Package

com.mongodb

spark

Permalink

package spark

The MongoDB Spark Connector

Since

1.0

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. spark
  2. AnyRef
  3. Any
  1. Hide All
  2. Show all
Visibility
  1. Public
  2. All

Type Members

  1. trait MongoClientFactory extends Serializable

    Permalink

    A factory for creating MongoClients

    A factory for creating MongoClients

    Note: Care should be taken to implement an equals method to ensure that the MongoClientCache can cache and reuse the resulting MongoClient.

    Since

    1.0

  2. case class MongoConnector(mongoClientFactory: MongoClientFactory) extends Logging with Serializable with Closeable with Product with Serializable

    Permalink

    The MongoConnector

    The MongoConnector

    Connects Spark to MongoDB

    mongoClientFactory

    the factory that can be used to create a MongoClient

    Since

    1.0

  3. case class MongoSpark(sqlContext: SQLContext, connector: MongoConnector, readConfig: ReadConfig, pipeline: Seq[BsonDocument]) extends Product with Serializable

    Permalink

    The MongoSpark class

    The MongoSpark class

    Note: Creation of the class should be via MongoSpark$.builder.

    Since

    1.0

  4. trait NotNothing[T] extends AnyRef

    Permalink

    :: DeveloperApi ::

    :: DeveloperApi ::

    NotNothing bottom type constraint for methods allowing a generic type that is not Nothing.

    Annotations
    @DeveloperApi() @implicitNotFound( ... )
  5. case class SparkContextFunctions(sc: SparkContext) extends Serializable with Product

    Permalink

    :: DeveloperApi ::

    :: DeveloperApi ::

    Helpers to create com.mongodb.spark.rdd.MongoRDD in the current SparkContext.

    sc

    the Spark context

    Annotations
    @DeveloperApi()
    Since

    1.0

Value Members

  1. object DefaultHelper

    Permalink

    :: DeveloperApi ::

    :: DeveloperApi ::

    A helper containing the sealed DefaultsTo trait which is used to determine the default type for a given method.

    Annotations
    @DeveloperApi()
    Since

    1.0

  2. object MongoConnector extends Serializable

    Permalink

    The MongoConnector companion object

    The MongoConnector companion object

    Since

    1.0

  3. object MongoSpark extends Serializable

    Permalink

    The MongoSpark helper allows easy creation of RDDs, DataFrames or Datasets from MongoDB.

    The MongoSpark helper allows easy creation of RDDs, DataFrames or Datasets from MongoDB.

    Since

    1.0

  4. object NotNothing

    Permalink

    :: DeveloperApi ::

    :: DeveloperApi ::

    NotNothing bottom type constraint for methods allowing a generic type that is not Nothing.

    Annotations
    @DeveloperApi()
  5. package annotation

    Permalink
  6. implicit def classTagToClassOf[C](ct: ClassTag[C]): Class[C]

    Permalink

    :: DeveloperApi ::

    :: DeveloperApi ::

    Helper to get the class from a classTag

    C

    the class type

    ct

    the classTag we want to implicitly get the class of

    returns

    the classOf[C]

    Annotations
    @DeveloperApi()
  7. package config

    Permalink
  8. package exceptions

    Permalink
  9. package rdd

    Permalink
  10. package sql

    Permalink

    The Mongo Spark Connector Sql package

  11. implicit def toDocumentRDDFunctions[D](rdd: RDD[D])(implicit e: DefaultsTo[D, Document], ct: ClassTag[D]): DocumentRDDFunctions[D]

    Permalink

    :: DeveloperApi ::

    :: DeveloperApi ::

    Helper to implicitly add MongoDB based functions to a SparkContext

    rdd

    the RDD to save to MongoDB

    returns

    the MongoDB based Spark Context

    Annotations
    @DeveloperApi()
  12. implicit def toSparkContextFunctions(sc: SparkContext): SparkContextFunctions

    Permalink

    :: DeveloperApi ::

    :: DeveloperApi ::

    Helper to implicitly add MongoDB based functions to a SparkContext

    sc

    the current SparkContext

    returns

    the MongoDB based Spark Context

    Annotations
    @DeveloperApi()

Inherited from AnyRef

Inherited from Any

Ungrouped