Package

com.mongodb.spark.rdd

partitioner

Permalink

package partitioner

Visibility

Public
All

Type Members

case class MongoPartition(index: Int, queryBounds: BsonDocument, locations: Seq[String]) extends Partition with Product with Serializable

An identifier for a partition in a MongoRDD.
An identifier for a partition in a MongoRDD.
index
The partition's index within its parent RDD
queryBounds
The query bounds for the data within this partition
locations
The preferred locations (hostnames) for the data

Since
1.0
trait MongoPartitioner extends Logging with Serializable

The MongoPartitioner provides the partitions of a collection
The MongoPartitioner provides the partitions of a collection

Since
1.0

Value Members

object DefaultMongoPartitioner extends Logging with MongoPartitioner with Product with Serializable

The default collection partitioner implementation
The default collection partitioner implementation
Checks if the collection is sharded then:
- If sharded uses the MongoShardedPartitioner to partition the collection by shard chunks
- If non sharded uses the MongoSplitVectorPartitioner to partition the collection by using the splitVector command.
Since
1.0
object MongoPartition extends Serializable

The MongoPartition companion object
The MongoPartition companion object

Since
1.0
object MongoShardedPartitioner extends Logging with MongoPartitioner with Product with Serializable

The Sharded Partitioner
The Sharded Partitioner
Partitions collections by shard and chunk.

Since
1.0
object MongoSinglePartitioner extends Logging with MongoPartitioner with Product with Serializable

The Single Partitioner.
The Single Partitioner.
Creates a single partition for the whole collection.
*Note:* Using this partitioner loses any parallelism and therefore is not generally recommended.

Since
1.0
object MongoSplitVectorPartitioner extends Logging with MongoPartitioner with Product with Serializable

The SplitVector Partitioner.
The SplitVector Partitioner.
Uses the SplitVector command on the primary node to generate partitions for a collection.

Since
1.0

Ungrouped