com.mongodb.spark.rdd.partitioner
Calculate the Partitions
Calculate the Partitions
the MongoConnector
the pipeline to apply if any. Note this pipeline may have been appended to during optimization.
the partitions
The shardKey property
The shardKey property
The shardKey value can be the name of a single key eg: _id
or for compound keys the extended json form eg: {a: 1, b: 1}
The Sharded Partitioner
Partitions collections by shard and chunk.
Configuration Properties
The prefix when using
sparkConf
is:spark.mongodb.input.partitionerOptions
followed by the property name:_id
.1.0