com.mongodb.spark.rdd.partitioner
Calculate the Partitions
Calculate the Partitions
the MongoConnector
the partitions
The shardKey property
The shardKey property
The shardKey value can be the name of a single key eg: _id
or for compound keys the extended json form eg: {a: 1, b: 1}
The Sharded Partitioner
Partitions collections by shard and chunk.
Configuration Properties
The prefix when using
sparkConf
is:spark.mongodb.input.partitionerOptions
followed by the property name:_id
.1.0