ReadConfig
Related Docs:
class ReadConfig
| package config
The type of the MongoConfig
The type of the MongoConfig
Create a configuration from the values in the Map, using the optional default configuration for any default values.
Create a configuration from the values in the Map, using the optional default configuration for any default values.
*Note:* Values in the map do not need to be prefixed with the configPrefix.
a map of properties and their string values
the optional default configuration, used for determining the default values for the properties
the configuration
Create a configuration from the values in the Map
Create a configuration from the values in the Map
*Note:* Values in the map do not need to be prefixed with the configPrefix.
a map of properties and their string values
the configuration
Create a configuration from the sparkConf
Create a configuration from the sparkConf
Uses the prefixed properties that are set in the Spark configuration to create the config.
the spark configuration
the configuration
Create a configuration from the sparkContext
Create a configuration from the sparkContext
Uses the prefixed properties that are set in the Spark configuration to create the config.
the spark context
the configuration
The collection name property
The collection name property
The configuration prefix string for the current configuration scope
The configuration prefix string for the current configuration scope
Create a configuration easily from the Java API using the values in the Map, using the optional default configuration for any
default values.
Create a configuration easily from the Java API using the values in the Map, using the optional default configuration for any
default values.
*Note:* Values in the map do not need to be prefixed with the configPrefix.
a map of properties and their string values
the optional default configuration, used for determining the default values for the properties
the configuration
Create a configuration easily from the Java API using the values in the Map
Create a configuration easily from the Java API using the values in the Map
*Note:* Values in the map do not need to be prefixed with the configPrefix.
a map of properties and their string values
the configuration
Create a configuration easily from the Java API using the sparkConf
Create a configuration easily from the Java API using the sparkConf
Uses the prefixed properties that are set in the Spark configuration to create the config.
the spark configuration
the configuration
Create a configuration easily from the Java API using the JavaSparkContext
Create a configuration easily from the Java API using the JavaSparkContext
Uses the prefixed properties that are set in the Spark configuration to create the config.
the java spark context
the configuration
Read Configuration used when reading data from MongoDB
Read Configuration used when reading data from MongoDB
the database name
the collection name
the optional connection string used in the creation of this configuration
a positive integer sample size to draw from the collection when inferring the schema
the maximum chunkSize for non-sharded collections
the key to split the collection by for non-sharded collections or the "shard key" for sharded collection
the local threshold in milliseconds used when choosing among multiple MongoDB servers to send a request. Only servers whose ping time is less than or equal to the server with the fastest ping time plus the local threshold will be chosen.
the readPreference configuration
the readConcern configuration
1.0
The database name property
The database name property
The localThreshold property
The localThreshold property
The local threshold in milliseconds is used when choosing among multiple MongoDB servers to send a request. Only servers whose ping time is less than or equal to the server with the fastest ping time *plus* the local threshold will be chosen.
For example when choosing which MongoS to send a request through a localThreshold of 0 would pick the MongoS with the fastest ping time.
Default: 15 ms
The max chunk size property
The max chunk size property
Represents the max size (in MB) for each partition. Only used when partitioning non-sharded collections.
Default: 64
The mongo URI property
The mongo URI property
Represents a connection string.
Any values set in the connection string will override any default values for the configuration.
The ReadConcern level property
The ReadConcern level property
The ReadPreference name property
The ReadPreference name property
Default: ACKNOWLEDGED
The ReadPreference tags property
The ReadPreference tags property
The sample size property
The sample size property
Used when sampling data from MongoDB to determine the Schema.
Default: 1000
The split key property
The split key property
Represents the key to be used when partitioning the data in the collection.
Default: _id
The
ReadConfigcompanion objectConfiguration Properties
The prefix when using
sparkConfis:spark.mongodb.input.followed by the property name:ReadPreferenceto use.ReadPreferenceTagSets to use.ReadConcernlevel to use.1.0