Create a configuration from the values in the Map
, using the optional default configuration for any default values.
Create a configuration from the values in the Map
, using the optional default configuration for any default values.
Note: Values in the map do not need to be prefixed with the configPrefix.
a map of properties and their string values
the optional default configuration, used for determining the default values for the properties
the configuration
The configuration prefix string for the current configuration scope
Create a configuration easily from the Java API using the values in the Map
, using the optional default configuration for any
default values.
Create a configuration easily from the Java API using the values in the Map
, using the optional default configuration for any
default values.
Note: Values in the map do not need to be prefixed with the configPrefix.
a map of properties and their string values
the optional default configuration, used for determining the default values for the properties
the configuration
Create a configuration easily from the Java API using the values in the Map
Create a configuration easily from the Java API using the values in the Map
Note: Values in the map do not need to be prefixed with the configPrefix.
a map of properties and their string values
the configuration
Create a configuration from the sparkConf
Create a configuration from the sparkConf
Uses the prefixed properties that are set in the Spark configuration to create the config.
the spark configuration
overloaded parameters
the configuration
Create a configuration easily from the Java API using the sparkConf
Create a configuration easily from the Java API using the sparkConf
Uses the prefixed properties that are set in the Spark configuration to create the config.
the spark configuration
the configuration
Create a configuration easily from the Java API using the JavaSparkContext
Create a configuration easily from the Java API using the JavaSparkContext
Uses the prefixed properties that are set in the Spark configuration to create the config.
the SparkSession
the configuration
Create a configuration easily from the Java API using the JavaSparkContext
Create a configuration easily from the Java API using the JavaSparkContext
Uses the prefixed properties that are set in the Spark configuration to create the config.
the java spark context
the configuration
Create a configuration easily from the Java API using the JavaSparkContext
Create a configuration easily from the Java API using the JavaSparkContext
Uses the prefixed properties that are set in the Spark configuration to create the config.
the SQL context
the configuration
(Since version 2.0.0) As of Spark 2.0 SQLContext was replaced by SparkSession. Use the SparkSession method instead
Create a configuration from the values in the Map
Create a configuration from the values in the Map
Note: Values in the map do not need to be prefixed with the configPrefix.
a map of properties and their string values
the configuration
Create a configuration from the sparkConf
Create a configuration from the sparkConf
Uses the prefixed properties that are set in the Spark configuration to create the config.
the spark configuration
overloaded parameters
the configuration
Create a configuration from the sparkConf
Create a configuration from the sparkConf
Uses the prefixed properties that are set in the Spark configuration to create the config.
the spark configuration
the configuration
Create a configuration from the sqlContext
Create a configuration from the sqlContext
Uses the prefixed properties that are set in the Spark configuration to create the config.
the SparkSession
the configuration
Create a configuration from the sparkContext
Create a configuration from the sparkContext
Uses the prefixed properties that are set in the Spark configuration to create the config.
the spark context
the configuration
Gets an options map from the SparkConf
Gets an options map from the SparkConf
the SparkConf
the options
The mongo URI property
The mongo URI property
Represents a connection string.
Any values set in the connection string will override any default values for the configuration.
Strip the prefix from options
Strip the prefix from options
options that may contain the prefix
prefixLess options
Create a configuration from the sqlContext
Create a configuration from the sqlContext
Uses the prefixed properties that are set in the Spark configuration to create the config.
the SQL context
the configuration
(Since version 2.0.0) As of Spark 2.0 SQLContext was replaced by SparkSession. Use the SparkSession method instead
The Mongo configuration base trait
Defines companion object helper methods for creating
MongoConfig
instances1.0