com.datastax.spark.connector.util

ConfigCheck

Related Doc: package util

object ConfigCheck

Helper class to throw exceptions if there are environment variables in the spark.cassandra namespace which don't map to Spark Cassandra Connector known properties.

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. ConfigCheck
  2. AnyRef
  3. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Type Members

  1. class ConnectorConfigurationException extends ConfigurationException

    Exception to be thrown when unknown properties are found in the SparkConf

Value Members

  1. final def !=(arg0: Any): Boolean

    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean

    Definition Classes
    AnyRef → Any
  4. val MatchThreshold: Double

  5. val Prefix: String

  6. final def asInstanceOf[T0]: T0

    Definition Classes
    Any
  7. def checkConfig(conf: SparkConf): Unit

    Checks the SparkConf Object for any unknown spark.cassandra.* properties and throws an exception with suggestions if an unknown property is found.

    Checks the SparkConf Object for any unknown spark.cassandra.* properties and throws an exception with suggestions if an unknown property is found.

    conf

    SparkConf object to check

  8. def clone(): AnyRef

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  9. final def eq(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  10. def equals(arg0: Any): Boolean

    Definition Classes
    AnyRef → Any
  11. def finalize(): Unit

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  12. final def getClass(): Class[_]

    Definition Classes
    AnyRef → Any
  13. def hashCode(): Int

    Definition Classes
    AnyRef → Any
  14. final def isInstanceOf[T0]: Boolean

    Definition Classes
    Any
  15. final def ne(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  16. final def notify(): Unit

    Definition Classes
    AnyRef
  17. final def notifyAll(): Unit

    Definition Classes
    AnyRef
  18. def suggestedProperties(unknownProp: String, extraProps: Set[String] = Set.empty): Seq[String]

    For a given unknown property determine if we have any guesses as to what the property should be.

    For a given unknown property determine if we have any guesses as to what the property should be. Suggestions are found by breaking the unknown property into fragments. spark.cassandra.foo.bar => [foo,bar] Any known property which has some fragments which fuzzy match all of the fragments of the unknown property are considered a suggestion.

    Fuzziness is determined by MatchThreshold

  19. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes
    AnyRef
  20. def toString(): String

    Definition Classes
    AnyRef → Any
  21. def unknownProperties(conf: SparkConf, extraProps: Set[String] = Set.empty): Seq[String]

  22. val validStaticProperties: Set[String]

    Set of valid static properties hardcoded in the connector.

    Set of valid static properties hardcoded in the connector. Custom CassandraConnectionFactory and AuthConf properties are not listed here.

  23. final def wait(): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  24. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  25. final def wait(arg0: Long): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from AnyRef

Inherited from Any

Ungrouped