Class

com.jcdecaux.setl.storage.connector

CassandraConnector

Related Doc: package connector

Permalink

class CassandraConnector extends DBConnector

CassandraConnector establish the connection to a given cassandra table of a given keyspace

Annotations
@Evolving()
Linear Supertypes
DBConnector, HasSparkSession, Connector, Logging, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. CassandraConnector
  2. DBConnector
  3. HasSparkSession
  4. Connector
  5. Logging
  6. AnyRef
  7. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new CassandraConnector(spark: SparkSession, config: Config)

    Permalink

    Constructor with a com.typesafe.config.Config object

    Constructor with a com.typesafe.config.Config object

    spark

    spark session

    config

    com.typesafe.config.Config typesafe Config object

  2. new CassandraConnector(spark: SparkSession, conf: Conf)

    Permalink

    Constructor with a com.jcdecaux.setl.config.Conf object

    Constructor with a com.jcdecaux.setl.config.Conf object

    spark

    spark session

    conf

    com.jcdecaux.setl.config.Conf object

  3. new CassandraConnector(config: Config)

    Permalink

    Constructor with a com.typesafe.config.Config object

    Constructor with a com.typesafe.config.Config object

    config

    com.typesafe.config.Config typesafe Config object

  4. new CassandraConnector(conf: Conf)

    Permalink

    Constructor with a com.jcdecaux.setl.config.Conf object

    Constructor with a com.jcdecaux.setl.config.Conf object

    conf

    com.jcdecaux.setl.config.Conf object

  5. new CassandraConnector(keyspace: String, table: String, spark: SparkSession, partitionKeyColumns: Option[Seq[String]], clusteringKeyColumns: Option[Seq[String]])

    Permalink

  6. new CassandraConnector(keyspace: String, table: String, partitionKeyColumns: Option[Seq[String]], clusteringKeyColumns: Option[Seq[String]])

    Permalink

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any

  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  4. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any

  5. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  6. val clusteringKeyColumns: Option[Seq[String]]

    Permalink

  7. def create(df: DataFrame): Unit

    Permalink
    Definition Classes
    CassandraConnector → DBConnector

  8. def create(df: DataFrame, suffix: Option[String]): Unit

    Permalink

    Create a Cassandra table for a DataFrame

    Create a Cassandra table for a DataFrame

    df

    DataFrame that will be used to create Cassandra table

    Definition Classes
    CassandraConnector → DBConnector

  9. def delete(query: String): Unit

    Permalink

    Delete a record

    Delete a record

    query

    query string

    Definition Classes
    CassandraConnector → DBConnector

  10. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef

  11. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  12. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )

  13. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any

  14. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any

  15. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any

  16. val keyspace: String

    Permalink

  17. def log: Logger

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  18. def logName: String

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  19. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef

  20. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef

  21. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef

  22. val partitionKeyColumns: Option[Seq[String]]

    Permalink

  23. def read(): DataFrame

    Permalink

    Read a cassandra table

    Read a cassandra table

    Definition Classes
    CassandraConnector → Connector

  24. val reader: DataFrameReader

    Permalink
    Definition Classes
    CassandraConnector → Connector

  25. val spark: SparkSession

    Permalink
    Definition Classes
    HasSparkSession

  26. val storage: Storage

    Permalink
    Definition Classes
    CassandraConnector → Connector

  27. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef

  28. val table: String

    Permalink

  29. def toString(): String

    Permalink
    Definition Classes
    AnyRef → Any

  30. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  31. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  32. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  33. def write(df: DataFrame): Unit

    Permalink
    Definition Classes
    CassandraConnector → Connector

  34. def write(df: DataFrame, suffix: Option[String]): Unit

    Permalink

    Write a DataFrame into a Cassandra table

    Write a DataFrame into a Cassandra table

    df

    DataFrame to be saved

    Definition Classes
    CassandraConnector → Connector

  35. val writer: (DataFrame) ⇒ DataFrameWriter[Row]

    Permalink
    Definition Classes
    CassandraConnector → Connector

Inherited from DBConnector

Inherited from HasSparkSession

Inherited from Connector

Inherited from Logging

Inherited from AnyRef

Inherited from Any

Ungrouped