CassandraSinkTask

Instance Constructors

new CassandraSinkTask()

Value Members

final def !=(arg0: AnyRef): Boolean

Definition Classes
AnyRef
final def !=(arg0: Any): Boolean

Definition Classes
Any
final def ##(): Int

Definition Classes
AnyRef → Any
final def ==(arg0: AnyRef): Boolean

Definition Classes
AnyRef
final def ==(arg0: Any): Boolean

Definition Classes
Any
final def asInstanceOf[T0]: T0

Definition Classes
Any
def clone(): AnyRef

Attributes
protected[java.lang]
Definition Classes
AnyRef
Annotations
@throws( ... )
var cluster: Option[CassandraCluster]

Attributes
protected
Definition Classes
CassandraTask
var configT: Map[String, String]

Attributes
protected
Definition Classes
ConnectorLike
def configure(conf: Map[String, String], taskClass: Class[_ <: Task]): Unit

Reads in the user provided configuration for a given source or sink.
Reads in the user provided configuration for a given source or sink. Fails fast on org.apache.kafka.connect.connector.Connector start if not valid.
Because user params can be a mine field on bugs farther down stream we attempt to catch as many up front as we can.
conf
the user config

Attributes
protected
Definition Classes
ConnectorLike
Exceptions thrown
org.apache.kafka.common.config.ConfigException
if requirements not met
final def eq(arg0: AnyRef): Boolean

Definition Classes
AnyRef
def equals(arg0: Any): Boolean

Definition Classes
AnyRef → Any
def finalize(): Unit

Attributes
protected[java.lang]
Definition Classes
AnyRef
Annotations
@throws( classOf[java.lang.Throwable] )
def flush(offsets: Map[TopicPartition, OffsetAndMetadata]): Unit

This method is not relevant as we insert every received record in Cassandra.
This method is not relevant as we insert every received record in Cassandra.

Definition Classes
CassandraSinkTask → SinkTask
final def getClass(): Class[_]

Definition Classes
AnyRef → Any
def hashCode(): Int

Definition Classes
AnyRef → Any
def initialize(arg0: SinkTaskContext): Unit

Definition Classes
SinkTask
final def isInstanceOf[T0]: Boolean

Definition Classes
Any
def localNode(rpcAddressColumn: String, listenAddressColumn: String): ResultSet

Attributes
protected
Definition Classes
CassandraClusterApi
val logger: Logger

Attributes
protected
Definition Classes
Logging
lazy val metadata: Metadata

Attributes
protected
Definition Classes
CassandraClusterApi
final def ne(arg0: AnyRef): Boolean

Definition Classes
AnyRef
final def notify(): Unit

Definition Classes
AnyRef
final def notifyAll(): Unit

Definition Classes
AnyRef
def onPartitionsAssigned(arg0: Collection[TopicPartition]): Unit

Definition Classes
SinkTask
def onPartitionsRevoked(arg0: Collection[TopicPartition]): Unit

Definition Classes
SinkTask
def partitioner: String

Returns the FQCN of the partitioner, which will NOT be on the classpath.
Returns the FQCN of the partitioner, which will NOT be on the classpath. org.apache.cassandra.dht.{Murmur3Partitioner, RandomPartitioner...}

Attributes
protected
Definition Classes
CassandraClusterApi
def put(records: Collection[SinkRecord]): Unit

Writes records from Kafka to Cassandra asynchronously and non-blocking.
Writes records from Kafka to Cassandra asynchronously and non-blocking.

Definition Classes
CassandraSinkTask → SinkTask
var routes: List[Route]

Attributes
protected
Definition Classes
ConnectorLike
def session: Session

Definition Classes
CassandraTask → CassandraClusterApi
def start(taskConfig: Map[String, String]): Unit

Restarts call stop() then start().
Restarts call stop() then start().

Definition Classes
CassandraSinkTask → CassandraTask → SinkTask → Task
def stop(): Unit

Definition Classes
CassandraTask → Task
final def synchronized[T0](arg0: ⇒ T0): T0

Definition Classes
AnyRef
def tableFor(ns: Route): Option[TableMetadata]

Returns table metadata if the keyspace and table exist in the Cassandra cluster being connected to, and the coordinates have been configured.
Returns table metadata if the keyspace and table exist in the Cassandra cluster being connected to, and the coordinates have been configured.

Attributes
protected
Definition Classes
CassandraClusterApi
Exceptions thrown
org.apache.kafka.connect.errors.ConnectException
The datastax java driver returns null Keyspace or null Table if either do not exist, so we alert the user application via ConnectException and do not proceed, to not propagate NPEs.
val taskClass: Class[_ <: Task]

Attributes
protected
Definition Classes
CassandraSinkTask → CassandraTask
var taskConfig: TaskConfig

The parsed values based on the config map passed in on start.
The parsed values based on the config map passed in on start. The Kafka mutable java map is converted to a scala immutable, parsed based on whether this is for a source or sink or task thereof, then validated by type.
If a source task, this will have one or more SourceConfigs. If a sink task, this will have one or more SinkConfigs. Currently we hand each task a unique topic to keyspace and table mapping. Roadmap: Parallism partitioning strategy configurable by user.

Attributes
protected
Definition Classes
CassandraTask
var taskStrategy: TaskStrategy

Initialized as the default, user can override.
Initialized as the default, user can override.

Attributes
protected
Definition Classes
ConnectorLike
def toString(): String

Definition Classes
AnyRef → Any
final val version: String

Attributes
protected
Definition Classes
ConnectorLike
final def wait(): Unit

Definition Classes
AnyRef
Annotations
@throws( ... )
final def wait(arg0: Long, arg1: Int): Unit

Definition Classes
AnyRef
Annotations
@throws( ... )
final def wait(arg0: Long): Unit

Definition Classes
AnyRef
Annotations
@throws( ... )

class CassandraSinkTask extends SinkTask with CassandraTask

Instance Constructors

new CassandraSinkTask()

Value Members

final def !=(arg0: AnyRef): Boolean

final def !=(arg0: Any): Boolean

final def ##(): Int

final def ==(arg0: AnyRef): Boolean

final def ==(arg0: Any): Boolean

final def asInstanceOf[T0]: T0

def clone(): AnyRef

var cluster: Option[CassandraCluster]

var configT: Map[String, String]

def configure(conf: Map[String, String], taskClass: Class[_ <: Task]): Unit

final def eq(arg0: AnyRef): Boolean

def equals(arg0: Any): Boolean

def finalize(): Unit

def flush(offsets: Map[TopicPartition, OffsetAndMetadata]): Unit

final def getClass(): Class[_]

def hashCode(): Int

def initialize(arg0: SinkTaskContext): Unit

final def isInstanceOf[T0]: Boolean

def localNode(rpcAddressColumn: String, listenAddressColumn: String): ResultSet

val logger: Logger

lazy val metadata: Metadata

final def ne(arg0: AnyRef): Boolean

final def notify(): Unit

final def notifyAll(): Unit

def onPartitionsAssigned(arg0: Collection[TopicPartition]): Unit

def onPartitionsRevoked(arg0: Collection[TopicPartition]): Unit

def partitioner: String

def put(records: Collection[SinkRecord]): Unit

var routes: List[Route]

def session: Session

def start(taskConfig: Map[String, String]): Unit

def stop(): Unit

final def synchronized[T0](arg0: ⇒ T0): T0

def tableFor(ns: Route): Option[TableMetadata]

val taskClass: Class[_ <: Task]

var taskConfig: TaskConfig

var taskStrategy: TaskStrategy

def toString(): String

final val version: String

final def wait(): Unit

final def wait(arg0: Long, arg1: Int): Unit

final def wait(arg0: Long): Unit

Inherited from CassandraTask

Inherited from CassandraClusterApi

Inherited from ConnectorLike

Inherited from Logging

Inherited from SinkTask

Inherited from Task

Inherited from AnyRef

Inherited from Any

Ungrouped