com.github.benfradet.spark.kafka

writer

package writer

Implicit conversions between

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. writer
  2. AnyRef
  3. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Type Members

  1. class DStreamKafkaWriter[T] extends KafkaWriter[T] with Serializable

    Class used for writing DStreams to Kafka

  2. class DatasetKafkaWriter[T] extends KafkaWriter[T] with Serializable

    Class used for writing Datasets to Kafka

  3. abstract class KafkaWriter[T] extends Serializable

    Class used to write DStreams, RDDs and Datasets to Kafka

  4. class RDDKafkaWriter[T] extends KafkaWriter[T] with Serializable

    Class used for writing RDDs to Kafka

Value Members

  1. object KafkaProducerCache

    Cache of KafkaProducers

  2. implicit def dStreamToKafkaWriter[T, K, V](dStream: DStream[T])(implicit arg0: ClassTag[T]): KafkaWriter[T]

    Convert a DStream to a KafkaWriter implicitly

    Convert a DStream to a KafkaWriter implicitly

    dStream

    DStream to be converted

    returns

    KafkaWriter ready to write messages to Kafka

  3. implicit def datasetToKafkaWriter[K, V](dataFrame: DataFrame): KafkaWriter[Row]

    Convert a DataFrame to a KafkaWriter implicitly

    Convert a DataFrame to a KafkaWriter implicitly

    dataFrame

    DataFrame to be converted

    returns

    KafkaWriter ready to write messages to Kafka

  4. implicit def datasetToKafkaWriter[T, K, V](dataset: Dataset[T])(implicit arg0: ClassTag[T]): KafkaWriter[T]

    Convert a Dataset to a KafkaWriter implicitly

    Convert a Dataset to a KafkaWriter implicitly

    dataset

    Dataset to be converted

    returns

    KafkaWriter ready to write messages to Kafka

  5. implicit def rddToKafkaWriter[T, K, V](rdd: RDD[T])(implicit arg0: ClassTag[T]): KafkaWriter[T]

    Convert a RDD to a KafkaWriter implicitly

    Convert a RDD to a KafkaWriter implicitly

    rdd

    RDD to be converted

    returns

    KafkaWriter ready to write messages to Kafka

Inherited from AnyRef

Inherited from Any

Ungrouped