io.gearpump.streaming.kafka.lib

KafkaSourceConfig

class KafkaSourceConfig extends Serializable

this class extends kafka kafka.consumer.ConsumerConfig with specific configs for KafkaSource

Linear Supertypes
Serializable, AnyRef, Any
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. KafkaSourceConfig
  2. Serializable
  3. AnyRef
  4. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Instance Constructors

  1. new KafkaSourceConfig(consumerProps: Properties = new java.util.Properties())

    consumerProps

    kafka consumer config

Value Members

  1. final def !=(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  2. final def !=(arg0: Any): Boolean

    Definition Classes
    Any

  3. final def ##(): Int

    Definition Classes
    AnyRef → Any

  4. final def ==(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  5. final def ==(arg0: Any): Boolean

    Definition Classes
    Any

  6. final def asInstanceOf[T0]: T0

    Definition Classes
    Any

  7. def clone(): AnyRef

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  8. def consumerConfig: ConsumerConfig

  9. val consumerProps: Properties

    kafka consumer config

  10. final def eq(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  11. def equals(arg0: Any): Boolean

    Definition Classes
    AnyRef → Any

  12. def finalize(): Unit

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )

  13. final def getClass(): Class[_]

    Definition Classes
    AnyRef → Any

  14. def getConsumerTopics: List[String]

    returns

    a list of kafka consumer topics

  15. def getFetchSleepMS: Int

    consumer.FetchThread will sleep for a while if no more messages or the incoming queue size is above the io.gearpump.streaming.kafka.lib.KafkaSourceConfig.FETCH_THRESHOLD this is to get sleep interval

    consumer.FetchThread will sleep for a while if no more messages or the incoming queue size is above the io.gearpump.streaming.kafka.lib.KafkaSourceConfig.FETCH_THRESHOLD this is to get sleep interval

    returns

    sleep interval in milliseconds

  16. def getFetchThreshold: Int

    io.gearpump.streaming.kafka.lib.consumer.FetchThread stops fetching new messages if its incoming queue size is above the threshold and starts again when the queue size is below it

    io.gearpump.streaming.kafka.lib.consumer.FetchThread stops fetching new messages if its incoming queue size is above the threshold and starts again when the queue size is below it

    returns

    fetch threshold

  17. def getGrouper: KafkaGrouper

    get io.gearpump.streaming.kafka.lib.grouper.KafkaGrouper instance, which defines how kafka.

    get io.gearpump.streaming.kafka.lib.grouper.KafkaGrouper instance, which defines how kafka.common.TopicAndPartitions are mapped to source tasks

    returns

  18. def hashCode(): Int

    Definition Classes
    AnyRef → Any

  19. final def isInstanceOf[T0]: Boolean

    Definition Classes
    Any

  20. final def ne(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  21. final def notify(): Unit

    Definition Classes
    AnyRef

  22. final def notifyAll(): Unit

    Definition Classes
    AnyRef

  23. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes
    AnyRef

  24. def toString(): String

    Definition Classes
    AnyRef → Any

  25. final def wait(): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  26. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  27. final def wait(arg0: Long): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  28. def withConsumerTopics(topics: String): KafkaSourceConfig

    set kafka consumer topics

    set kafka consumer topics

    topics

    comma-separated string

    returns

    new KafkaConfig based on this but with io.gearpump.streaming.kafka.lib.KafkaSourceConfig.CONSUMER_TOPICS set to given value

  29. def withFetchSleepMS(sleepMS: Int): KafkaSourceConfig

    consumer.FetchThread will sleep for a while if no more messages or the incoming queue size is above the io.gearpump.streaming.kafka.lib.KafkaSourceConfig.FETCH_THRESHOLD this is to set sleep interval

    consumer.FetchThread will sleep for a while if no more messages or the incoming queue size is above the io.gearpump.streaming.kafka.lib.KafkaSourceConfig.FETCH_THRESHOLD this is to set sleep interval

    sleepMS

    sleep interval in milliseconds

    returns

    new KafkaConfig based on this but with io.gearpump.streaming.kafka.lib.KafkaSourceConfig.FETCH_SLEEP_MS set to given value

  30. def withFetchThreshold(threshold: Int): KafkaSourceConfig

    consumer.FetchThread stops fetching new messages if its incoming queue size is above the threshold and starts again when the queue size is below it

    consumer.FetchThread stops fetching new messages if its incoming queue size is above the threshold and starts again when the queue size is below it

    threshold

    queue size

    returns

    new KafkaConfig based on this but with io.gearpump.streaming.kafka.lib.KafkaSourceConfig.FETCH_THRESHOLD set to give value

  31. def withGrouper(className: String): KafkaSourceConfig

    set io.gearpump.streaming.kafka.lib.grouper.KafkaGrouper, which defines how kafka.

    set io.gearpump.streaming.kafka.lib.grouper.KafkaGrouper, which defines how kafka.common.TopicAndPartitions are mapped to source tasks

    className

    name of the factory class

    returns

    new KafkaConfig based on this but with io.gearpump.streaming.kafka.lib.KafkaSourceConfig.GROUPER_CLASS set to given value

Inherited from Serializable

Inherited from AnyRef

Inherited from Any

Ungrouped