Object

org.apache.spark.streaming.kafka010

ConsumerStrategies

Related Doc: package kafka010

Permalink

object ConsumerStrategies

:: Experimental :: object for obtaining instances of ConsumerStrategy

Annotations
@Experimental()
Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. ConsumerStrategies
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  4. def Assign[K, V](topicPartitions: Collection[TopicPartition], kafkaParams: Map[String, AnyRef]): ConsumerStrategy[K, V]

    Permalink

    :: Experimental :: Assign a fixed collection of TopicPartitions

    :: Experimental :: Assign a fixed collection of TopicPartitions

    topicPartitions

    collection of TopicPartitions to assign

    kafkaParams

    Kafka configuration parameters to be used on driver. The same params will be used on executors, with minor automatic modifications applied. Requires "bootstrap.servers" to be set with Kafka broker(s) specified in host1:port1,host2:port2 form.

    Annotations
    @Experimental()
  5. def Assign[K, V](topicPartitions: Collection[TopicPartition], kafkaParams: Map[String, AnyRef], offsets: Map[TopicPartition, Long]): ConsumerStrategy[K, V]

    Permalink

    :: Experimental :: Assign a fixed collection of TopicPartitions

    :: Experimental :: Assign a fixed collection of TopicPartitions

    topicPartitions

    collection of TopicPartitions to assign

    kafkaParams

    Kafka configuration parameters to be used on driver. The same params will be used on executors, with minor automatic modifications applied. Requires "bootstrap.servers" to be set with Kafka broker(s) specified in host1:port1,host2:port2 form.

    Annotations
    @Experimental()
  6. def Assign[K, V](topicPartitions: Iterable[TopicPartition], kafkaParams: Map[String, AnyRef]): ConsumerStrategy[K, V]

    Permalink

    :: Experimental :: Assign a fixed collection of TopicPartitions

    :: Experimental :: Assign a fixed collection of TopicPartitions

    topicPartitions

    collection of TopicPartitions to assign

    kafkaParams

    Kafka configuration parameters to be used on driver. The same params will be used on executors, with minor automatic modifications applied. Requires "bootstrap.servers" to be set with Kafka broker(s) specified in host1:port1,host2:port2 form.

    Annotations
    @Experimental()
  7. def Assign[K, V](topicPartitions: Iterable[TopicPartition], kafkaParams: Map[String, AnyRef], offsets: Map[TopicPartition, Long]): ConsumerStrategy[K, V]

    Permalink

    :: Experimental :: Assign a fixed collection of TopicPartitions

    :: Experimental :: Assign a fixed collection of TopicPartitions

    topicPartitions

    collection of TopicPartitions to assign

    kafkaParams

    Kafka configuration parameters to be used on driver. The same params will be used on executors, with minor automatic modifications applied. Requires "bootstrap.servers" to be set with Kafka broker(s) specified in host1:port1,host2:port2 form.

    Annotations
    @Experimental()
  8. def Subscribe[K, V](topics: Collection[String], kafkaParams: Map[String, AnyRef]): ConsumerStrategy[K, V]

    Permalink

    :: Experimental :: Subscribe to a collection of topics.

    :: Experimental :: Subscribe to a collection of topics.

    topics

    collection of topics to subscribe

    kafkaParams

    Kafka configuration parameters to be used on driver. The same params will be used on executors, with minor automatic modifications applied. Requires "bootstrap.servers" to be set with Kafka broker(s) specified in host1:port1,host2:port2 form.

    Annotations
    @Experimental()
  9. def Subscribe[K, V](topics: Collection[String], kafkaParams: Map[String, AnyRef], offsets: Map[TopicPartition, Long]): ConsumerStrategy[K, V]

    Permalink

    :: Experimental :: Subscribe to a collection of topics.

    :: Experimental :: Subscribe to a collection of topics.

    topics

    collection of topics to subscribe

    kafkaParams

    Kafka configuration parameters to be used on driver. The same params will be used on executors, with minor automatic modifications applied. Requires "bootstrap.servers" to be set with Kafka broker(s) specified in host1:port1,host2:port2 form.

    Annotations
    @Experimental()
  10. def Subscribe[K, V](topics: Iterable[String], kafkaParams: Map[String, AnyRef]): ConsumerStrategy[K, V]

    Permalink

    :: Experimental :: Subscribe to a collection of topics.

    :: Experimental :: Subscribe to a collection of topics.

    topics

    collection of topics to subscribe

    kafkaParams

    Kafka configuration parameters to be used on driver. The same params will be used on executors, with minor automatic modifications applied. Requires "bootstrap.servers" to be set with Kafka broker(s) specified in host1:port1,host2:port2 form.

    Annotations
    @Experimental()
  11. def Subscribe[K, V](topics: Iterable[String], kafkaParams: Map[String, AnyRef], offsets: Map[TopicPartition, Long]): ConsumerStrategy[K, V]

    Permalink

    :: Experimental :: Subscribe to a collection of topics.

    :: Experimental :: Subscribe to a collection of topics.

    topics

    collection of topics to subscribe

    kafkaParams

    Kafka configuration parameters to be used on driver. The same params will be used on executors, with minor automatic modifications applied. Requires "bootstrap.servers" to be set with Kafka broker(s) specified in host1:port1,host2:port2 form.

    Annotations
    @Experimental()
  12. def SubscribePattern[K, V](pattern: Pattern, kafkaParams: Map[String, AnyRef]): ConsumerStrategy[K, V]

    Permalink

    :: Experimental :: Subscribe to all topics matching specified pattern to get dynamically assigned partitions.

    :: Experimental :: Subscribe to all topics matching specified pattern to get dynamically assigned partitions. The pattern matching will be done periodically against topics existing at the time of check.

    pattern

    pattern to subscribe to

    kafkaParams

    Kafka configuration parameters to be used on driver. The same params will be used on executors, with minor automatic modifications applied. Requires "bootstrap.servers" to be set with Kafka broker(s) specified in host1:port1,host2:port2 form.

    Annotations
    @Experimental()
  13. def SubscribePattern[K, V](pattern: Pattern, kafkaParams: Map[String, AnyRef], offsets: Map[TopicPartition, Long]): ConsumerStrategy[K, V]

    Permalink

    :: Experimental :: Subscribe to all topics matching specified pattern to get dynamically assigned partitions.

    :: Experimental :: Subscribe to all topics matching specified pattern to get dynamically assigned partitions. The pattern matching will be done periodically against topics existing at the time of check.

    pattern

    pattern to subscribe to

    kafkaParams

    Kafka configuration parameters to be used on driver. The same params will be used on executors, with minor automatic modifications applied. Requires "bootstrap.servers" to be set with Kafka broker(s) specified in host1:port1,host2:port2 form.

    Annotations
    @Experimental()
  14. def SubscribePattern[K, V](pattern: Pattern, kafkaParams: Map[String, AnyRef]): ConsumerStrategy[K, V]

    Permalink

    :: Experimental :: Subscribe to all topics matching specified pattern to get dynamically assigned partitions.

    :: Experimental :: Subscribe to all topics matching specified pattern to get dynamically assigned partitions. The pattern matching will be done periodically against topics existing at the time of check.

    pattern

    pattern to subscribe to

    kafkaParams

    Kafka configuration parameters to be used on driver. The same params will be used on executors, with minor automatic modifications applied. Requires "bootstrap.servers" to be set with Kafka broker(s) specified in host1:port1,host2:port2 form.

    Annotations
    @Experimental()
  15. def SubscribePattern[K, V](pattern: Pattern, kafkaParams: Map[String, AnyRef], offsets: Map[TopicPartition, Long]): ConsumerStrategy[K, V]

    Permalink

    :: Experimental :: Subscribe to all topics matching specified pattern to get dynamically assigned partitions.

    :: Experimental :: Subscribe to all topics matching specified pattern to get dynamically assigned partitions. The pattern matching will be done periodically against topics existing at the time of check.

    pattern

    pattern to subscribe to

    kafkaParams

    Kafka configuration parameters to be used on driver. The same params will be used on executors, with minor automatic modifications applied. Requires "bootstrap.servers" to be set with Kafka broker(s) specified in host1:port1,host2:port2 form.

    Annotations
    @Experimental()
  16. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  17. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  18. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  19. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  20. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  21. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
  22. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  23. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  24. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  25. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
  26. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
  27. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  28. def toString(): String

    Permalink
    Definition Classes
    AnyRef → Any
  29. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  30. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  31. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from AnyRef

Inherited from Any

Ungrouped