consumer

Type Members

1. case class Broker(host: String, port: Int) extends Product with Serializable

   

2. class ConsumerRebalancer[K, V] extends IZkStateListener with IZkDataListener with IZkChildListener with LazyLogging

   

   Manages rebalancing of consumers across jvms

   Manages rebalancing of consumers across jvms

   Consumer info is kept in zookeeper - changes to partitions or number of consumers triggers a zookeeper listener, which causes a rebalance to be run.

   During rebalance, each partition will be assigned to a single consumer - if there are more consumers than partitions, some consumers will not receive any data.

3. trait Fetcher extends LazyLogging

   

4. case class KafkaConsumer[K, V](topic: String, config: ConsumerConfig, keyDecoder: Decoder[K], valueDecoder: Decoder[V]) extends LazyLogging with Product with Serializable

   

   Kafka consumer that allows reading a stream from various offsets (vs just the last read)

5. class KafkaConsumerFactory extends AnyRef

   

6. class KafkaStreamLike[K, V] extends Iterable[MessageAndMetadata[K, V]]

   

   Replacement for kafka.consumer.KafkaStream - the original uses private methods we can't access

7. case class WrappedConsumer(consumer: SimpleConsumer, tap: TopicAndPartition, config: ConsumerConfig) extends Product with Serializable

   

   Container for passing around a consumer so that it can be rebuilt without losing the reference to it