kafka

Type Members

1. abstract class BaseKafkaSourceFactory[T] extends FlinkSourceFactory[T] with Serializable

   

2. class ConsumerGroupDeterminer extends AnyRef

   

3. class KafkaExceptionConsumer extends FlinkEspExceptionConsumer

   

4. class KafkaSinkFactory extends SinkFactory

   

5. class KafkaSourceFactory[T] extends BaseKafkaSourceFactory[T]

   

   Wrapper for [[org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer]]
   Features:
     - fetch latest N records which can be later used to test process in UI
   Fetching data is defined in [[pl.touk.nussknacker.engine.kafka.BaseKafkaSourceFactory.KafkaSource]] which
   extends [[pl.touk.nussknacker.engine.api.process.TestDataGenerator]]. See [[pl.touk.nussknacker.engine.kafka.KafkaEspUtils#readLastMessages]]
     - reset Kafka's offset to latest value - `forceLatestRead` property, see [[pl.touk.nussknacker.engine.kafka.KafkaEspUtils#setOffsetToLatest]]
   
   BaseKafkaSourceFactory comes in two variants:
     - KafkaSourceFactory - `topic` parameter has to be passed on frontend
     - SingleTopicKafkaSourceFactory - topic is defined on level of configuration
   
   

   Wrapper for [[org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer]]
   Features:
     - fetch latest N records which can be later used to test process in UI
   Fetching data is defined in [[pl.touk.nussknacker.engine.kafka.BaseKafkaSourceFactory.KafkaSource]] which
   extends [[pl.touk.nussknacker.engine.api.process.TestDataGenerator]]. See [[pl.touk.nussknacker.engine.kafka.KafkaEspUtils#readLastMessages]]
     - reset Kafka's offset to latest value - `forceLatestRead` property, see [[pl.touk.nussknacker.engine.kafka.KafkaEspUtils#setOffsetToLatest]]
   
   BaseKafkaSourceFactory comes in two variants:
     - KafkaSourceFactory - `topic` parameter has to be passed on frontend
     - SingleTopicKafkaSourceFactory - topic is defined on level of configuration
   
   

6. trait RecordFormatter extends AnyRef

   

   It is interface for bi-directional conversion between Kafka record and bytes.

   It is interface for bi-directional conversion between Kafka record and bytes. It is used when data stored on topic aren't in human readable format and you need to add extra step in generation of test data and in reading of these data.

7. class SingleTopicKafkaSourceFactory[T] extends BaseKafkaSourceFactory[T]