Class

pl.touk.nussknacker.engine.avro.source

DelayedKafkaAvroSourceFactory

Related Doc: package source

Permalink

class DelayedKafkaAvroSourceFactory[K, V] extends KafkaAvroSourceFactory[K, V] with BaseKafkaDelayedSourceFactory

Linear Supertypes
BaseKafkaDelayedSourceFactory, KafkaAvroSourceFactory[K, V], KafkaAvroBaseTransformer[FlinkSource[ConsumerRecord[K, V]]], WithCachedTopicsExistenceValidator, TopicsExistenceValidator, SingleInputGenericNodeTransformation[FlinkSource[ConsumerRecord[K, V]]], GenericNodeTransformation[FlinkSource[ConsumerRecord[K, V]]], FlinkSourceFactory[ConsumerRecord[K, V]], SourceFactory[ConsumerRecord[K, V]], Component, Serializable, Serializable, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. DelayedKafkaAvroSourceFactory
  2. BaseKafkaDelayedSourceFactory
  3. KafkaAvroSourceFactory
  4. KafkaAvroBaseTransformer
  5. WithCachedTopicsExistenceValidator
  6. TopicsExistenceValidator
  7. SingleInputGenericNodeTransformation
  8. GenericNodeTransformation
  9. FlinkSourceFactory
  10. SourceFactory
  11. Component
  12. Serializable
  13. Serializable
  14. AnyRef
  15. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new DelayedKafkaAvroSourceFactory(schemaRegistryProvider: SchemaRegistryProvider, processObjectDependencies: ProcessObjectDependencies, timestampAssigner: Option[TimestampWatermarkHandler[ConsumerRecord[K, V]]])(implicit arg0: ClassTag[K], arg1: ClassTag[V])

    Permalink

Type Members

  1. type DefinedParameter = DefinedSingleParameter

    Permalink
    Definition Classes
    SingleInputGenericNodeTransformation → GenericNodeTransformation
  2. case class FinalResults extends TransformationStepResult with Product with Serializable

    Permalink
    Definition Classes
    GenericNodeTransformation
  3. type InputContext = ValidationContext

    Permalink
    Definition Classes
    SingleInputGenericNodeTransformation → GenericNodeTransformation
  4. case class NextParameters extends TransformationStepResult with Product with Serializable

    Permalink
    Definition Classes
    GenericNodeTransformation
  5. type NodeTransformationDefinition = PartialFunction[TransformationStep, TransformationStepResult]

    Permalink
    Definition Classes
    GenericNodeTransformation
  6. type State = KafkaAvroSourceFactoryState[K, V, DefinedParameter]

    Permalink
    Definition Classes
    KafkaAvroSourceFactory → GenericNodeTransformation
  7. case class TransformationStep extends Product with Serializable

    Permalink
    Definition Classes
    GenericNodeTransformation
  8. sealed trait TransformationStepResult extends AnyRef

    Permalink
    Definition Classes
    GenericNodeTransformation
  9. type WithError[V] = WriterT[Id, List[ProcessCompilationError], V]

    Permalink
    Definition Classes
    KafkaAvroBaseTransformer

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  5. def clazz: Class[ConsumerRecord[K, V]]

    Permalink
    Definition Classes
    FlinkSourceFactory → SourceFactory
  6. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @HotSpotIntrinsicCandidate() @throws( ... )
  7. def contextTransformation(context: ValidationContext, dependencies: List[NodeDependencyValue])(implicit nodeId: NodeId): NodeTransformationDefinition

    Permalink
    Definition Classes
    KafkaAvroSourceFactory → GenericNodeTransformation
  8. def createDelayedKafkaSource[K, V](preparedTopics: List[PreparedKafkaTopic], kafkaConfig: KafkaConfig, deserializationSchema: KafkaDeserializationSchema[ConsumerRecord[K, V]], timestampAssigner: Option[TimestampWatermarkHandler[ConsumerRecord[K, V]]], formatter: RecordFormatter, flinkContextInitializer: FlinkContextInitializer[ConsumerRecord[K, V]], delay: Long): KafkaSource[ConsumerRecord[K, V]]

    Permalink
    Attributes
    protected
    Definition Classes
    BaseKafkaDelayedSourceFactory
  9. def createSource(params: Map[String, Any], dependencies: List[NodeDependencyValue], finalState: Option[State], preparedTopics: List[PreparedKafkaTopic], kafkaConfig: KafkaConfig, deserializationSchema: KafkaDeserializationSchema[ConsumerRecord[K, V]], timestampAssigner: Option[TimestampWatermarkHandler[ConsumerRecord[K, V]]], formatter: RecordFormatter, flinkContextInitializer: FlinkContextInitializer[ConsumerRecord[K, V]]): KafkaSource[ConsumerRecord[K, V]]

    Permalink

    Basic implementation of new source creation.

    Basic implementation of new source creation. Override this method to create custom KafkaSource.

    Attributes
    protected
    Definition Classes
    DelayedKafkaAvroSourceFactoryKafkaAvroSourceFactory
  10. def determineSchemaAndType(schemaDeterminer: AvroSchemaDeterminer, paramName: Option[String])(implicit nodeId: NodeId): Validated[ProcessCompilationError, (Option[RuntimeSchemaData], TypingResult)]

    Permalink
    Attributes
    protected
    Definition Classes
    KafkaAvroSourceFactory
  11. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  12. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  13. def extractPreparedTopic(params: Map[String, Any]): PreparedKafkaTopic

    Permalink
    Attributes
    protected
    Definition Classes
    KafkaAvroBaseTransformer
  14. def extractTimestampFromField(fieldName: String)(element: ConsumerRecord[K, V], kafkaEventTimestamp: Long): Long

    Permalink
  15. def extractVersionOption(params: Map[String, Any]): SchemaVersionOption

    Permalink
    Attributes
    protected
    Definition Classes
    KafkaAvroBaseTransformer
  16. val fallbackVersionOptionParam: Parameter

    Permalink
    Attributes
    protected
    Definition Classes
    KafkaAvroBaseTransformer
  17. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
    Annotations
    @HotSpotIntrinsicCandidate()
  18. def getTopicParam(implicit nodeId: NodeId): WithError[Parameter]

    Permalink
    Attributes
    protected
    Definition Classes
    KafkaAvroBaseTransformer
  19. def getVersionParam(versions: List[Integer]): Parameter

    Permalink
    Attributes
    protected
    Definition Classes
    KafkaAvroBaseTransformer
  20. def getVersionParam(preparedTopic: PreparedKafkaTopic)(implicit nodeId: NodeId): WithError[Parameter]

    Permalink
    Attributes
    protected
    Definition Classes
    KafkaAvroBaseTransformer
  21. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any
    Annotations
    @HotSpotIntrinsicCandidate()
  22. def implementation(params: Map[String, Any], dependencies: List[NodeDependencyValue], finalState: Option[State]): FlinkSource[ConsumerRecord[K, V]]

    Permalink
    Definition Classes
    KafkaAvroSourceFactory → GenericNodeTransformation
  23. def initialParameters: List[Parameter]

    Permalink
    Definition Classes
    KafkaAvroBaseTransformer → GenericNodeTransformation
  24. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  25. val kafkaConfig: KafkaConfig

    Permalink
    Attributes
    protected
    Definition Classes
    KafkaAvroBaseTransformer → WithCachedTopicsExistenceValidator
  26. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  27. def nextSteps(context: ValidationContext, dependencies: List[NodeDependencyValue])(implicit nodeId: NodeId): NodeTransformationDefinition

    Permalink
    Attributes
    protected
    Definition Classes
    DelayedKafkaAvroSourceFactoryKafkaAvroSourceFactory
  28. def nodeDependencies: List[NodeDependency]

    Permalink
    Definition Classes
    KafkaAvroSourceFactory → GenericNodeTransformation
  29. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @HotSpotIntrinsicCandidate()
  30. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @HotSpotIntrinsicCandidate()
  31. val nullTopicOption: FixedExpressionValue

    Permalink
    Definition Classes
    KafkaAvroBaseTransformer
  32. def paramsDeterminedAfterSchema: List[Parameter]

    Permalink
  33. def parseVersionOption(versionOptionName: String): SchemaVersionOption

    Permalink
    Attributes
    protected
    Definition Classes
    KafkaAvroBaseTransformer
  34. def prepareKafkaConfig: KafkaConfig

    Permalink
    Attributes
    protected
    Definition Classes
    KafkaAvroBaseTransformer
  35. def prepareKeySchemaDeterminer(preparedTopic: PreparedKafkaTopic): AvroSchemaDeterminer

    Permalink
    Attributes
    protected
    Definition Classes
    KafkaAvroBaseTransformer
  36. def prepareSourceFinalErrors(context: ValidationContext, dependencies: List[NodeDependencyValue], parameters: List[(String, DefinedParameter)], errors: List[ProcessCompilationError])(implicit nodeId: NodeId): FinalResults

    Permalink
    Attributes
    protected
    Definition Classes
    KafkaAvroSourceFactory
  37. def prepareSourceFinalResults(preparedTopic: PreparedKafkaTopic, valueValidationResult: Validated[ProcessCompilationError, (Option[RuntimeSchemaData], TypingResult)], context: ValidationContext, dependencies: List[NodeDependencyValue], parameters: List[(String, DefinedParameter)], errors: List[ProcessCompilationError])(implicit nodeId: NodeId): FinalResults

    Permalink
    Attributes
    protected
    Definition Classes
    KafkaAvroSourceFactory
  38. def prepareTimestampAssigner[K, V](kafkaConfig: KafkaConfig, extract: (ConsumerRecord[K, V], Long) ⇒ Long): TimestampWatermarkHandler[ConsumerRecord[K, V]]

    Permalink
    Attributes
    protected
    Definition Classes
    BaseKafkaDelayedSourceFactory
  39. def prepareTopic(topic: String): PreparedKafkaTopic

    Permalink
    Attributes
    protected
    Definition Classes
    KafkaAvroBaseTransformer
  40. def prepareValueSchemaDeterminer(preparedTopic: PreparedKafkaTopic, version: SchemaVersionOption): AvroSchemaDeterminer

    Permalink
    Attributes
    protected
    Definition Classes
    KafkaAvroBaseTransformer
  41. val processObjectDependencies: ProcessObjectDependencies

    Permalink
  42. def schemaParamStep(implicit nodeId: NodeId): NodeTransformationDefinition

    Permalink
    Attributes
    protected
    Definition Classes
    KafkaAvroBaseTransformer
  43. lazy val schemaRegistryClient: SchemaRegistryClient

    Permalink
    Attributes
    protected
    Definition Classes
    KafkaAvroBaseTransformer
  44. val schemaRegistryProvider: SchemaRegistryProvider

    Permalink

    - provides a set of strategies for serialization and deserialization while event processing and/or testing.

    - provides a set of strategies for serialization and deserialization while event processing and/or testing.

    Definition Classes
    KafkaAvroSourceFactoryKafkaAvroBaseTransformer
  45. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  46. def toString(): String

    Permalink
    Definition Classes
    AnyRef → Any
  47. val topicParamName: String

    Permalink
    Attributes
    protected
    Definition Classes
    KafkaAvroBaseTransformer
  48. def topicParamStep(implicit nodeId: NodeId): NodeTransformationDefinition

    Permalink
    Attributes
    protected
    Definition Classes
    KafkaAvroBaseTransformer
  49. def topicSelectionStrategy: TopicSelectionStrategy

    Permalink
    Attributes
    protected
    Definition Classes
    KafkaAvroBaseTransformer
  50. def typedDependency[C](list: List[NodeDependencyValue])(implicit arg0: ClassTag[C]): C

    Permalink
    Attributes
    protected
    Definition Classes
    KafkaAvroBaseTransformer
  51. final def validateTopic(topic: String): Validated[TopicExistenceValidationException, String]

    Permalink
    Definition Classes
    TopicsExistenceValidator
  52. final def validateTopics(topics: List[String]): Validated[TopicExistenceValidationException, List[String]]

    Permalink
    Definition Classes
    WithCachedTopicsExistenceValidator → TopicsExistenceValidator
  53. lazy val validator: CachedTopicsExistenceValidator

    Permalink
    Attributes
    protected
    Definition Classes
    WithCachedTopicsExistenceValidator
  54. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  55. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  56. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Deprecated Value Members

  1. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @Deprecated @deprecated @throws( classOf[java.lang.Throwable] )
    Deprecated

    (Since version ) see corresponding Javadoc for more information.

Inherited from BaseKafkaDelayedSourceFactory

Inherited from KafkaAvroSourceFactory[K, V]

Inherited from KafkaAvroBaseTransformer[FlinkSource[ConsumerRecord[K, V]]]

Inherited from WithCachedTopicsExistenceValidator

Inherited from TopicsExistenceValidator

Inherited from SingleInputGenericNodeTransformation[FlinkSource[ConsumerRecord[K, V]]]

Inherited from GenericNodeTransformation[FlinkSource[ConsumerRecord[K, V]]]

Inherited from FlinkSourceFactory[ConsumerRecord[K, V]]

Inherited from SourceFactory[ConsumerRecord[K, V]]

Inherited from Component

Inherited from Serializable

Inherited from Serializable

Inherited from AnyRef

Inherited from Any

Ungrouped