Class

it.agilelab.bigdata.wasp.models

StructuredStreamingETLModel

Related Doc: package models

Permalink

case class StructuredStreamingETLModel(name: String, group: String = "default", streamingInput: StreamingReaderModel, staticInputs: List[ReaderModel], streamingOutput: WriterModel, mlModels: List[MlModelOnlyInfo], strategy: Option[StrategyModel], triggerIntervalMs: Option[Long], options: Map[String, String] = Map.empty) extends ProcessingComponentModel with Product with Serializable

A streaming processing component that leverages Spark's Structured Streaming API.

name

unique name of the processing component

group

group of which the processing component is part

staticInputs

list of inputs for static datasets

streamingOutput

streaming output

mlModels

machine learning models to be used in the processing

strategy

strategy model that defines the processing

triggerIntervalMs

trigger interval to use, in milliseconds

options

has no effect at all

Linear Supertypes
Serializable, Serializable, Product, Equals, ProcessingComponentModel, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. StructuredStreamingETLModel
  2. Serializable
  3. Serializable
  4. Product
  5. Equals
  6. ProcessingComponentModel
  7. AnyRef
  8. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new StructuredStreamingETLModel(name: String, group: String = "default", streamingInput: StreamingReaderModel, staticInputs: List[ReaderModel], streamingOutput: WriterModel, mlModels: List[MlModelOnlyInfo], strategy: Option[StrategyModel], triggerIntervalMs: Option[Long], options: Map[String, String] = Map.empty)

    Permalink

    name

    unique name of the processing component

    group

    group of which the processing component is part

    staticInputs

    list of inputs for static datasets

    streamingOutput

    streaming output

    mlModels

    machine learning models to be used in the processing

    strategy

    strategy model that defines the processing

    triggerIntervalMs

    trigger interval to use, in milliseconds

    options

    has no effect at all

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  5. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @HotSpotIntrinsicCandidate() @throws( ... )
  6. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  7. def generateStandardProcessingComponentName: String

    Permalink
    Definition Classes
    ProcessingComponentModel
  8. def generateStandardWriterName: String

    Permalink
    Definition Classes
    ProcessingComponentModel
  9. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
    Annotations
    @HotSpotIntrinsicCandidate()
  10. val group: String

    Permalink

    group of which the processing component is part

  11. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  12. val mlModels: List[MlModelOnlyInfo]

    Permalink

    machine learning models to be used in the processing

  13. val name: String

    Permalink

    unique name of the processing component

    unique name of the processing component

    Definition Classes
    StructuredStreamingETLModelProcessingComponentModel
  14. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  15. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @HotSpotIntrinsicCandidate()
  16. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @HotSpotIntrinsicCandidate()
  17. val options: Map[String, String]

    Permalink

    has no effect at all

  18. val staticInputs: List[ReaderModel]

    Permalink

    list of inputs for static datasets

  19. val strategy: Option[StrategyModel]

    Permalink

    strategy model that defines the processing

  20. val streamingInput: StreamingReaderModel

    Permalink
  21. val streamingOutput: WriterModel

    Permalink

    streaming output

  22. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  23. val triggerIntervalMs: Option[Long]

    Permalink

    trigger interval to use, in milliseconds

  24. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  25. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  26. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Deprecated Value Members

  1. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @Deprecated @deprecated @throws( classOf[java.lang.Throwable] )
    Deprecated

    (Since version ) see corresponding Javadoc for more information.

Inherited from Serializable

Inherited from Serializable

Inherited from Product

Inherited from Equals

Inherited from ProcessingComponentModel

Inherited from AnyRef

Inherited from Any

Ungrouped