c

cloudflow.flink

FlinkStreamletLogic

abstract class FlinkStreamletLogic extends StreamletLogic[FlinkStreamletContext]

Provides an entry-point for defining the behavior of a FlinkStreamlet. Overide the method buildExecutionGraph to build the computation graph that needs to run as part of the business logic for the FlinkStreamlet.

Here's an example of how to provide a specialized implementation of FlinkStreamletLogic as part of implementing a custom FlinkStreamlet:

  // new custom `FlinkStreamlet`
  // define inlets, outlets and shape

  // provide custom implementation of `FlinkStreamletLogic`
  override def createLogic() = new FlinkStreamletLogic {
    override def buildExecutionGraph = {
      val ins: DataStream[Data] = readStream(in)
      val simples: DataStream[Simple] = ins.map(r ⇒ new Simple(r.getName()))
      writeStream(out, simples)
    }
  }
}
Source
FlinkStreamlet.scala
Linear Supertypes
StreamletLogic[FlinkStreamletContext], Serializable, Serializable, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. FlinkStreamletLogic
  2. StreamletLogic
  3. Serializable
  4. Serializable
  5. AnyRef
  6. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new FlinkStreamletLogic()(implicit context: FlinkStreamletContext)

Abstract Value Members

  1. abstract def buildExecutionGraph(): Unit

    Derived classes need to override this method to provide a custom implementation of the logic to start execution of queries.

Concrete Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  5. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native() @HotSpotIntrinsicCandidate()
  6. final def config: Config
  7. implicit val context: FlinkStreamletContext
    Definition Classes
    FlinkStreamletLogic → StreamletLogic
  8. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  9. def equals(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  10. def executeStreamingQueries(env: StreamExecutionEnvironment): JobExecutionResult
  11. final def getClass(): Class[_]
    Definition Classes
    AnyRef → Any
    Annotations
    @native() @HotSpotIntrinsicCandidate()
  12. def getContext(): FlinkStreamletContext
    Definition Classes
    FlinkStreamletLogic → StreamletLogic
  13. final def getMountedPath(volumeMount: VolumeMount): Path

    The path mounted for a VolumeMount request from a streamlet.

    The path mounted for a VolumeMount request from a streamlet. In a clustered deployment, the mounted path will correspond to the requested mount path in the VolumeMount definition. In a local environment, this path will be replaced by a local folder.

    volumeMount

    the volumeMount declaration for which we want to obtain the mounted path.

    returns

    the path where the volume is mounted.

    Exceptions thrown

    [[cloudflow.streamlets.MountedPathUnavailableException MountedPathUnavailableException ]] in the case the path is not available.

  14. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @native() @HotSpotIntrinsicCandidate()
  15. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  16. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  17. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native() @HotSpotIntrinsicCandidate()
  18. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native() @HotSpotIntrinsicCandidate()
  19. final def readStream[In](inlet: CodecInlet[In], clazz: Class[In]): DataStream[In]

    Java API Read from the underlying external storage through the inlet inlet and return a DataStream

    Java API Read from the underlying external storage through the inlet inlet and return a DataStream

    inlet

    the inlet port to read from

    clazz

    the class of data flowing from inlet

    returns

    the data read as DataStream[In]

  20. final def readStream[In](inlet: CodecInlet[In])(implicit arg0: TypeInformation[In]): DataStream[In]

    Read from the underlying external storage through the inlet inlet and return a DataStream

    Read from the underlying external storage through the inlet inlet and return a DataStream

    inlet

    the inlet port to read from

    returns

    the data read as DataStream[In]

  21. final def streamletRef: String
  22. final def synchronized[T0](arg0: ⇒ T0): T0
    Definition Classes
    AnyRef
  23. def toString(): String
    Definition Classes
    AnyRef → Any
  24. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  25. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()
  26. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  27. final def writeStream[Out](outlet: CodecOutlet[Out], stream: DataStream[Out], clazz: Class[Out]): DataStreamSink[Out]

    Java API Write to the external storage using the outlet outlet from the stream stream and return the same stream

    Java API Write to the external storage using the outlet outlet from the stream stream and return the same stream

    outlet

    the outlet port to write to

    stream

    the data stream to write

    clazz

    the class of data flowing from inlet

    returns

    the result DataStreamSink[Out]

  28. final def writeStream[Out](outlet: CodecOutlet[Out], stream: DataStream[Out])(implicit arg0: TypeInformation[Out]): DataStreamSink[Out]

    Write to the external storage using the outlet outlet from the stream stream and return the same stream

    Write to the external storage using the outlet outlet from the stream stream and return the same stream

    outlet

    the outlet port to write to

    stream

    the data stream to write

    returns

    the result DataStreamSink[Out]

Deprecated Value Members

  1. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] ) @Deprecated @deprecated
    Deprecated

    (Since version ) see corresponding Javadoc for more information.

Inherited from StreamletLogic[FlinkStreamletContext]

Inherited from Serializable

Inherited from Serializable

Inherited from AnyRef

Inherited from Any

Ungrouped