streaming

Type Members

1. final class DataStreamReader extends Logging

   Interface used to load a streaming Dataset from external storage systems (e.

2. final class DataStreamWriter[T] extends AnyRef

   :: Experimental :: Interface used to write a streaming Dataset to external storage systems (e.

3. case class ProcessingTime(intervalMs: Long) extends Trigger with Product with Serializable

   :: Experimental :: A trigger that runs a query periodically based on the processing time.

4. class SinkProgress extends Serializable

   :: Experimental :: Information about progress made for a sink in the execution of a StreamingQuery during a trigger.

5. class SourceProgress extends Serializable

   :: Experimental :: Information about progress made for a source in the execution of a StreamingQuery during a trigger.

6. class StateOperatorProgress extends Serializable

   :: Experimental :: Information about updates made to stateful operators in a StreamingQuery during a trigger.

7. trait StreamingQuery extends AnyRef

   :: Experimental :: A handle to a query that is executing continuously in the background as new data arrives.

8. class StreamingQueryException extends Exception

   :: Experimental :: Exception that stopped a StreamingQuery.

9. abstract class StreamingQueryListener extends AnyRef

   :: Experimental :: Interface for listening to events related to StreamingQueries.

10. class StreamingQueryManager extends AnyRef

    :: Experimental :: A class to manage all the StreamingQuery active on a SparkSession.

11. class StreamingQueryProgress extends Serializable

    :: Experimental :: Information about progress made in the execution of a StreamingQuery during a trigger.

12. class StreamingQueryStatus extends Serializable

    :: Experimental :: Reports information about the instantaneous status of a streaming query.

13. sealed trait Trigger extends AnyRef

    :: Experimental :: Used to indicate how often results should be produced by a StreamingQuery.