Store a single item of received data to Spark's memory and returns a Future
.
Store a single item of received data to Spark's memory and returns a Future
.
The Future
will be completed when the operator finishes, or with an
akka.pattern.AskTimeoutException
after the given timeout has expired.
These single items will be aggregated together into data blocks before
being pushed into Spark's memory.
This method allows the user to control the flow speed using Future
Store a single item of received data to Spark's memory.
Store a single item of received data to Spark's memory. These single items will be aggregated together into data blocks before being pushed into Spark's memory.
Store the bytes of received data as a data block into Spark's memory.
Store the bytes of received data as a data block into Spark's memory. Note that the data in the ByteBuffer must be serialized using the same serializer that Spark is configured to use.
Store an iterator of received data as a data block into Spark's memory.
:: DeveloperApi :: A Java UntypedActor that provides APIs for pushing received data into Spark Streaming for processing.
Find more details at: http://spark.apache.org/docs/latest/streaming-custom-receivers.html
Since Actor may exist outside the spark framework, It is thus user's responsibility to ensure the type safety, i.e. parametrized type of push block and InputDStream should be same.