Returns the data that is between the offsets (start
, end
].
Returns the data that is between the offsets (start
, end
]. When start
is None
then
the batch should begin with the first available record. This method must always return the
same data for a particular start
and end
pair.
Returns the maximum available offset for this source.
Returns the schema of the data from this source
A source of continually arriving data for a streaming query. A Source must have a monotonically increasing notion of progress that can be represented as an Offset. Spark will regularly query each Source to see if any more data is available.