Return the latest offset in the source
Returns the data that is between the offsets (start
, end
].
Returns the data that is between the offsets (start
, end
].
Returns the maximum available offset for this source.
Returns the maximum available offset for this source.
Returns the schema of the data from this source
Returns the schema of the data from this source
For test only.
For test only. Run func
with the internal lock to make sure when func
is running,
the current offset won't be changed and no new batch will be emitted.
A very simple source that reads text files from the given directory as they appear.
TODO Clean up the metadata files periodically