Returns an HDFSState created directly from a Config object.
Returns a new HDFSState tuned to the given state path.
Returns a new HDFSState tuned to the given state path. Each run will fire up at most numBatches batches.
Pass in a startTime to restart the process from the specified time.
State implementation that uses an HDFS folder as a crude key-value store that tracks the batches currently processed.