org.apache.gearpump.streaming.hadoop
Persists a pair of timestamp and checkpoint, which:
Persists a pair of timestamp and checkpoint, which:
Recovers checkpoint given timestamp, which
Recovers checkpoint given timestamp, which
1. returns None if no store exists 2. searches checkpoint stores for a. complete store checkpoints-$startTime-$endTime.store where startTime <= timestamp <= endTime b. temporary store checkpoints-$startTime.store where startTime <= timestamp 3. renames store to checkpoints-$startTime-$endTime.store 4. deletes all stores whose name has a startTime larger than timestamp 5. looks for the checkpoint in the found store
Stores timestamp-checkpoint mapping to Hadoop-compatible filesystem.
Store file layout: