com.google.cloud.dataflow.sdk.io.range

Class OffsetRangeTracker

java.lang.Object

com.google.cloud.dataflow.sdk.io.range.OffsetRangeTracker

All Implemented Interfaces:

RangeTracker<Long>

public class OffsetRangeTracker
extends Object
implements RangeTracker<Long>

A RangeTracker for non-negative positions of type long.

Field Summary

Fields

Modifier and Type	Field and Description
static long	OFFSET_INFINITY Offset corresponding to infinity.

Constructor Summary

Constructors

Constructor and Description
OffsetRangeTracker(long startOffset, long stopOffset) Creates an OffsetRangeTracker for the specified range.

Method Summary

Modifier and Type	Method and Description
double	getFractionConsumed() Returns the approximate fraction of positions in the source that have been consumed by successful RangeTracker.tryReturnRecordAt(boolean, PositionT) calls, or 0.0 if no such calls have happened.
long	getPositionForFractionConsumed(double fraction) Returns a position P such that the range [start, P) represents approximately the given fraction of the range [start, end).
Long	getStartPosition() Returns the starting position of the current range, inclusive.
Long	getStopPosition() Returns the ending position of the current range, exclusive.
String	toString()
boolean	tryReturnRecordAt(boolean isAtSplitPoint, long recordStart)
boolean	tryReturnRecordAt(boolean isAtSplitPoint, Long recordStart) Atomically determines whether a record at the given position can be returned and updates internal state.
boolean	trySplitAtPosition(long splitOffset)
boolean	trySplitAtPosition(Long splitOffset) Atomically splits the current range [RangeTracker.getStartPosition(), RangeTracker.getStopPosition()) into a "primary" part [RangeTracker.getStartPosition(), splitPosition) and a "residual" part [splitPosition, RangeTracker.getStopPosition()), assuming the current last-consumed position is within [RangeTracker.getStartPosition(), splitPosition) (i.e., splitPosition has not been consumed yet).

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Detail

OFFSET_INFINITY

public static final long OFFSET_INFINITY

Offset corresponding to infinity. This can only be used as the upper-bound of a range, and indicates reading all of the records until the end without specifying exactly what the end is.

Infinite ranges cannot be split because it is impossible to estimate progress within them.

See Also:

Constant Field Values

Constructor Detail

OffsetRangeTracker

public OffsetRangeTracker(long startOffset,
                          long stopOffset)

Creates an OffsetRangeTracker for the specified range.

Method Detail

getStartPosition

public Long getStartPosition()

Description copied from interface: RangeTracker

Returns the starting position of the current range, inclusive.

Specified by:

getStartPosition in interface RangeTracker<Long>

getStopPosition

public Long getStopPosition()

Description copied from interface: RangeTracker

Returns the ending position of the current range, exclusive.

Specified by:

getStopPosition in interface RangeTracker<Long>

tryReturnRecordAt

public boolean tryReturnRecordAt(boolean isAtSplitPoint,
                                 Long recordStart)

Description copied from interface: RangeTracker

Atomically determines whether a record at the given position can be returned and updates internal state. In particular:

• If isAtSplitPoint is true, and recordStart is outside the current range, returns false;
• Otherwise, updates the last-consumed position to recordStart and returns true.

This method MUST be called on all split point records. It may be called on every record.

Specified by:

tryReturnRecordAt in interface RangeTracker<Long>

tryReturnRecordAt

public boolean tryReturnRecordAt(boolean isAtSplitPoint,
                                 long recordStart)

trySplitAtPosition

public boolean trySplitAtPosition(Long splitOffset)

Description copied from interface: RangeTracker

Atomically splits the current range [RangeTracker.getStartPosition(), RangeTracker.getStopPosition()) into a "primary" part [RangeTracker.getStartPosition(), splitPosition) and a "residual" part [splitPosition, RangeTracker.getStopPosition()), assuming the current last-consumed position is within [RangeTracker.getStartPosition(), splitPosition) (i.e., splitPosition has not been consumed yet).

Updates the current range to be the primary and returns true. This means that all further calls on the current object will interpret their arguments relative to the primary range.

If the split position has already been consumed, or if no RangeTracker.tryReturnRecordAt(boolean, PositionT) call was made yet, returns false. The second condition is to prevent dynamic splitting during reader start-up.

Specified by:

trySplitAtPosition in interface RangeTracker<Long>

trySplitAtPosition

public boolean trySplitAtPosition(long splitOffset)

getPositionForFractionConsumed

public long getPositionForFractionConsumed(double fraction)

Returns a position P such that the range [start, P) represents approximately the given fraction of the range [start, end). Assumes that the density of records in the range is approximately uniform.

getFractionConsumed

public double getFractionConsumed()

Description copied from interface: RangeTracker

Returns the approximate fraction of positions in the source that have been consumed by successful RangeTracker.tryReturnRecordAt(boolean, PositionT) calls, or 0.0 if no such calls have happened.

Specified by:

getFractionConsumed in interface RangeTracker<Long>

toString

public String toString()

Overrides:

toString in class Object