io.cdap.cdap.api.dataset.lib.partitioned

Class ConsumerWorkingSet

java.lang.Object

io.cdap.cdap.api.dataset.lib.partitioned.ConsumerWorkingSet

public class ConsumerWorkingSet
extends Object

Keeps track of a list of partitions that are either available for consuming or are currently being consumed.

Constructor Summary

Constructors

Constructor and Description
ConsumerWorkingSet() Constructs an empty working set.

Method Summary

Modifier and Type	Method and Description
void	addPartition(PartitionKey partitionKey) Adds a new partition to the working set.
boolean	equals(Object o)
static ConsumerWorkingSet	fromBytes(byte[] bytes)
List<ConsumablePartition>	getPartitions()
int	hashCode()
ConsumablePartition	lookup(PartitionKey partitionKey)
void	populate(PartitionedFileSet partitionedFileSet, ConsumerConfiguration configuration) Populates the ConsumerWorkingSet by fetching partitions from the given PartitionedFileSet.
ConsumablePartition	remove(PartitionKey partitionKey)
byte[]	toBytes()

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ConsumerWorkingSet

public ConsumerWorkingSet()

Constructs an empty working set.

Method Detail

getPartitions

public List<ConsumablePartition> getPartitions()

Returns:

the list of partitions of this working set

addPartition

public void addPartition(PartitionKey partitionKey)

Adds a new partition to the working set.

remove

public ConsumablePartition remove(PartitionKey partitionKey)

Returns:

the ConsumablePartition with the given PartitionKey, from the working set, after removing it from the partitions list

lookup

public ConsumablePartition lookup(PartitionKey partitionKey)

Returns:

the ConsumablePartition with the given PartitionKey, from the working set

populate

public void populate(PartitionedFileSet partitionedFileSet,
                     ConsumerConfiguration configuration)

Populates the ConsumerWorkingSet by fetching partitions from the given PartitionedFileSet.

Parameters:

partitionedFileSet - the PartitionedFileSet to fetch partitions from

configuration - the ConsumerConfiguration which defines parameters for consuming

fromBytes

public static ConsumerWorkingSet fromBytes(byte[] bytes)

toBytes

public byte[] toBytes()

equals

public boolean equals(Object o)

Overrides:

equals in class Object

hashCode

public int hashCode()

Overrides:

hashCode in class Object