Package org.apache.druid.data.input.impl

Interface CloudObjectSplitWidget

public interface CloudObjectSplitWidget

Helper used by CloudObjectInputSource to implement SplittableInputSource.createSplits(org.apache.druid.data.input.InputFormat, org.apache.druid.data.input.SplitHintSpec).

Nested Class Summary

Nested Classes

Modifier and Type	Interface	Description
static class	CloudObjectSplitWidget.LocationWithSize	Returned by getDescriptorIteratorForPrefixes(List).

Field Summary

Fields

Modifier and Type	Field	Description
static long	UNKNOWN_SIZE

Method Summary

Modifier and Type	Method	Description
Iterator<CloudObjectSplitWidget.LocationWithSize>	getDescriptorIteratorForPrefixes(List<URI> prefixes)	Iterator of descriptors that match a list of prefixes.
long	getObjectSize(CloudObjectLocation descriptor)	Size of an object.

Field Detail

UNKNOWN_SIZE

static final long UNKNOWN_SIZE

See Also:

Constant Field Values

Method Detail

getDescriptorIteratorForPrefixes

Iterator<CloudObjectSplitWidget.LocationWithSize> getDescriptorIteratorForPrefixes(List<URI> prefixes)

Iterator of descriptors that match a list of prefixes. Used if CloudObjectInputSource.getPrefixes() is set. Sizes in CloudObjectSplitWidget.LocationWithSize are set if the information is naturally available as part of listing the cloud object prefix. Otherwise, they are set to UNKNOWN_SIZE and filled in later.

getObjectSize

long getObjectSize(CloudObjectLocation descriptor)
            throws IOException

Size of an object. May use a cached size, if available, or may issue a network call.

Throws:

IOException