Package | Description |
---|---|
org.apache.hadoop.fs.s3a |
S3A Filesystem.
|
org.apache.hadoop.fs.s3a.impl |
Implementation classes private to the S3A store.
|
org.apache.hadoop.fs.s3a.prefetch |
High performance s3 input stream which reads in
blocks and can cache blocks in the local filesystem.
|
Constructor and Description |
---|
S3AInputStream(S3AReadOpContext ctx,
S3ObjectAttributes s3Attributes,
S3AInputStream.InputStreamCallbacks client,
S3AInputStreamStatistics streamStatistics,
ExecutorService boundedThreadPool)
Create the stream.
|
Modifier and Type | Method and Description |
---|---|
S3ObjectAttributes |
OperationCallbacks.createObjectAttributes(org.apache.hadoop.fs.Path path,
String eTag,
String versionId,
long len)
Create the attributes of an object for subsequent use.
|
S3ObjectAttributes |
OperationCallbacks.createObjectAttributes(S3AFileStatus fileStatus)
Create the attributes of an object for subsequent use.
|
Modifier and Type | Method and Description |
---|---|
software.amazon.awssdk.services.s3.model.CopyObjectResponse |
OperationCallbacks.copyFile(String srcKey,
String destKey,
S3ObjectAttributes srcAttributes,
S3AReadOpContext readContext)
Copy a single object in the bucket via a COPY operation.
|
abstract String |
ChangeDetectionPolicy.getRevisionId(S3ObjectAttributes s3Attributes)
Like {
ChangeDetectionPolicy.getRevisionId(HeadObjectResponse, String) }, but retrieves the
revision identifier from S3ObjectAttributes . |
Constructor and Description |
---|
ChangeTracker(String uri,
ChangeDetectionPolicy policy,
ChangeTrackerStatistics versionMismatches,
S3ObjectAttributes s3ObjectAttributes)
Create a change tracker.
|
Modifier and Type | Method and Description |
---|---|
protected S3ObjectAttributes |
S3ARemoteInputStream.getS3ObjectAttributes() |
Modifier and Type | Method and Description |
---|---|
static String |
S3ARemoteObject.getPath(S3ObjectAttributes s3Attributes)
Gets the path corresponding to the given s3Attributes.
|
Constructor and Description |
---|
S3ACachingInputStream(S3AReadOpContext context,
S3ObjectAttributes s3Attributes,
S3AInputStream.InputStreamCallbacks client,
S3AInputStreamStatistics streamStatistics,
org.apache.hadoop.conf.Configuration conf,
org.apache.hadoop.fs.LocalDirAllocator localDirAllocator)
Initializes a new instance of the
S3ACachingInputStream class. |
S3AInMemoryInputStream(S3AReadOpContext context,
S3ObjectAttributes s3Attributes,
S3AInputStream.InputStreamCallbacks client,
S3AInputStreamStatistics streamStatistics)
Initializes a new instance of the
S3AInMemoryInputStream class. |
S3APrefetchingInputStream(S3AReadOpContext context,
S3ObjectAttributes s3Attributes,
S3AInputStream.InputStreamCallbacks client,
S3AInputStreamStatistics streamStatistics,
org.apache.hadoop.conf.Configuration conf,
org.apache.hadoop.fs.LocalDirAllocator localDirAllocator)
Initializes a new instance of the
S3APrefetchingInputStream class. |
S3ARemoteInputStream(S3AReadOpContext context,
S3ObjectAttributes s3Attributes,
S3AInputStream.InputStreamCallbacks client,
S3AInputStreamStatistics streamStatistics)
Initializes a new instance of the
S3ARemoteInputStream class. |
S3ARemoteObject(S3AReadOpContext context,
S3ObjectAttributes s3Attributes,
S3AInputStream.InputStreamCallbacks client,
S3AInputStreamStatistics streamStatistics,
ChangeTracker changeTracker)
Initializes a new instance of the
S3ARemoteObject class. |
Copyright © 2008–2024 Apache Software Foundation. All rights reserved.