Package | Description |
---|---|
org.apache.hadoop.fs.s3a.commit |
Support for committing the output of analytics jobs directly to S3.
|
Modifier and Type | Method and Description |
---|---|
static org.apache.commons.lang3.tuple.Pair<String,AbstractS3ACommitter.JobUUIDSource> |
AbstractS3ACommitter.buildJobUUID(org.apache.hadoop.conf.Configuration conf,
org.apache.hadoop.mapreduce.JobID jobId)
Build the job UUID.
|
static S3AFileSystem |
CommitUtils.getS3AFileSystem(org.apache.hadoop.fs.Path path,
org.apache.hadoop.conf.Configuration conf,
boolean magicCommitRequired)
Get the S3A FS of a path.
|
static void |
CommitUtils.verifyIsMagicCommitFS(S3AFileSystem fs)
Verify that an S3A FS instance is a magic commit FS.
|
static void |
CommitUtils.verifyIsMagicCommitPath(S3AFileSystem fs,
org.apache.hadoop.fs.Path path)
Verify that the path is a magic one.
|
static S3AFileSystem |
CommitUtils.verifyIsS3AFS(org.apache.hadoop.fs.FileSystem fs,
org.apache.hadoop.fs.Path path)
Verify that an FS is an S3A FS.
|
Copyright © 2008–2022 Apache Software Foundation. All rights reserved.