Package | Description |
---|---|
org.apache.hadoop.fs.s3a.commit.magic |
This is the "Magic" committer and support.
|
org.apache.hadoop.fs.s3a.commit.staging |
The staging committers.
|
Modifier and Type | Class and Description |
---|---|
class |
MagicS3GuardCommitter
This is a dedicated committer which requires the "magic" directory feature
of the S3A Filesystem to be enabled; it then uses paths for task and job
attempts in magic paths, so as to ensure that the final output goes direct
to the destination directory.
|
Modifier and Type | Class and Description |
---|---|
class |
DirectoryStagingCommitter
This commits to a directory.
|
class |
PartitionedStagingCommitter
Partitioned committer.
|
class |
StagingCommitter
Committer based on the contributed work of the
Netflix multipart committers.
The working directory of each task is actually under a temporary
path in the local filesystem; jobs write directly into it.
|
Copyright © 2008–2024 Apache Software Foundation. All rights reserved.