org.apache.hadoop.fs.s3a.commit

Class CommitterStatisticNames

java.lang.Object

org.apache.hadoop.fs.s3a.commit.CommitterStatisticNames

@InterfaceAudience.Public
 @InterfaceStability.Unstable
public final class CommitterStatisticNames
extends Object

Statistic names for committers. Please keep in sync with org.apache.hadoop.fs.s3a.Statistic so that S3A and manifest committers are in sync.

Field Summary

Fields

Modifier and Type	Field and Description
static String	COMMITTER_BYTES_COMMITTED_COUNT Amount of data committed: "committer_bytes_committed".
static String	COMMITTER_COMMIT_JOB Duration Tracking of time to commit an entire job: "committer_commit_job".
static String	COMMITTER_COMMITS_ABORTED_COUNT Count of commits aborted: "committer_commits_aborted".
static String	COMMITTER_COMMITS_FAILED Count of commits failed: "committer_commits.failures".
static String	COMMITTER_COMMITS_REVERTED_COUNT Count of commits reverted: "committer_commits_reverted".
static String	COMMITTER_FILE_COUNT_MEAN The number of files in a task.
static String	COMMITTER_FILE_SIZE_MEAN File Size.
static String	COMMITTER_FILES_COMMITTED_COUNT Number of files committed: "committer_files_committed".
static String	COMMITTER_TASK_DIRECTORY_COUNT_MEAN What is a task attempt's directory count.
static String	COMMITTER_TASK_DIRECTORY_DEPTH_MEAN What is the depth of a task attempt's directory tree.
static String	COMMITTER_TASK_FILE_COUNT_MEAN The number of files in a task.
static String	COMMITTER_TASK_FILE_SIZE_MEAN The number of files in a task.
static String	COMMITTER_TASKS_COMPLETED_COUNT "Count of successful tasks:: "committer_tasks_completed".
static String	COMMITTER_TASKS_FAILED_COUNT Count of failed tasks: "committer_tasks_failed".
static String	OP_CREATE_DIRECTORIES Directory creation "op_create_directories".
static String	OP_CREATE_ONE_DIRECTORY Creating a single directory "op_create_one_directory".
static String	OP_DIRECTORY_SCAN Directory scan "op_directory_scan".
static String	OP_LOAD_ALL_MANIFESTS "op_load_all_manifests".
static String	OP_LOAD_MANIFEST Load a task manifest: "op_load_manifest".
static String	OP_RENAME_FILE Rename a file: "op_rename".
static String	OP_SAVE_TASK_MANIFEST Save a task manifest: "op_task_stage_save_task_manifest".
static String	OP_STAGE_JOB_ABORT Job abort: "op_job_stage_abort".
static String	OP_STAGE_JOB_CLEANUP Job cleanup: "op_job_stage_cleanup".
static String	OP_STAGE_JOB_COMMIT Overall job commit "committer_commit_job".
static String	OP_STAGE_JOB_CREATE_TARGET_DIRS Prepare Directories Stage: "op_job_stage_create_target_dirs".
static String	OP_STAGE_JOB_LOAD_MANIFESTS Load Manifest Stage: "op_job_stage_load_manifests".
static String	OP_STAGE_JOB_RENAME_FILES Rename files stage duration: "op_job_stage_rename_files".
static String	OP_STAGE_JOB_SAVE_SUCCESS Job saving _SUCCESS marker Stage: "op_job_stage_save_success_marker".
static String	OP_STAGE_JOB_SETUP Job Setup Stage: "op_job_stage_setup".
static String	OP_STAGE_JOB_VALIDATE_OUTPUT Output Validation (within job commit) Stage: "op_job_stage_optional_validate_output".
static String	OP_STAGE_TASK_ABORT_TASK Task abort: "op_task_stage_abort_task".
static String	OP_STAGE_TASK_COMMIT Task Commit Stage: "op_stage_task_commit".
static String	OP_STAGE_TASK_SAVE_MANIFEST Task saving manifest file Stage: "op_task_stage_save_manifest".
static String	OP_STAGE_TASK_SCAN_DIRECTORY Task Scan directory Stage: "op_stage_task_scan_directory".
static String	OP_STAGE_TASK_SETUP Task Setup Stage: "op_task_stage_setup".

Method Summary

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

COMMITTER_BYTES_COMMITTED_COUNT

public static final String COMMITTER_BYTES_COMMITTED_COUNT

Amount of data committed: "committer_bytes_committed".

See Also:

Constant Field Values

COMMITTER_COMMIT_JOB

public static final String COMMITTER_COMMIT_JOB

Duration Tracking of time to commit an entire job: "committer_commit_job".

See Also:

Constant Field Values

COMMITTER_FILES_COMMITTED_COUNT

public static final String COMMITTER_FILES_COMMITTED_COUNT

Number of files committed: "committer_files_committed".

See Also:

Constant Field Values

COMMITTER_TASKS_COMPLETED_COUNT

public static final String COMMITTER_TASKS_COMPLETED_COUNT

"Count of successful tasks:: "committer_tasks_completed".

See Also:

Constant Field Values

COMMITTER_TASKS_FAILED_COUNT

public static final String COMMITTER_TASKS_FAILED_COUNT

Count of failed tasks: "committer_tasks_failed".

See Also:

Constant Field Values

COMMITTER_COMMITS_ABORTED_COUNT

public static final String COMMITTER_COMMITS_ABORTED_COUNT

Count of commits aborted: "committer_commits_aborted".

See Also:

Constant Field Values

COMMITTER_COMMITS_REVERTED_COUNT

public static final String COMMITTER_COMMITS_REVERTED_COUNT

Count of commits reverted: "committer_commits_reverted".

See Also:

Constant Field Values

COMMITTER_COMMITS_FAILED

public static final String COMMITTER_COMMITS_FAILED

Count of commits failed: "committer_commits.failures".

See Also:

Constant Field Values

COMMITTER_FILE_COUNT_MEAN

public static final String COMMITTER_FILE_COUNT_MEAN

The number of files in a task. This will be a MeanStatistic.

See Also:

Constant Field Values

COMMITTER_FILE_SIZE_MEAN

public static final String COMMITTER_FILE_SIZE_MEAN

File Size.

See Also:

Constant Field Values

COMMITTER_TASK_DIRECTORY_COUNT_MEAN

public static final String COMMITTER_TASK_DIRECTORY_COUNT_MEAN

What is a task attempt's directory count.

See Also:

Constant Field Values

COMMITTER_TASK_DIRECTORY_DEPTH_MEAN

public static final String COMMITTER_TASK_DIRECTORY_DEPTH_MEAN

What is the depth of a task attempt's directory tree.

See Also:

Constant Field Values

COMMITTER_TASK_FILE_COUNT_MEAN

public static final String COMMITTER_TASK_FILE_COUNT_MEAN

The number of files in a task. This will be a MeanStatistic.

See Also:

Constant Field Values

COMMITTER_TASK_FILE_SIZE_MEAN

public static final String COMMITTER_TASK_FILE_SIZE_MEAN

The number of files in a task. This will be a MeanStatistic.

See Also:

Constant Field Values

OP_CREATE_DIRECTORIES

public static final String OP_CREATE_DIRECTORIES

Directory creation "op_create_directories".

See Also:

Constant Field Values

OP_CREATE_ONE_DIRECTORY

public static final String OP_CREATE_ONE_DIRECTORY

Creating a single directory "op_create_one_directory".

See Also:

Constant Field Values

OP_DIRECTORY_SCAN

public static final String OP_DIRECTORY_SCAN

Directory scan "op_directory_scan".

See Also:

Constant Field Values

OP_STAGE_JOB_COMMIT

public static final String OP_STAGE_JOB_COMMIT

Overall job commit "committer_commit_job".

See Also:

Constant Field Values

OP_LOAD_ALL_MANIFESTS

public static final String OP_LOAD_ALL_MANIFESTS

"op_load_all_manifests".

See Also:

Constant Field Values

OP_LOAD_MANIFEST

public static final String OP_LOAD_MANIFEST

Load a task manifest: "op_load_manifest".

See Also:

Constant Field Values

OP_RENAME_FILE

public static final String OP_RENAME_FILE

Rename a file: "op_rename".

See Also:

Constant Field Values

OP_SAVE_TASK_MANIFEST

public static final String OP_SAVE_TASK_MANIFEST

Save a task manifest: "op_task_stage_save_task_manifest".

See Also:

Constant Field Values

OP_STAGE_TASK_ABORT_TASK

public static final String OP_STAGE_TASK_ABORT_TASK

Task abort: "op_task_stage_abort_task".

See Also:

Constant Field Values

OP_STAGE_JOB_ABORT

public static final String OP_STAGE_JOB_ABORT

Job abort: "op_job_stage_abort".

See Also:

Constant Field Values

OP_STAGE_JOB_CLEANUP

public static final String OP_STAGE_JOB_CLEANUP

Job cleanup: "op_job_stage_cleanup".

See Also:

Constant Field Values

OP_STAGE_JOB_CREATE_TARGET_DIRS

public static final String OP_STAGE_JOB_CREATE_TARGET_DIRS

Prepare Directories Stage: "op_job_stage_create_target_dirs".

See Also:

Constant Field Values

OP_STAGE_JOB_LOAD_MANIFESTS

public static final String OP_STAGE_JOB_LOAD_MANIFESTS

Load Manifest Stage: "op_job_stage_load_manifests".

See Also:

Constant Field Values

OP_STAGE_JOB_RENAME_FILES

public static final String OP_STAGE_JOB_RENAME_FILES

Rename files stage duration: "op_job_stage_rename_files".

See Also:

Constant Field Values

OP_STAGE_JOB_SETUP

public static final String OP_STAGE_JOB_SETUP

Job Setup Stage: "op_job_stage_setup".

See Also:

Constant Field Values

OP_STAGE_JOB_SAVE_SUCCESS

public static final String OP_STAGE_JOB_SAVE_SUCCESS

Job saving _SUCCESS marker Stage: "op_job_stage_save_success_marker".

See Also:

Constant Field Values

OP_STAGE_JOB_VALIDATE_OUTPUT

public static final String OP_STAGE_JOB_VALIDATE_OUTPUT

Output Validation (within job commit) Stage: "op_job_stage_optional_validate_output".

See Also:

Constant Field Values

OP_STAGE_TASK_SAVE_MANIFEST

public static final String OP_STAGE_TASK_SAVE_MANIFEST

Task saving manifest file Stage: "op_task_stage_save_manifest".

See Also:

Constant Field Values

OP_STAGE_TASK_SETUP

public static final String OP_STAGE_TASK_SETUP

Task Setup Stage: "op_task_stage_setup".

See Also:

Constant Field Values

OP_STAGE_TASK_COMMIT

public static final String OP_STAGE_TASK_COMMIT

Task Commit Stage: "op_stage_task_commit".

See Also:

Constant Field Values

OP_STAGE_TASK_SCAN_DIRECTORY

public static final String OP_STAGE_TASK_SCAN_DIRECTORY

Task Scan directory Stage: "op_stage_task_scan_directory".

See Also:

Constant Field Values