Index (Apache Hadoop Amazon Web Services support 2.9.1 API)

A B C D E F G H I K L M N O P Q R S T U V W

A

aborted - Variable in class org.apache.hadoop.fs.s3a.S3AInstrumentation.InputStreamStatistics
ACCESS_KEY - Static variable in class org.apache.hadoop.fs.s3a.Constants
add(AWSCredentialsProvider) - Method in class org.apache.hadoop.fs.s3a.AWSCredentialProviderList: Add a new provider.
addAncestors(MetadataStore, Path, String) - Static method in class org.apache.hadoop.fs.s3a.s3guard.S3Guard
addMoveAncestors(MetadataStore, Collection<Path>, Collection<PathMetadata>, Path, Path, Path, String) - Static method in class org.apache.hadoop.fs.s3a.s3guard.S3Guard: Helper method that records the move of all ancestors of a path.
addMoveDir(MetadataStore, Collection<Path>, Collection<PathMetadata>, Path, Path, String) - Static method in class org.apache.hadoop.fs.s3a.s3guard.S3Guard: Helper function that records the move of directory paths, adding resulting metadata to the supplied lists.
addMoveFile(MetadataStore, Collection<Path>, Collection<PathMetadata>, Path, Path, long, long, String) - Static method in class org.apache.hadoop.fs.s3a.s3guard.S3Guard: Like S3Guard.addMoveDir(MetadataStore, Collection, Collection, Path, Path, String) (), but for files.
addValueToQuantiles(Statistic, long) - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation: Add a value to a quantiles statistic.
AnonymousAWSCredentialsProvider - Class in org.apache.hadoop.fs.s3a: AnonymousAWSCredentialsProvider supports anonymous access to AWS services through the AWS SDK.
AnonymousAWSCredentialsProvider() - Constructor for class org.apache.hadoop.fs.s3a.AnonymousAWSCredentialsProvider
append(Path, int, Progressable) - Method in class org.apache.hadoop.fs.s3.S3FileSystem: Deprecated.

This optional operation is not yet supported.
append(Path, int, Progressable) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem: Append to an existing file (optional operation).
append(Path, int, Progressable) - Method in class org.apache.hadoop.fs.s3native.NativeS3FileSystem: This optional operation is not yet supported.
assertQualified(Path) - Static method in class org.apache.hadoop.fs.s3a.s3guard.S3Guard: Assert that the path is qualified with a host and scheme.
assertQualified(Path...) - Static method in class org.apache.hadoop.fs.s3a.s3guard.S3Guard: Assert that all paths are valid.
available() - Method in class org.apache.hadoop.fs.s3a.S3AInputStream
AWS_CREDENTIALS_PROVIDER - Static variable in class org.apache.hadoop.fs.s3a.Constants
AWSClientIOException - Exception in org.apache.hadoop.fs.s3a: IOException equivalent of an AmazonClientException.
AWSClientIOException(String, AmazonClientException) - Constructor for exception org.apache.hadoop.fs.s3a.AWSClientIOException
AWSCredentialProviderList - Class in org.apache.hadoop.fs.s3a: A list of providers.
AWSCredentialProviderList() - Constructor for class org.apache.hadoop.fs.s3a.AWSCredentialProviderList: Empty instance.
AWSCredentialProviderList(Collection<AWSCredentialsProvider>) - Constructor for class org.apache.hadoop.fs.s3a.AWSCredentialProviderList: Create with an initial list of providers.
AWSS3IOException - Exception in org.apache.hadoop.fs.s3a: Wrap a AmazonS3Exception as an IOE, relaying all getters.
AWSS3IOException(String, AmazonS3Exception) - Constructor for exception org.apache.hadoop.fs.s3a.AWSS3IOException: Instantiate.
AWSServiceIOException - Exception in org.apache.hadoop.fs.s3a: A specific exception from AWS operations.
AWSServiceIOException(String, AmazonServiceException) - Constructor for exception org.apache.hadoop.fs.s3a.AWSServiceIOException: Instantiate.

B

backwardSeekOperations - Variable in class org.apache.hadoop.fs.s3a.S3AInstrumentation.InputStreamStatistics
badState(String, Object...) - Static method in class org.apache.hadoop.fs.s3a.s3guard.S3GuardTool: Build the exception to raise on a bad store/bucket state.
BasicAWSCredentialsProvider - Class in org.apache.hadoop.fs.s3a: BasicAWSCredentialsProvider supports static configuration of access key ID and secret access key for use with the AWS SDK.
BasicAWSCredentialsProvider(String, String) - Constructor for class org.apache.hadoop.fs.s3a.BasicAWSCredentialsProvider
Block - Class in org.apache.hadoop.fs.s3: Deprecated.
Block(long, long) - Constructor for class org.apache.hadoop.fs.s3.Block: Deprecated.
blockExists(long) - Method in interface org.apache.hadoop.fs.s3.FileSystemStore: Deprecated.
blocksActivelyAllocated() - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation.OutputStreamStatistics: Get counters of blocks actively allocated; my be inaccurate if the numbers change during the (non-synchronized) calculation.
blocksAllocated() - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation.OutputStreamStatistics
blocksReleased() - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation.OutputStreamStatistics
BUFFER_DIR - Static variable in class org.apache.hadoop.fs.s3a.Constants
buildFSURI(URI) - Static method in class org.apache.hadoop.fs.s3native.S3xLoginHelper: Build the filesystem URI.
bytesBackwardsOnSeek - Variable in class org.apache.hadoop.fs.s3a.S3AInstrumentation.InputStreamStatistics
bytesDiscardedInAbort - Variable in class org.apache.hadoop.fs.s3a.S3AInstrumentation.InputStreamStatistics
bytesRead - Variable in class org.apache.hadoop.fs.s3a.S3AInstrumentation.InputStreamStatistics
bytesRead(long) - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation.InputStreamStatistics: Increment the bytes read counter by the number of bytes; no-op if the argument is negative.
bytesReadInClose - Variable in class org.apache.hadoop.fs.s3a.S3AInstrumentation.InputStreamStatistics
bytesSkippedOnSeek - Variable in class org.apache.hadoop.fs.s3a.S3AInstrumentation.InputStreamStatistics

C

CANNED_ACL - Static variable in class org.apache.hadoop.fs.s3a.Constants
canonicalizeUri(URI) - Method in class org.apache.hadoop.fs.s3.S3FileSystem: Deprecated.
canonicalizeUri(URI) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem
canonicalizeUri(URI) - Method in class org.apache.hadoop.fs.s3native.NativeS3FileSystem
canonicalizeUri(URI, int) - Static method in class org.apache.hadoop.fs.s3native.S3xLoginHelper: Canonicalize the given URI.
castFrom(AmazonS3) - Static method in class org.apache.hadoop.fs.s3a.InconsistentAmazonS3Client: Convenience function for test code to cast from supertype.
checkNotEmpty() - Method in class org.apache.hadoop.fs.s3a.AWSCredentialProviderList: Verify that the provider list is not empty.
checkPath(Path) - Method in class org.apache.hadoop.fs.s3.S3FileSystem: Deprecated.

Check that a Path belongs to this FileSystem.
checkPath(Path) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem: Check that a Path belongs to this FileSystem.
checkPath(Path) - Method in class org.apache.hadoop.fs.s3native.NativeS3FileSystem: Check that a Path belongs to this FileSystem.
checkPath(Configuration, URI, Path, int) - Static method in class org.apache.hadoop.fs.s3native.S3xLoginHelper: Check the path, ignoring authentication details.
clearBucketOption(Configuration, String, String) - Static method in class org.apache.hadoop.fs.s3a.S3AUtils: Clear a bucket-specific property.
clearInconsistency() - Method in class org.apache.hadoop.fs.s3a.InconsistentAmazonS3Client: Clear all oustanding inconsistent keys.
close() - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem: Close the filesystem.
close() - Method in class org.apache.hadoop.fs.s3a.S3AInputStream: Close the stream.
close() - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation.InputStreamStatistics: Close triggers the merge of statistics into the filesystem's instrumentation instance.
close() - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation.OutputStreamStatistics: Output stream has closed.
close() - Method in class org.apache.hadoop.fs.s3a.S3AOutputStream
close() - Method in class org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore
close() - Method in class org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore
close() - Method in class org.apache.hadoop.fs.s3a.s3guard.NullMetadataStore
closeAll(Logger, Closeable...) - Static method in class org.apache.hadoop.fs.s3a.S3AUtils: Close the Closeable objects and ignore any Exception or null pointers.
closed - Variable in class org.apache.hadoop.fs.s3a.S3AInstrumentation.InputStreamStatistics
closeOperations - Variable in class org.apache.hadoop.fs.s3a.S3AInstrumentation.InputStreamStatistics
CONF_MAX_RECORDS - Static variable in class org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore: Maximum number of records.
Constants - Class in org.apache.hadoop.fs.s3a: All the constants used with the S3AFileSystem.
CONTEXT - Static variable in class org.apache.hadoop.fs.s3a.S3AInstrumentation
continueListObjects(ObjectListing) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem: List the next set of objects.
copyFromLocalFile(boolean, boolean, Path, Path) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem: The src file is on the local disk.
CORE_THREADS - Static variable in class org.apache.hadoop.fs.s3a.Constants: Deprecated.
counter(String, String) - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation: Create a counter in the registry.
counter(Statistic) - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation: Create a counter in the registry.
create(Path, FsPermission, boolean, int, short, long, Progressable) - Method in class org.apache.hadoop.fs.s3.S3FileSystem: Deprecated.
create(Path, FsPermission, boolean, int, short, long, Progressable) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem: Create an FSDataOutputStream at the indicated Path with write-progress reporting.
create(Path, FsPermission, boolean, int, short, long, Progressable) - Method in class org.apache.hadoop.fs.s3native.NativeS3FileSystem
createAwsConf(Configuration) - Static method in class org.apache.hadoop.fs.s3a.DefaultS3ClientFactory: Create a new ClientConfiguration.
createAWSCredentialProviderSet(URI, Configuration) - Static method in class org.apache.hadoop.fs.s3a.S3AUtils: Create the AWS credentials from the providers and the URI.
createDynamoDBClient(String) - Method in interface org.apache.hadoop.fs.s3a.s3guard.DynamoDBClientFactory: Create a DynamoDB client object from configuration.
createDynamoDBClient(String) - Method in class org.apache.hadoop.fs.s3a.s3guard.DynamoDBClientFactory.DefaultDynamoDBClientFactory
createFileStatus(Path, S3ObjectSummary, long, String) - Static method in class org.apache.hadoop.fs.s3a.S3AUtils: Create a files status instance from a listing.
createNonRecursive(Path, FsPermission, EnumSet<CreateFlag>, int, short, long, Progressable) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem
createS3Client(URI) - Method in class org.apache.hadoop.fs.s3a.DefaultS3ClientFactory
createS3Client(URI) - Method in interface org.apache.hadoop.fs.s3a.S3ClientFactory: Creates a new AmazonS3 client.
createUploadFileStatus(Path, boolean, long, long, String) - Static method in class org.apache.hadoop.fs.s3a.S3AUtils: Create a file status for object we just uploaded.
CredentialInitializationException - Exception in org.apache.hadoop.fs.s3a: Exception which Hadoop's AWSCredentialsProvider implementations should throw when there is a problem with the credential setup.
CredentialInitializationException(String, Throwable) - Constructor for exception org.apache.hadoop.fs.s3a.CredentialInitializationException
CredentialInitializationException(String) - Constructor for exception org.apache.hadoop.fs.s3a.CredentialInitializationException

D

dateToLong(Date) - Static method in class org.apache.hadoop.fs.s3a.S3AUtils: Date to long conversion.
DAYS_FLAG - Static variable in class org.apache.hadoop.fs.s3a.s3guard.S3GuardTool
decrementGauge(Statistic, long) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem: Decrement a gauge by a specific value.
decrementGauge(Statistic, long) - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation: Decrement a specific gauge.
DEFAULT_BLOCKSIZE - Static variable in class org.apache.hadoop.fs.s3a.S3AFileSystem: Default blocksize as used in blocksize and FS status queries.
DEFAULT_CANNED_ACL - Static variable in class org.apache.hadoop.fs.s3a.Constants
DEFAULT_DELAY_KEY_MSEC - Static variable in class org.apache.hadoop.fs.s3a.InconsistentAmazonS3Client: How many seconds affected keys will be delayed from appearing in listing.
DEFAULT_DELAY_KEY_PROBABILITY - Static variable in class org.apache.hadoop.fs.s3a.InconsistentAmazonS3Client
DEFAULT_DELAY_KEY_SUBSTRING - Static variable in class org.apache.hadoop.fs.s3a.InconsistentAmazonS3Client: Keys containing this substring will be subject to delayed visibility.
DEFAULT_ESTABLISH_TIMEOUT - Static variable in class org.apache.hadoop.fs.s3a.Constants
DEFAULT_FAST_BUFFER_SIZE - Static variable in class org.apache.hadoop.fs.s3a.Constants
DEFAULT_FAST_UPLOAD - Static variable in class org.apache.hadoop.fs.s3a.Constants
DEFAULT_FAST_UPLOAD_ACTIVE_BLOCKS - Static variable in class org.apache.hadoop.fs.s3a.Constants: Limit of queued block upload operations before writes block.
DEFAULT_FAST_UPLOAD_BUFFER - Static variable in class org.apache.hadoop.fs.s3a.Constants: Default buffer option: "disk".
DEFAULT_KEEPALIVE_TIME - Static variable in class org.apache.hadoop.fs.s3a.Constants
DEFAULT_MAX_ERROR_RETRIES - Static variable in class org.apache.hadoop.fs.s3a.Constants
DEFAULT_MAX_PAGING_KEYS - Static variable in class org.apache.hadoop.fs.s3a.Constants
DEFAULT_MAX_RECORDS - Static variable in class org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore
DEFAULT_MAX_THREADS - Static variable in class org.apache.hadoop.fs.s3a.Constants
DEFAULT_MAX_TOTAL_TASKS - Static variable in class org.apache.hadoop.fs.s3a.Constants
DEFAULT_MAXIMUM_CONNECTIONS - Static variable in class org.apache.hadoop.fs.s3a.Constants
DEFAULT_METADATASTORE_AUTHORITATIVE - Static variable in class org.apache.hadoop.fs.s3a.Constants
DEFAULT_MIN_MULTIPART_THRESHOLD - Static variable in class org.apache.hadoop.fs.s3a.Constants
DEFAULT_MULTIPART_SIZE - Static variable in class org.apache.hadoop.fs.s3a.Constants
DEFAULT_PURGE_EXISTING_MULTIPART - Static variable in class org.apache.hadoop.fs.s3a.Constants
DEFAULT_PURGE_EXISTING_MULTIPART_AGE - Static variable in class org.apache.hadoop.fs.s3a.Constants
DEFAULT_READAHEAD_RANGE - Static variable in class org.apache.hadoop.fs.s3a.Constants
DEFAULT_S3_CLIENT_FACTORY_IMPL - Static variable in class org.apache.hadoop.fs.s3a.Constants
DEFAULT_SECURE_CONNECTIONS - Static variable in class org.apache.hadoop.fs.s3a.Constants
DEFAULT_SOCKET_RECV_BUFFER - Static variable in class org.apache.hadoop.fs.s3a.Constants
DEFAULT_SOCKET_SEND_BUFFER - Static variable in class org.apache.hadoop.fs.s3a.Constants
DEFAULT_SOCKET_TIMEOUT - Static variable in class org.apache.hadoop.fs.s3a.Constants
DefaultS3ClientFactory - Class in org.apache.hadoop.fs.s3a: The default factory implementation, which calls the AWS SDK to configure and create an AmazonS3Client that communicates with the S3 service.
DefaultS3ClientFactory() - Constructor for class org.apache.hadoop.fs.s3a.DefaultS3ClientFactory
delete(Path, boolean) - Method in class org.apache.hadoop.fs.s3.S3FileSystem: Deprecated.
delete(Path, boolean) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem: Delete a Path.
delete(Path) - Method in class org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore
delete(Path) - Method in class org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore
delete(Path) - Method in interface org.apache.hadoop.fs.s3a.s3guard.MetadataStore: Deletes exactly one path, leaving a tombstone to prevent lingering, inconsistent copies of it from being listed.
delete(Path) - Method in class org.apache.hadoop.fs.s3a.s3guard.NullMetadataStore
delete(Path, boolean) - Method in class org.apache.hadoop.fs.s3native.NativeS3FileSystem
deleteBlock(Block) - Method in interface org.apache.hadoop.fs.s3.FileSystemStore: Deprecated.
deleteINode(Path) - Method in interface org.apache.hadoop.fs.s3.FileSystemStore: Deprecated.
deleteObject(DeleteObjectRequest) - Method in class org.apache.hadoop.fs.s3a.InconsistentAmazonS3Client
deleteObjects(DeleteObjectsRequest) - Method in class org.apache.hadoop.fs.s3a.InconsistentAmazonS3Client
deleteSubtree(Path) - Method in class org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore
deleteSubtree(Path) - Method in class org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore
deleteSubtree(Path) - Method in interface org.apache.hadoop.fs.s3a.s3guard.MetadataStore: Deletes the entire sub-tree rooted at the given path, leaving tombstones to prevent lingering, inconsistent copies of it from being listed.
deleteSubtree(Path) - Method in class org.apache.hadoop.fs.s3a.s3guard.NullMetadataStore
DescendantsIterator - Class in org.apache.hadoop.fs.s3a.s3guard: DescendantsIterator is a RemoteIterator that implements pre-ordering breadth-first traversal (BFS) of a path and all of its descendants recursively.
DescendantsIterator(MetadataStore, PathMetadata) - Constructor for class org.apache.hadoop.fs.s3a.s3guard.DescendantsIterator: Creates a new DescendantsIterator.
deserialize(InputStream) - Static method in class org.apache.hadoop.fs.s3.INode: Deprecated.
destroy() - Method in class org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore
destroy() - Method in class org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore
destroy() - Method in interface org.apache.hadoop.fs.s3a.s3guard.MetadataStore: Destroy all resources associated with the metadata store.
destroy() - Method in class org.apache.hadoop.fs.s3a.s3guard.NullMetadataStore
DIRECTORY_INODE - Static variable in class org.apache.hadoop.fs.s3.INode: Deprecated.
directoryCreated() - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation: Indicate that S3A created a directory.
directoryDeleted() - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation: Indicate that S3A just deleted a directory.
DirListingMetadata - Class in org.apache.hadoop.fs.s3a.s3guard: DirListingMetadata models a directory listing stored in a MetadataStore.
DirListingMetadata(Path, Collection<PathMetadata>, boolean) - Constructor for class org.apache.hadoop.fs.s3a.s3guard.DirListingMetadata: Create a directory listing metadata container.
DirListingMetadata(DirListingMetadata) - Constructor for class org.apache.hadoop.fs.s3a.s3guard.DirListingMetadata: Copy constructor.
dirListingUnion(MetadataStore, Path, List<FileStatus>, DirListingMetadata, boolean) - Static method in class org.apache.hadoop.fs.s3a.s3guard.S3Guard: Given directory listing metadata from both the backing store and the MetadataStore, merge the two sources of truth to create a consistent view of the current directory contents, which can be returned to clients.
dirMetaToStatuses(DirListingMetadata) - Static method in class org.apache.hadoop.fs.s3a.s3guard.S3Guard: Convert the data of a directory listing to an array of FileStatus entries.
dump() - Method in interface org.apache.hadoop.fs.s3.FileSystemStore: Deprecated.

Diagnostic method to dump all INodes to the console.
dump(String, String, String, boolean) - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation: Dump all the metrics to a string.
DynamoDBClientFactory - Interface in org.apache.hadoop.fs.s3a.s3guard: Interface to create a DynamoDB client.
DynamoDBClientFactory.DefaultDynamoDBClientFactory - Class in org.apache.hadoop.fs.s3a.s3guard: The default implementation for creating an AmazonDynamoDB.
DynamoDBClientFactory.DefaultDynamoDBClientFactory() - Constructor for class org.apache.hadoop.fs.s3a.s3guard.DynamoDBClientFactory.DefaultDynamoDBClientFactory
DynamoDBMetadataStore - Class in org.apache.hadoop.fs.s3a.s3guard: DynamoDBMetadataStore is a MetadataStore that persists file system metadata to DynamoDB.
DynamoDBMetadataStore() - Constructor for class org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore

E

E_INCOMPATIBLE_VERSION - Static variable in class org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore: Error: version mismatch.
E_NO_VERSION_MARKER - Static variable in class org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore: Error: version marker not found in table.
EMPTY - Static variable in class org.apache.hadoop.fs.s3native.S3xLoginHelper.Login
EMPTY_DIR - Static variable in class org.apache.hadoop.fs.s3a.s3guard.DirListingMetadata: Convenience parameter for passing into constructor.
ENABLE_MULTI_DELETE - Static variable in class org.apache.hadoop.fs.s3a.Constants
ENDPOINT - Static variable in class org.apache.hadoop.fs.s3a.Constants
ensureOutputParameterInRange(String, long) - Static method in class org.apache.hadoop.fs.s3a.S3AUtils: Ensure that the long value is in the range of an integer.
equals(Object) - Method in class org.apache.hadoop.fs.s3a.S3AFileStatus: Compare if this object is equal to another object.
equals(Object) - Method in class org.apache.hadoop.fs.s3a.s3guard.PathMetadata
equals(Object) - Method in class org.apache.hadoop.fs.s3native.S3xLoginHelper.Login: Equality test matches user and password.
errorIgnored() - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation: Note that an error was ignored.
ESTABLISH_TIMEOUT - Static variable in class org.apache.hadoop.fs.s3a.Constants
exists(Path) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem: Override superclass so as to add statistic collection.
exit(int, String) - Static method in class org.apache.hadoop.fs.s3a.s3guard.S3GuardTool
extractException(String, String, ExecutionException) - Static method in class org.apache.hadoop.fs.s3a.S3AUtils: Extract an exception from a failed future, and convert to an IOE.
extractLoginDetails(URI) - Static method in class org.apache.hadoop.fs.s3native.S3xLoginHelper: Extract the login details from a URI.
extractLoginDetailsWithWarnings(URI) - Static method in class org.apache.hadoop.fs.s3native.S3xLoginHelper: Extract the login details from a URI, logging a warning if the URI contains these.

F

FAIL_INJECT_INCONSISTENCY_KEY - Static variable in class org.apache.hadoop.fs.s3a.Constants: Inconsistency (visibility delay) injection settings.
FAIL_INJECT_INCONSISTENCY_MSEC - Static variable in class org.apache.hadoop.fs.s3a.Constants
FAIL_INJECT_INCONSISTENCY_PROBABILITY - Static variable in class org.apache.hadoop.fs.s3a.Constants
fakeDirsDeleted(int) - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation: Indicate that fake directory request was made.
FAST_BUFFER_SIZE - Static variable in class org.apache.hadoop.fs.s3a.Constants: Deprecated.
FAST_UPLOAD - Static variable in class org.apache.hadoop.fs.s3a.Constants
FAST_UPLOAD_ACTIVE_BLOCKS - Static variable in class org.apache.hadoop.fs.s3a.Constants: Maximum Number of blocks a single output stream can have active (uploading, or queued to the central FileSystem instance's pool of queued operations.
FAST_UPLOAD_BUFFER - Static variable in class org.apache.hadoop.fs.s3a.Constants: What buffer to use.
FAST_UPLOAD_BUFFER_ARRAY - Static variable in class org.apache.hadoop.fs.s3a.Constants: Use an in-memory array.
FAST_UPLOAD_BUFFER_DISK - Static variable in class org.apache.hadoop.fs.s3a.Constants: Buffer blocks to disk: "disk".
FAST_UPLOAD_BYTEBUFFER - Static variable in class org.apache.hadoop.fs.s3a.Constants: Use a byte buffer.
FILE_TYPES - Static variable in class org.apache.hadoop.fs.s3.INode: Deprecated.
fileCreated() - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation: Indicate that S3A created a file.
fileDeleted(int) - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation: Indicate that S3A deleted one or more file.s
filesCopied(int, long) - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation: Indicate that S3A copied some files within the store.
FileSystemStore - Interface in org.apache.hadoop.fs.s3: Deprecated.
flush() - Method in class org.apache.hadoop.fs.s3a.S3AOutputStream
forgetMetadata(Path) - Method in class org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore
forgetMetadata(Path) - Method in class org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore
forgetMetadata(Path) - Method in interface org.apache.hadoop.fs.s3a.s3guard.MetadataStore: Removes the record of exactly one path.
forgetMetadata(Path) - Method in class org.apache.hadoop.fs.s3a.s3guard.NullMetadataStore
forwardSeekOperations - Variable in class org.apache.hadoop.fs.s3a.S3AInstrumentation.InputStreamStatistics
fromBool(boolean) - Static method in enum org.apache.hadoop.fs.s3a.Tristate
fromFileStatus(FileStatus, Tristate) - Static method in class org.apache.hadoop.fs.s3a.S3AFileStatus: Convenience constructor for creating from a vanilla FileStatus plus an isEmptyDirectory flag.
fromSymbol(String) - Static method in enum org.apache.hadoop.fs.s3a.Statistic: Get a statistic from a symbol.
FS_S3A - Static variable in class org.apache.hadoop.fs.s3a.Constants
FS_S3A_BLOCK_SIZE - Static variable in class org.apache.hadoop.fs.s3a.Constants
FS_S3A_BUCKET_PREFIX - Static variable in class org.apache.hadoop.fs.s3a.Constants: Prefix for S3A bucket-specific properties: "fs.s3a.bucket.".
FS_S3A_PREFIX - Static variable in class org.apache.hadoop.fs.s3a.Constants: Prefix for all S3A properties: "fs.s3a.".

G

gauge(String, String) - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation: Create a gauge in the registry.
get(Path) - Method in class org.apache.hadoop.fs.s3a.s3guard.DirListingMetadata: Lookup entry within this directory listing.
get(Path) - Method in class org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore
get(Path, boolean) - Method in class org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore
get(Path) - Method in class org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore
get(Path, boolean) - Method in class org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore
get(Path) - Method in interface org.apache.hadoop.fs.s3a.s3guard.MetadataStore: Gets metadata for a path.
get(Path, boolean) - Method in interface org.apache.hadoop.fs.s3a.s3guard.MetadataStore: Gets metadata for a path.
get(Path) - Method in class org.apache.hadoop.fs.s3a.s3guard.NullMetadataStore
get(Path, boolean) - Method in class org.apache.hadoop.fs.s3a.s3guard.NullMetadataStore
getAccessKey() - Method in class org.apache.hadoop.fs.s3.S3Credentials: Deprecated.
getAdditionalDetails() - Method in exception org.apache.hadoop.fs.s3a.AWSS3IOException
getAWSAccessKeys(URI, Configuration) - Static method in class org.apache.hadoop.fs.s3a.S3AUtils: Return the access key and secret for S3 API use.
getBlocks() - Method in class org.apache.hadoop.fs.s3.INode: Deprecated.
getBucket() - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem: Get the bucket of this filesystem.
getBucketLocation() - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem: Get the region of a bucket.
getBucketLocation(String) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem: Get the region of a bucket.
getBucketOption(Configuration, String, String) - Static method in class org.apache.hadoop.fs.s3a.S3AUtils: Get a bucket-specific property.
getBytesPendingUpload() - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation.OutputStreamStatistics: Get the number of bytes pending upload.
getCanonicalServiceName() - Method in class org.apache.hadoop.fs.s3.S3FileSystem: Deprecated.
getCanonicalServiceName() - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem: Override getCanonicalServiceName because we don't support token in S3A.
getCanonicalServiceName() - Method in class org.apache.hadoop.fs.s3native.NativeS3FileSystem
getCause() - Method in exception org.apache.hadoop.fs.s3a.AWSClientIOException
getCause() - Method in exception org.apache.hadoop.fs.s3a.AWSS3IOException
getCause() - Method in exception org.apache.hadoop.fs.s3a.AWSServiceIOException
getCommandFormat() - Method in class org.apache.hadoop.fs.s3a.s3guard.S3GuardTool
getContentRangeFinish() - Method in class org.apache.hadoop.fs.s3a.S3AInputStream
getContentRangeStart() - Method in class org.apache.hadoop.fs.s3a.S3AInputStream
getCounterValue(Statistic) - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation: Get the value of a counter.
getCounterValue(String) - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation: Get the value of a counter.
getCredentials() - Method in class org.apache.hadoop.fs.s3a.AnonymousAWSCredentialsProvider
getCredentials() - Method in class org.apache.hadoop.fs.s3a.AWSCredentialProviderList: Iterate through the list of providers, to find one with credentials.
getCredentials() - Method in class org.apache.hadoop.fs.s3a.BasicAWSCredentialsProvider
getCredentials() - Method in class org.apache.hadoop.fs.s3a.SimpleAWSCredentialsProvider
getCredentials() - Method in class org.apache.hadoop.fs.s3a.TemporaryAWSCredentialsProvider
getDefaultBlockSize() - Method in class org.apache.hadoop.fs.s3.S3FileSystem: Deprecated.
getDefaultBlockSize() - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem: Deprecated.
use FileSystem.getDefaultBlockSize(Path) instead
getDefaultBlockSize() - Method in class org.apache.hadoop.fs.s3native.NativeS3FileSystem
getDefaultPort() - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem
getDescription() - Method in enum org.apache.hadoop.fs.s3a.Statistic
getDiagnostics() - Method in class org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore
getDiagnostics() - Method in class org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore
getDiagnostics() - Method in interface org.apache.hadoop.fs.s3a.s3guard.MetadataStore: Get any diagnostics information from a store, as a list of (key, value) tuples for display.
getDiagnostics() - Method in class org.apache.hadoop.fs.s3a.s3guard.NullMetadataStore
getErrorCode() - Method in exception org.apache.hadoop.fs.s3a.AWSServiceIOException
getErrorResponseXml() - Method in exception org.apache.hadoop.fs.s3a.AWSS3IOException
getExitCode() - Method in exception org.apache.hadoop.fs.s3a.RenameFailedException
getExtendedRequestId() - Method in exception org.apache.hadoop.fs.s3a.AWSS3IOException
getFileStatus(Path) - Method in class org.apache.hadoop.fs.s3.S3FileSystem: Deprecated.

FileStatus for S3 file systems.
getFileStatus(Path) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem: Return a file status object that represents the path.
getFileStatus() - Method in class org.apache.hadoop.fs.s3a.s3guard.PathMetadata
getFileStatus(Path) - Method in class org.apache.hadoop.fs.s3native.NativeS3FileSystem
getFilesystem() - Method in class org.apache.hadoop.fs.s3a.s3guard.S3GuardTool
getFileType() - Method in class org.apache.hadoop.fs.s3.INode: Deprecated.
getId() - Method in class org.apache.hadoop.fs.s3.Block: Deprecated.
getInputPolicy() - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem: Get the input policy for this FS instance.
getInstance() - Static method in class org.apache.hadoop.fs.s3a.SharedInstanceProfileCredentialsProvider: Deprecated.

Returns the singleton instance.
getInstrumentation() - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem: Get S3A Instrumentation.
getLength() - Method in class org.apache.hadoop.fs.s3.Block: Deprecated.
getLength() - Method in class org.apache.hadoop.fs.s3a.UploadInfo
getListing() - Method in class org.apache.hadoop.fs.s3a.s3guard.DirListingMetadata
getLong(String) - Method in class org.apache.hadoop.fs.s3a.S3AStorageStatistics
getLongStatistics() - Method in class org.apache.hadoop.fs.s3a.S3AStorageStatistics
getMessage() - Method in exception org.apache.hadoop.fs.s3a.AWSClientIOException
getMetadataStore() - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem: Get the metadata store.
getMetadataStore(FileSystem) - Static method in class org.apache.hadoop.fs.s3a.s3guard.S3Guard: Create a new instance of the configured MetadataStore.
getMethod() - Method in enum org.apache.hadoop.fs.s3a.S3AEncryptionMethods
getMethod(String) - Static method in enum org.apache.hadoop.fs.s3a.S3AEncryptionMethods: Get the encryption mechanism from the value provided.
getModificationTime() - Method in class org.apache.hadoop.fs.s3a.S3AFileStatus: Get the modification time of the file/directory.
getMultipartSizeProperty(Configuration, String, long) - Static method in class org.apache.hadoop.fs.s3a.S3AUtils: Get a size property from the configuration: this property must be at least equal to Constants.MULTIPART_MIN_SIZE.
getMultiPartThreshold() - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem: Get the threshold for multipart files.
getObjectMetadata(Path) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem: Low-level call to get at the object metadata.
getObjectMetadata(String) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem: Request object metadata; increments counters in the process.
getPartitionSize() - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem: Get the partition size for multipart operations.
getPassword() - Method in class org.apache.hadoop.fs.s3native.S3xLoginHelper.Login
getPath() - Method in class org.apache.hadoop.fs.s3a.s3guard.DirListingMetadata
getPolicy(String) - Static method in enum org.apache.hadoop.fs.s3a.S3AInputPolicy: Choose an FS access policy.
getPos() - Method in class org.apache.hadoop.fs.s3a.S3AInputStream
getRawResponseContent() - Method in exception org.apache.hadoop.fs.s3a.AWSServiceIOException
getReadahead() - Method in class org.apache.hadoop.fs.s3a.S3AInputStream: Get the current readahead value.
getRegistry() - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation: Get the metrics registry.
getRequestId() - Method in exception org.apache.hadoop.fs.s3a.AWSServiceIOException
getS3AStreamStatistics() - Method in class org.apache.hadoop.fs.s3a.S3AInputStream: Access the input stream statistics.
getS3GuardInstrumentation() - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation: Create a S3Guard instrumentation instance.
getScheme() - Method in class org.apache.hadoop.fs.s3.S3FileSystem: Deprecated.

Return the protocol scheme for the FileSystem.
getScheme() - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem: Return the protocol scheme for the FileSystem.
getScheme() - Method in class org.apache.hadoop.fs.s3a.S3AStorageStatistics
getScheme() - Method in class org.apache.hadoop.fs.s3native.NativeS3FileSystem: Return the protocol scheme for the FileSystem.
getSecretAccessKey() - Method in class org.apache.hadoop.fs.s3.S3Credentials: Deprecated.
getSerializedLength() - Method in class org.apache.hadoop.fs.s3.INode: Deprecated.
getServiceName() - Method in exception org.apache.hadoop.fs.s3a.AWSServiceIOException
getStatusCode() - Method in exception org.apache.hadoop.fs.s3a.AWSServiceIOException
getStorageStatistics() - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem: Get the storage statistics of this filesystem.
getStore() - Method in class org.apache.hadoop.fs.s3a.s3guard.S3GuardTool
getSymbol() - Method in enum org.apache.hadoop.fs.s3a.Statistic
getUpload() - Method in class org.apache.hadoop.fs.s3a.UploadInfo
getUri() - Method in class org.apache.hadoop.fs.s3.S3FileSystem: Deprecated.
getUri() - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem: Returns a URI whose scheme and authority identify this FileSystem.
getUri() - Method in class org.apache.hadoop.fs.s3native.NativeS3FileSystem
getUriDefaultPort() - Method in class org.apache.hadoop.fs.s3a.S3A
getUsage() - Method in class org.apache.hadoop.fs.s3a.s3guard.S3GuardTool
getUser() - Method in class org.apache.hadoop.fs.s3native.S3xLoginHelper.Login
getUsername() - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem: Get the username of the FS.
getVersion() - Method in interface org.apache.hadoop.fs.s3.FileSystemStore: Deprecated.
getWorkingDirectory() - Method in class org.apache.hadoop.fs.s3.S3FileSystem: Deprecated.
getWorkingDirectory() - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem: Get the current working directory for the given file system.
getWorkingDirectory() - Method in class org.apache.hadoop.fs.s3native.NativeS3FileSystem
globStatus(Path) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem: Increments the statistic Statistic.INVOCATION_GLOB_STATUS.
globStatus(Path, PathFilter) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem: Override superclass so as to add statistic collection.

H

hashCode() - Method in class org.apache.hadoop.fs.s3a.S3AFileStatus: Returns a hash code value for the object, which is defined as the hash code of the path name.
hashCode() - Method in class org.apache.hadoop.fs.s3a.s3guard.PathMetadata
hashCode() - Method in class org.apache.hadoop.fs.s3native.S3xLoginHelper.Login
hasLogin() - Method in class org.apache.hadoop.fs.s3native.S3xLoginHelper.Login: Predicate to verify login details are defined.
hasMetadataStore() - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem: Does this Filesystem have a metadata store?
hasNext() - Method in class org.apache.hadoop.fs.s3a.s3guard.DescendantsIterator
hasNext() - Method in class org.apache.hadoop.fs.s3a.s3guard.MetadataStoreListFilesIterator
HOURS_FLAG - Static variable in class org.apache.hadoop.fs.s3a.s3guard.S3GuardTool

I

InconsistentAmazonS3Client - Class in org.apache.hadoop.fs.s3a: A wrapper around AmazonS3 that injects inconsistency and/or errors.
InconsistentAmazonS3Client(AWSCredentialsProvider, ClientConfiguration, Configuration) - Constructor for class org.apache.hadoop.fs.s3a.InconsistentAmazonS3Client
InconsistentS3ClientFactory - Class in org.apache.hadoop.fs.s3a: S3 Client factory used for testing with eventual consistency fault injection.
InconsistentS3ClientFactory() - Constructor for class org.apache.hadoop.fs.s3a.InconsistentS3ClientFactory
incrementCounter(Statistic, long) - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation: Increment a specific counter.
incrementCounter(Statistic, AtomicLong) - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation: Increment a specific counter.
incrementCounter(Statistic, long) - Method in class org.apache.hadoop.fs.s3a.S3AStorageStatistics: Increment a specific counter.
incrementGauge(Statistic, long) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem: Increment a gauge by a specific value.
incrementGauge(Statistic, long) - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation: Increment a specific gauge.
incrementPutCompletedStatistics(boolean, long) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem: At the end of a put/multipart upload operation, update the relevant counters and gauges.
incrementPutProgressStatistics(String, long) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem: Callback for use in progress callbacks from put/multipart upload events.
incrementPutStartStatistics(long) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem: At the start of a put/multipart upload operation, update the relevant counters.
incrementReadOperations() - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem: Increment read operations.
incrementStatistic(Statistic) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem: Increment a statistic by 1.
incrementStatistic(Statistic, long) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem: Increment a statistic by a specific value.
incrementWriteOperations() - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem: Increment the write operation counter.
initialize(URI, Configuration) - Method in interface org.apache.hadoop.fs.s3.FileSystemStore: Deprecated.
initialize(URI) - Method in class org.apache.hadoop.fs.s3.MigrationTool: Deprecated.
initialize(URI, Configuration) - Method in class org.apache.hadoop.fs.s3.S3Credentials: Deprecated.
initialize(URI, Configuration) - Method in class org.apache.hadoop.fs.s3.S3FileSystem: Deprecated.
initialize(URI, Configuration) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem: Called after a new FileSystem instance is constructed.
initialize(FileSystem) - Method in class org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore
initialize(Configuration) - Method in class org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore: Performs one-time initialization of the metadata store via configuration.
initialize(FileSystem) - Method in class org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore
initialize(Configuration) - Method in class org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore
initialize(FileSystem) - Method in interface org.apache.hadoop.fs.s3a.s3guard.MetadataStore: Performs one-time initialization of the metadata store.
initialize(Configuration) - Method in interface org.apache.hadoop.fs.s3a.s3guard.MetadataStore: Performs one-time initialization of the metadata store via configuration.
initialize(FileSystem) - Method in class org.apache.hadoop.fs.s3a.s3guard.NullMetadataStore
initialize(Configuration) - Method in class org.apache.hadoop.fs.s3a.s3guard.NullMetadataStore
initialize(URI, Configuration) - Method in class org.apache.hadoop.fs.s3native.NativeS3FileSystem
initialized() - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation.S3GuardInstrumentation: Initialized event.
innerListStatus(Path) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem: List the statuses of the files/directories in the given path if the path is a directory.
INode - Class in org.apache.hadoop.fs.s3: Deprecated.
INode(INode.FileType, Block[]) - Constructor for class org.apache.hadoop.fs.s3.INode: Deprecated.
inodeExists(Path) - Method in interface org.apache.hadoop.fs.s3.FileSystemStore: Deprecated.
INPUT_FADV_NORMAL - Static variable in class org.apache.hadoop.fs.s3a.Constants: General input.
INPUT_FADV_RANDOM - Static variable in class org.apache.hadoop.fs.s3a.Constants: Optimized purely for random seek+read/positionedRead operations; The performance of sequential IO may be reduced in exchange for more efficient seek() operations.
INPUT_FADV_SEQUENTIAL - Static variable in class org.apache.hadoop.fs.s3a.Constants: Optimized for sequential access.
INPUT_FADVISE - Static variable in class org.apache.hadoop.fs.s3a.Constants: Which input strategy to use for buffering, seeking and similar when reading data.
invalidArgs(String, Object...) - Static method in class org.apache.hadoop.fs.s3a.s3guard.S3GuardTool: Build the exception to raise on invalid arguments.
isAuthoritative() - Method in class org.apache.hadoop.fs.s3a.s3guard.DirListingMetadata
isDeleted() - Method in class org.apache.hadoop.fs.s3a.s3guard.PathMetadata
isDirectory() - Method in class org.apache.hadoop.fs.s3.INode: Deprecated.
isDirectory(Path) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem: Override superclass so as to add statistic collection.
isEmpty() - Method in class org.apache.hadoop.fs.s3a.s3guard.DirListingMetadata: Is the underlying directory known to be empty?
isEmptyDirectory() - Method in class org.apache.hadoop.fs.s3a.S3AFileStatus
isEmptyDirectory() - Method in class org.apache.hadoop.fs.s3a.s3guard.PathMetadata: Query if a directory is empty.
isFile() - Method in class org.apache.hadoop.fs.s3.INode: Deprecated.
isFile(Path) - Method in class org.apache.hadoop.fs.s3.S3FileSystem: Deprecated.
isFile(Path) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem: Override superclass so as to add statistic collection.
isNullMetadataStore(MetadataStore) - Static method in class org.apache.hadoop.fs.s3a.s3guard.S3Guard: Although NullMetadataStore does nothing, callers may wish to avoid work (fast path) when the NullMetadataStore is in use.
isRetryable() - Method in exception org.apache.hadoop.fs.s3a.AWSServiceIOException
isRetryable() - Method in exception org.apache.hadoop.fs.s3a.CredentialInitializationException: This exception is not going to go away if you try calling it again.
isReuseLastProvider() - Method in class org.apache.hadoop.fs.s3a.AWSCredentialProviderList: query the AWSCredentialProviderList.reuseLastProvider flag.
isTracked(String) - Method in class org.apache.hadoop.fs.s3a.S3AStorageStatistics

K

KEEPALIVE_TIME - Static variable in class org.apache.hadoop.fs.s3a.Constants

L

listChildren(Path) - Method in class org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore
listChildren(Path) - Method in class org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore
listChildren(Path) - Method in interface org.apache.hadoop.fs.s3a.s3guard.MetadataStore: Lists metadata for all direct children of a path.
listChildren(Path) - Method in class org.apache.hadoop.fs.s3a.s3guard.NullMetadataStore
listDeepSubPaths(Path) - Method in interface org.apache.hadoop.fs.s3.FileSystemStore: Deprecated.
listFiles(Path, boolean) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem: .
listFilesAndEmptyDirectories(Path, boolean) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem
Listing - Class in org.apache.hadoop.fs.s3a: Place for the S3A listing classes; keeps all the small classes under control.
Listing(S3AFileSystem) - Constructor for class org.apache.hadoop.fs.s3a.Listing
listLocatedStatus(Path) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem: Override superclass so as to add statistic collection.
listLocatedStatus(Path, PathFilter) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem: .
listObjects(ListObjectsRequest) - Method in class org.apache.hadoop.fs.s3a.InconsistentAmazonS3Client
listObjects(ListObjectsRequest) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem: Initiate a listObjects operation, incrementing metrics in the process.
listProviderNames() - Method in class org.apache.hadoop.fs.s3a.AWSCredentialProviderList: List all the providers' names.
listStatus(Path) - Method in class org.apache.hadoop.fs.s3.S3FileSystem: Deprecated.
listStatus(Path) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem: List the statuses of the files/directories in the given path if the path is a directory.
listStatus(Path) - Method in class org.apache.hadoop.fs.s3native.NativeS3FileSystem: If f is a file, this method will make a single call to S3.
listSubPaths(Path) - Method in interface org.apache.hadoop.fs.s3.FileSystemStore: Deprecated.
listTombstones() - Method in class org.apache.hadoop.fs.s3a.s3guard.DirListingMetadata
listTombstones() - Method in class org.apache.hadoop.fs.s3a.s3guard.MetadataStoreListFilesIterator
LocalMetadataStore - Class in org.apache.hadoop.fs.s3a.s3guard: This is a local, in-memory, implementation of MetadataStore.
LocalMetadataStore() - Constructor for class org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore
LOG - Static variable in class org.apache.hadoop.fs.s3a.DefaultS3ClientFactory
LOG - Static variable in class org.apache.hadoop.fs.s3a.S3AFileSystem
LOG - Static variable in class org.apache.hadoop.fs.s3a.S3AOutputStream
LOG - Static variable in interface org.apache.hadoop.fs.s3a.s3guard.DynamoDBClientFactory
LOG - Static variable in class org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore
LOG - Static variable in class org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore
LOG - Static variable in class org.apache.hadoop.fs.s3a.s3guard.MetadataStoreListFilesIterator
LOG - Static variable in class org.apache.hadoop.fs.s3native.NativeS3FileSystem
LOGIN_WARNING - Static variable in class org.apache.hadoop.fs.s3native.S3xLoginHelper
lookupGauge(String) - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation: Look up a gauge.
lookupMetric(String) - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation: Look up a metric from both the registered set and the lighter weight stream entries.
lookupQuantiles(String) - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation: Look up a quantiles.
LruHashMap<K,V> - Class in org.apache.hadoop.fs.s3a.s3guard: LinkedHashMap that implements a maximum size and LRU eviction policy.
LruHashMap(int, int) - Constructor for class org.apache.hadoop.fs.s3a.s3guard.LruHashMap

M

main(String[]) - Static method in class org.apache.hadoop.fs.s3.MigrationTool: Deprecated.
main(String[]) - Static method in class org.apache.hadoop.fs.s3a.s3guard.S3GuardTool: Main entry point.
makeDirsOrdered(MetadataStore, List<Path>, String, boolean) - Static method in class org.apache.hadoop.fs.s3a.s3guard.S3Guard: Update MetadataStore to reflect creation of the given directories.
markDeleted(Path) - Method in class org.apache.hadoop.fs.s3a.s3guard.DirListingMetadata: Replace an entry with a tombstone.
markSupported() - Method in class org.apache.hadoop.fs.s3a.S3AInputStream
MATCH_ALL_KEYS - Static variable in class org.apache.hadoop.fs.s3a.InconsistentAmazonS3Client: Special config value since we can't store empty strings in XML.
MAX_ERROR_RETRIES - Static variable in class org.apache.hadoop.fs.s3a.Constants
MAX_MULTIPART_COUNT - Static variable in class org.apache.hadoop.fs.s3a.Constants: Maximum number of partitions in a multipart upload: 10000.
MAX_PAGING_KEYS - Static variable in class org.apache.hadoop.fs.s3a.Constants
MAX_THREADS - Static variable in class org.apache.hadoop.fs.s3a.Constants
MAX_TOTAL_TASKS - Static variable in class org.apache.hadoop.fs.s3a.Constants
MAXIMUM_CONNECTIONS - Static variable in class org.apache.hadoop.fs.s3a.Constants
META_FLAG - Static variable in class org.apache.hadoop.fs.s3a.s3guard.S3GuardTool
MetadataStore - Interface in org.apache.hadoop.fs.s3a.s3guard: MetadataStore defines the set of operations that any metadata store implementation must provide.
METADATASTORE_AUTHORITATIVE - Static variable in class org.apache.hadoop.fs.s3a.Constants: Whether or not to allow MetadataStore to be source of truth.
MetadataStoreListFilesIterator - Class in org.apache.hadoop.fs.s3a.s3guard: MetadataStoreListFilesIterator is a RemoteIterator that is similar to DescendantsIterator but does not return directories that have (or may have) children, and will also provide access to the set of tombstones to allow recently deleted S3 objects to be filtered out from a corresponding request.
MetadataStoreListFilesIterator(MetadataStore, PathMetadata, boolean) - Constructor for class org.apache.hadoop.fs.s3a.s3guard.MetadataStoreListFilesIterator
MigrationTool - Class in org.apache.hadoop.fs.s3: Deprecated.
MigrationTool() - Constructor for class org.apache.hadoop.fs.s3.MigrationTool: Deprecated.
MIN_MULTIPART_THRESHOLD - Static variable in class org.apache.hadoop.fs.s3a.Constants
MIN_RETRY_SLEEP_MSEC - Static variable in class org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore: Initial delay for retries when batched operations get throttled by DynamoDB.
MINUTES_FLAG - Static variable in class org.apache.hadoop.fs.s3a.s3guard.S3GuardTool
mkdirs(Path, FsPermission) - Method in class org.apache.hadoop.fs.s3.S3FileSystem: Deprecated.
mkdirs(Path, FsPermission) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem: Make the given path and all non-existent parents into directories.
mkdirs(Path, FsPermission) - Method in class org.apache.hadoop.fs.s3native.NativeS3FileSystem
move(Collection<Path>, Collection<PathMetadata>) - Method in class org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore
move(Collection<Path>, Collection<PathMetadata>) - Method in class org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore
move(Collection<Path>, Collection<PathMetadata>) - Method in interface org.apache.hadoop.fs.s3a.s3guard.MetadataStore: Record the effects of a FileSystem.rename(Path, Path) in the MetadataStore.
move(Collection<Path>, Collection<PathMetadata>) - Method in class org.apache.hadoop.fs.s3a.s3guard.NullMetadataStore
mruGet(K) - Method in class org.apache.hadoop.fs.s3a.s3guard.LruHashMap: get() plus side-effect of making the element Most Recently Used.
MULTIPART_MIN_SIZE - Static variable in class org.apache.hadoop.fs.s3a.Constants: The minimum multipart size which S3 supports.
MULTIPART_SIZE - Static variable in class org.apache.hadoop.fs.s3a.Constants

N

NAME - Static variable in class org.apache.hadoop.fs.s3a.AnonymousAWSCredentialsProvider
NAME - Static variable in class org.apache.hadoop.fs.s3a.BasicAWSCredentialsProvider
NAME - Static variable in class org.apache.hadoop.fs.s3a.S3AStorageStatistics
NAME - Static variable in class org.apache.hadoop.fs.s3a.SimpleAWSCredentialsProvider
NAME - Static variable in class org.apache.hadoop.fs.s3a.TemporaryAWSCredentialsProvider
NativeS3FileSystem - Class in org.apache.hadoop.fs.s3native: A FileSystem for reading and writing files stored on Amazon S3.
NativeS3FileSystem() - Constructor for class org.apache.hadoop.fs.s3native.NativeS3FileSystem
NativeS3FileSystem(NativeFileSystemStore) - Constructor for class org.apache.hadoop.fs.s3native.NativeS3FileSystem
newAmazonS3Client(AWSCredentialsProvider, ClientConfiguration) - Method in class org.apache.hadoop.fs.s3a.DefaultS3ClientFactory: Wrapper around constructor for AmazonS3 client.
newAmazonS3Client(AWSCredentialsProvider, ClientConfiguration) - Method in class org.apache.hadoop.fs.s3a.InconsistentS3ClientFactory
newObjectMetadata() - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem: Create a new object metadata instance.
newObjectMetadata(long) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem: Create a new object metadata instance.
newPutObjectRequest(String, ObjectMetadata, File) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem: Create a putObject request.
next() - Method in class org.apache.hadoop.fs.s3a.s3guard.DescendantsIterator
next() - Method in class org.apache.hadoop.fs.s3a.s3guard.MetadataStoreListFilesIterator
NO_AWS_CREDENTIAL_PROVIDERS - Static variable in class org.apache.hadoop.fs.s3a.AWSCredentialProviderList
NullMetadataStore - Class in org.apache.hadoop.fs.s3a.s3guard: A no-op implementation of MetadataStore.
NullMetadataStore() - Constructor for class org.apache.hadoop.fs.s3a.s3guard.NullMetadataStore
numEntries() - Method in class org.apache.hadoop.fs.s3a.s3guard.DirListingMetadata

O

objectRepresentsDirectory(String, long) - Static method in class org.apache.hadoop.fs.s3a.S3AUtils: Predicate: does the object represent a directory?.
open(Path, int) - Method in class org.apache.hadoop.fs.s3.S3FileSystem: Deprecated.
open(Path, int) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem: Opens an FSDataInputStream at the indicated Path.
open(Path, int) - Method in class org.apache.hadoop.fs.s3native.NativeS3FileSystem
openOperations - Variable in class org.apache.hadoop.fs.s3a.S3AInstrumentation.InputStreamStatistics
org.apache.hadoop.fs.s3 - package org.apache.hadoop.fs.s3: A distributed, block-based implementation of FileSystem that uses Amazon S3 as a backing store.
org.apache.hadoop.fs.s3a - package org.apache.hadoop.fs.s3a: S3A Filesystem.
org.apache.hadoop.fs.s3a.s3guard - package org.apache.hadoop.fs.s3a.s3guard: This package contains classes related to S3Guard: a feature of S3A to mask the eventual consistency behavior of S3 and optimize access patterns by coordinating with a strongly consistent external store for file system metadata.
org.apache.hadoop.fs.s3native - package org.apache.hadoop.fs.s3native: A distributed implementation of FileSystem for reading and writing files on Amazon S3.

P

PATH_STYLE_ACCESS - Static variable in class org.apache.hadoop.fs.s3a.Constants
PathMetadata - Class in org.apache.hadoop.fs.s3a.s3guard: PathMetadata models path metadata stored in the MetadataStore.
PathMetadata(FileStatus) - Constructor for class org.apache.hadoop.fs.s3a.s3guard.PathMetadata: Creates a new PathMetadata containing given FileStatus.
PathMetadata(FileStatus, Tristate) - Constructor for class org.apache.hadoop.fs.s3a.s3guard.PathMetadata
PathMetadata(FileStatus, Tristate, boolean) - Constructor for class org.apache.hadoop.fs.s3a.s3guard.PathMetadata
pathToKey(Path) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem: Turns a path (relative or otherwise) into an S3 key.
PLUS_ENCODED - Static variable in class org.apache.hadoop.fs.s3native.S3xLoginHelper
PLUS_UNENCODED - Static variable in class org.apache.hadoop.fs.s3native.S3xLoginHelper
PLUS_WARNING - Static variable in class org.apache.hadoop.fs.s3native.S3xLoginHelper
prettyPrint(StringBuilder) - Method in class org.apache.hadoop.fs.s3a.s3guard.DirListingMetadata: Log contents to supplied StringBuilder in a pretty fashion.
prettyPrint() - Method in class org.apache.hadoop.fs.s3a.s3guard.DirListingMetadata
prettyPrint(StringBuilder) - Method in class org.apache.hadoop.fs.s3a.s3guard.PathMetadata: Log contents to supplied StringBuilder in a pretty fashion.
prettyPrint() - Method in class org.apache.hadoop.fs.s3a.s3guard.PathMetadata
printStoreDiagnostics(PrintStream, MetadataStore) - Static method in class org.apache.hadoop.fs.s3a.s3guard.S3GuardTool: Retrieve and Print store diagnostics.
ProgressableProgressListener - Class in org.apache.hadoop.fs.s3a: Listener to progress from AWS regarding transfers.
ProgressableProgressListener(S3AFileSystem, String, Upload, Progressable) - Constructor for class org.apache.hadoop.fs.s3a.ProgressableProgressListener: Instantiate.
progressChanged(ProgressEvent) - Method in class org.apache.hadoop.fs.s3a.ProgressableProgressListener
propagateBucketOptions(Configuration, String) - Static method in class org.apache.hadoop.fs.s3a.S3AUtils: Propagates bucket-specific settings into generic S3A configuration keys.
PROXY_DOMAIN - Static variable in class org.apache.hadoop.fs.s3a.Constants
PROXY_HOST - Static variable in class org.apache.hadoop.fs.s3a.Constants
PROXY_PASSWORD - Static variable in class org.apache.hadoop.fs.s3a.Constants
PROXY_PORT - Static variable in class org.apache.hadoop.fs.s3a.Constants
PROXY_USERNAME - Static variable in class org.apache.hadoop.fs.s3a.Constants
PROXY_WORKSTATION - Static variable in class org.apache.hadoop.fs.s3a.Constants
prune(long) - Method in class org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore
prune(long) - Method in class org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore
prune(long) - Method in interface org.apache.hadoop.fs.s3a.s3guard.MetadataStore: Clear any metadata older than a specified time from the repository.
prune(long) - Method in class org.apache.hadoop.fs.s3a.s3guard.NullMetadataStore
purge() - Method in interface org.apache.hadoop.fs.s3.FileSystemStore: Deprecated.

Delete everything.
PURGE_EXISTING_MULTIPART - Static variable in class org.apache.hadoop.fs.s3a.Constants
PURGE_EXISTING_MULTIPART_AGE - Static variable in class org.apache.hadoop.fs.s3a.Constants
put(FileStatus) - Method in class org.apache.hadoop.fs.s3a.s3guard.DirListingMetadata: Add an entry to the directory listing.
put(PathMetadata) - Method in class org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore
put(Collection<PathMetadata>) - Method in class org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore
put(DirListingMetadata) - Method in class org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore
put(PathMetadata) - Method in class org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore
put(DirListingMetadata) - Method in class org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore
put(Collection<PathMetadata>) - Method in class org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore
put(PathMetadata) - Method in interface org.apache.hadoop.fs.s3a.s3guard.MetadataStore: Saves metadata for exactly one path.
put(Collection<PathMetadata>) - Method in interface org.apache.hadoop.fs.s3a.s3guard.MetadataStore: Saves metadata for any number of paths.
put(DirListingMetadata) - Method in interface org.apache.hadoop.fs.s3a.s3guard.MetadataStore: Save directory listing metadata.
put(PathMetadata) - Method in class org.apache.hadoop.fs.s3a.s3guard.NullMetadataStore
put(Collection<PathMetadata>) - Method in class org.apache.hadoop.fs.s3a.s3guard.NullMetadataStore
put(DirListingMetadata) - Method in class org.apache.hadoop.fs.s3a.s3guard.NullMetadataStore
putAndReturn(MetadataStore, S3AFileStatus, S3AInstrumentation) - Static method in class org.apache.hadoop.fs.s3a.s3guard.S3Guard: Helper function which puts a given S3AFileStatus into the MetadataStore and returns the same S3AFileStatus.
putObject(PutObjectRequest) - Method in class org.apache.hadoop.fs.s3a.InconsistentAmazonS3Client
putObject(PutObjectRequest) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem: Start a transfer-manager managed async PUT of an object, incrementing the put requests and put bytes counters.

Q

qualify(Path) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem: Qualify a path.
quantiles(Statistic, String, String, int) - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation: Create a quantiles in the registry.

R

read() - Method in class org.apache.hadoop.fs.s3a.S3AInputStream
read(byte[], int, int) - Method in class org.apache.hadoop.fs.s3a.S3AInputStream: This updates the statistics on read operations started and whether or not the read operation "completed", that is: returned the exact number of bytes requested.
READ_FLAG - Static variable in class org.apache.hadoop.fs.s3a.s3guard.S3GuardTool
READAHEAD_RANGE - Static variable in class org.apache.hadoop.fs.s3a.Constants: read ahead buffer size to prevent connection re-establishments.
readException() - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation.InputStreamStatistics: An ignored stream read exception was received.
readExceptions - Variable in class org.apache.hadoop.fs.s3a.S3AInstrumentation.InputStreamStatistics
readFully(long, byte[], int, int) - Method in class org.apache.hadoop.fs.s3a.S3AInputStream: Subclass readFully() operation which only seeks at the start of the series of operations; seeking back at the end.
readFullyOperations - Variable in class org.apache.hadoop.fs.s3a.S3AInstrumentation.InputStreamStatistics
readFullyOperationStarted(long, long) - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation.InputStreamStatistics: A PositionedRead.read(position, buffer, offset, length) operation has just started.
readOperationCompleted(int, int) - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation.InputStreamStatistics: A read operation has completed.
readOperations - Variable in class org.apache.hadoop.fs.s3a.S3AInstrumentation.InputStreamStatistics
readOperationStarted(long, long) - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation.InputStreamStatistics: A read(byte[] buf, int off, int len) operation has started.
readsIncomplete - Variable in class org.apache.hadoop.fs.s3a.S3AInstrumentation.InputStreamStatistics
refresh() - Method in class org.apache.hadoop.fs.s3a.AnonymousAWSCredentialsProvider
refresh() - Method in class org.apache.hadoop.fs.s3a.AWSCredentialProviderList: Refresh all child entries.
refresh() - Method in class org.apache.hadoop.fs.s3a.BasicAWSCredentialsProvider
refresh() - Method in class org.apache.hadoop.fs.s3a.SimpleAWSCredentialsProvider
refresh() - Method in class org.apache.hadoop.fs.s3a.TemporaryAWSCredentialsProvider
REGION_FLAG - Static variable in class org.apache.hadoop.fs.s3a.s3guard.S3GuardTool
remainingInCurrentRequest() - Method in class org.apache.hadoop.fs.s3a.S3AInputStream: Bytes left in the current request.
remainingInFile() - Method in class org.apache.hadoop.fs.s3a.S3AInputStream: Bytes left in stream.
remove(Path) - Method in class org.apache.hadoop.fs.s3a.s3guard.DirListingMetadata: Remove entry from this directory.
removeEldestEntry(Map.Entry<K, V>) - Method in class org.apache.hadoop.fs.s3a.s3guard.LruHashMap
rename(Path, Path) - Method in class org.apache.hadoop.fs.s3.S3FileSystem: Deprecated.
rename(Path, Path) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem: Renames Path src to Path dst.
rename(Path, Path) - Method in class org.apache.hadoop.fs.s3native.NativeS3FileSystem
RenameFailedException - Exception in org.apache.hadoop.fs.s3a: Error to indicate that a specific rename failed.
RenameFailedException(String, String, Throwable) - Constructor for exception org.apache.hadoop.fs.s3a.RenameFailedException
RenameFailedException(String, String, String) - Constructor for exception org.apache.hadoop.fs.s3a.RenameFailedException
RenameFailedException(Path, Path, String) - Constructor for exception org.apache.hadoop.fs.s3a.RenameFailedException
reset() - Method in class org.apache.hadoop.fs.s3a.S3AStorageStatistics
resetConnection() - Method in class org.apache.hadoop.fs.s3a.S3AInputStream: Forcibly reset the stream, by aborting the connection.
retrieveBlock(Block, long) - Method in interface org.apache.hadoop.fs.s3.FileSystemStore: Deprecated.
retrieveINode(Path) - Method in interface org.apache.hadoop.fs.s3.FileSystemStore: Deprecated.
run(String[]) - Method in class org.apache.hadoop.fs.s3.MigrationTool: Deprecated.
run(String[]) - Method in class org.apache.hadoop.fs.s3a.s3guard.S3GuardTool
run(String[], PrintStream) - Method in class org.apache.hadoop.fs.s3a.s3guard.S3GuardTool: Run the tool, capturing the output (if the tool supports that).
run(Configuration, String...) - Static method in class org.apache.hadoop.fs.s3a.s3guard.S3GuardTool: Execute the command with the given arguments.

S

S3_BLOCK_SIZE_DEFAULT - Static variable in class org.apache.hadoop.fs.s3.S3FileSystemConfigKeys: Deprecated.
S3_BLOCK_SIZE_KEY - Static variable in class org.apache.hadoop.fs.s3.S3FileSystemConfigKeys: Deprecated.
S3_BYTES_PER_CHECKSUM_DEFAULT - Static variable in class org.apache.hadoop.fs.s3.S3FileSystemConfigKeys: Deprecated.
S3_BYTES_PER_CHECKSUM_KEY - Static variable in class org.apache.hadoop.fs.s3.S3FileSystemConfigKeys: Deprecated.
S3_CLIENT_FACTORY_IMPL - Static variable in class org.apache.hadoop.fs.s3a.Constants
S3_CLIENT_WRITE_PACKET_SIZE_DEFAULT - Static variable in class org.apache.hadoop.fs.s3.S3FileSystemConfigKeys: Deprecated.
S3_CLIENT_WRITE_PACKET_SIZE_KEY - Static variable in class org.apache.hadoop.fs.s3.S3FileSystemConfigKeys: Deprecated.
S3_METADATA_STORE_IMPL - Static variable in class org.apache.hadoop.fs.s3a.Constants
S3_NATIVE_BLOCK_SIZE_DEFAULT - Static variable in class org.apache.hadoop.fs.s3native.S3NativeFileSystemConfigKeys
S3_NATIVE_BLOCK_SIZE_KEY - Static variable in class org.apache.hadoop.fs.s3native.S3NativeFileSystemConfigKeys
S3_NATIVE_BYTES_PER_CHECKSUM_DEFAULT - Static variable in class org.apache.hadoop.fs.s3native.S3NativeFileSystemConfigKeys
S3_NATIVE_BYTES_PER_CHECKSUM_KEY - Static variable in class org.apache.hadoop.fs.s3native.S3NativeFileSystemConfigKeys
S3_NATIVE_CLIENT_WRITE_PACKET_SIZE_DEFAULT - Static variable in class org.apache.hadoop.fs.s3native.S3NativeFileSystemConfigKeys
S3_NATIVE_CLIENT_WRITE_PACKET_SIZE_KEY - Static variable in class org.apache.hadoop.fs.s3native.S3NativeFileSystemConfigKeys
S3_NATIVE_REPLICATION_DEFAULT - Static variable in class org.apache.hadoop.fs.s3native.S3NativeFileSystemConfigKeys
S3_NATIVE_REPLICATION_KEY - Static variable in class org.apache.hadoop.fs.s3native.S3NativeFileSystemConfigKeys
S3_NATIVE_STREAM_BUFFER_SIZE_DEFAULT - Static variable in class org.apache.hadoop.fs.s3native.S3NativeFileSystemConfigKeys
S3_NATIVE_STREAM_BUFFER_SIZE_KEY - Static variable in class org.apache.hadoop.fs.s3native.S3NativeFileSystemConfigKeys
S3_REPLICATION_DEFAULT - Static variable in class org.apache.hadoop.fs.s3.S3FileSystemConfigKeys: Deprecated.
S3_REPLICATION_KEY - Static variable in class org.apache.hadoop.fs.s3.S3FileSystemConfigKeys: Deprecated.
S3_STREAM_BUFFER_SIZE_DEFAULT - Static variable in class org.apache.hadoop.fs.s3.S3FileSystemConfigKeys: Deprecated.
S3_STREAM_BUFFER_SIZE_KEY - Static variable in class org.apache.hadoop.fs.s3.S3FileSystemConfigKeys: Deprecated.
S3A - Class in org.apache.hadoop.fs.s3a: S3A implementation of AbstractFileSystem.
S3A(URI, Configuration) - Constructor for class org.apache.hadoop.fs.s3a.S3A
S3A_DEFAULT_PORT - Static variable in class org.apache.hadoop.fs.s3a.Constants
S3A_OUTPUT_COMMITTER_FACTORY - Static variable in class org.apache.hadoop.fs.s3a.Constants: Classname of the S3A-specific output committer factory.
S3A_OUTPUT_COMMITTER_MRV1 - Static variable in class org.apache.hadoop.fs.s3a.Constants: V1 committer.
S3A_SECURITY_CREDENTIAL_PROVIDER_PATH - Static variable in class org.apache.hadoop.fs.s3a.Constants: Extra set of security credentials which will be prepended to that set in "hadoop.security.credential.provider.path".
S3AEncryptionMethods - Enum in org.apache.hadoop.fs.s3a: This enum is to centralize the encryption methods and the value required in the configuration.
S3AFileStatus - Class in org.apache.hadoop.fs.s3a: File status for an S3A "file".
S3AFileStatus(boolean, Path, String) - Constructor for class org.apache.hadoop.fs.s3a.S3AFileStatus: Create a directory status.
S3AFileStatus(Tristate, Path, String) - Constructor for class org.apache.hadoop.fs.s3a.S3AFileStatus: Create a directory status.
S3AFileStatus(long, long, Path, long, String) - Constructor for class org.apache.hadoop.fs.s3a.S3AFileStatus: A simple file.
S3AFileSystem - Class in org.apache.hadoop.fs.s3a: The core S3A Filesystem implementation.
S3AFileSystem() - Constructor for class org.apache.hadoop.fs.s3a.S3AFileSystem
S3AInputPolicy - Enum in org.apache.hadoop.fs.s3a: Filesystem input policy.
S3AInputStream - Class in org.apache.hadoop.fs.s3a: The input stream for an S3A object.
S3AInputStream(S3ObjectAttributes, long, AmazonS3, FileSystem.Statistics, S3AInstrumentation, long, S3AInputPolicy) - Constructor for class org.apache.hadoop.fs.s3a.S3AInputStream
S3AInstrumentation - Class in org.apache.hadoop.fs.s3a: Instrumentation of S3a.
S3AInstrumentation(URI) - Constructor for class org.apache.hadoop.fs.s3a.S3AInstrumentation
S3AInstrumentation.InputStreamStatistics - Class in org.apache.hadoop.fs.s3a: Statistics updated by an input stream during its actual operation.
S3AInstrumentation.OutputStreamStatistics - Class in org.apache.hadoop.fs.s3a: Statistics updated by an output stream during its actual operation.
S3AInstrumentation.OutputStreamStatistics(FileSystem.Statistics) - Constructor for class org.apache.hadoop.fs.s3a.S3AInstrumentation.OutputStreamStatistics
S3AInstrumentation.S3GuardInstrumentation - Class in org.apache.hadoop.fs.s3a: Instrumentation exported to S3Guard.
S3AInstrumentation.S3GuardInstrumentation() - Constructor for class org.apache.hadoop.fs.s3a.S3AInstrumentation.S3GuardInstrumentation
S3AOutputStream - Class in org.apache.hadoop.fs.s3a: Output stream to save data to S3.
S3AOutputStream(Configuration, S3AFileSystem, String, Progressable) - Constructor for class org.apache.hadoop.fs.s3a.S3AOutputStream
S3AStorageStatistics - Class in org.apache.hadoop.fs.s3a: Storage statistics for S3A.
S3AStorageStatistics() - Constructor for class org.apache.hadoop.fs.s3a.S3AStorageStatistics
S3AUtils - Class in org.apache.hadoop.fs.s3a: Utility methods for S3A code.
S3ClientFactory - Interface in org.apache.hadoop.fs.s3a: Factory for creation of AmazonS3 client instances.
S3Credentials - Class in org.apache.hadoop.fs.s3: Deprecated.
S3Credentials() - Constructor for class org.apache.hadoop.fs.s3.S3Credentials: Deprecated.
S3Exception - Exception in org.apache.hadoop.fs.s3: Deprecated.
S3Exception(Throwable) - Constructor for exception org.apache.hadoop.fs.s3.S3Exception: Deprecated.
S3FileSystem - Class in org.apache.hadoop.fs.s3: Deprecated.
Use NativeS3FileSystem and S3AFileSystem instead.
S3FileSystem() - Constructor for class org.apache.hadoop.fs.s3.S3FileSystem: Deprecated.
S3FileSystem(FileSystemStore) - Constructor for class org.apache.hadoop.fs.s3.S3FileSystem: Deprecated.
S3FileSystemConfigKeys - Class in org.apache.hadoop.fs.s3: Deprecated.
S3FileSystemConfigKeys() - Constructor for class org.apache.hadoop.fs.s3.S3FileSystemConfigKeys: Deprecated.
S3FileSystemException - Exception in org.apache.hadoop.fs.s3: Deprecated.
S3FileSystemException(String) - Constructor for exception org.apache.hadoop.fs.s3.S3FileSystemException: Deprecated.
S3Guard - Class in org.apache.hadoop.fs.s3a.s3guard: Logic for integrating MetadataStore with S3A.
S3GUARD_CLI_PRUNE_AGE - Static variable in class org.apache.hadoop.fs.s3a.Constants: Minimum period of time (in milliseconds) to keep metadata (may only be applied when a prune command is manually run).
S3GUARD_DDB_BACKGROUND_SLEEP_MSEC_DEFAULT - Static variable in class org.apache.hadoop.fs.s3a.Constants
S3GUARD_DDB_BACKGROUND_SLEEP_MSEC_KEY - Static variable in class org.apache.hadoop.fs.s3a.Constants: Period of time (in milliseconds) to sleep between batches of writes.
S3GUARD_DDB_BATCH_WRITE_REQUEST_LIMIT - Static variable in class org.apache.hadoop.fs.s3a.Constants: The maximum put or delete requests per BatchWriteItem request.
S3GUARD_DDB_CLIENT_FACTORY_IMPL - Static variable in class org.apache.hadoop.fs.s3a.s3guard.S3Guard
S3GUARD_DDB_MAX_RETRIES - Static variable in class org.apache.hadoop.fs.s3a.Constants
S3GUARD_DDB_MAX_RETRIES_DEFAULT - Static variable in class org.apache.hadoop.fs.s3a.Constants: Max retries on batched DynamoDB operations before giving up and throwing an IOException.
S3GUARD_DDB_REGION_KEY - Static variable in class org.apache.hadoop.fs.s3a.Constants: The region of the DynamoDB service.
S3GUARD_DDB_TABLE_CAPACITY_READ_DEFAULT - Static variable in class org.apache.hadoop.fs.s3a.Constants
S3GUARD_DDB_TABLE_CAPACITY_READ_KEY - Static variable in class org.apache.hadoop.fs.s3a.Constants
S3GUARD_DDB_TABLE_CAPACITY_WRITE_DEFAULT - Static variable in class org.apache.hadoop.fs.s3a.Constants
S3GUARD_DDB_TABLE_CAPACITY_WRITE_KEY - Static variable in class org.apache.hadoop.fs.s3a.Constants
S3GUARD_DDB_TABLE_CREATE_KEY - Static variable in class org.apache.hadoop.fs.s3a.Constants: Whether to create the DynamoDB table if the table does not exist.
S3GUARD_DDB_TABLE_NAME_KEY - Static variable in class org.apache.hadoop.fs.s3a.Constants: The DynamoDB table name to use.
S3GUARD_METASTORE_DYNAMO - Static variable in class org.apache.hadoop.fs.s3a.Constants: Use DynamoDB for the metadata: "org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore".
S3GUARD_METASTORE_LOCAL - Static variable in class org.apache.hadoop.fs.s3a.Constants: Use Local memory for the metadata: "org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore".
S3GUARD_METASTORE_NULL - Static variable in class org.apache.hadoop.fs.s3a.Constants: The default "Null" metadata store: "org.apache.hadoop.fs.s3a.s3guard.NullMetadataStore".
S3GuardTool - Class in org.apache.hadoop.fs.s3a.s3guard: CLI to manage S3Guard Metadata Store.
S3GuardTool(Configuration, String...) - Constructor for class org.apache.hadoop.fs.s3a.s3guard.S3GuardTool: Constructor a S3Guard tool with HDFS configuration.
S3N_FOLDER_SUFFIX - Static variable in class org.apache.hadoop.fs.s3a.Constants
S3NativeFileSystemConfigKeys - Class in org.apache.hadoop.fs.s3native: This class contains constants for configuration keys used in the s3 file system.
S3NativeFileSystemConfigKeys() - Constructor for class org.apache.hadoop.fs.s3native.S3NativeFileSystemConfigKeys
S3xLoginHelper - Class in org.apache.hadoop.fs.s3native: Class to aid logging in to S3 endpoints.
S3xLoginHelper.Login - Class in org.apache.hadoop.fs.s3native: Simple tuple of login details.
S3xLoginHelper.Login() - Constructor for class org.apache.hadoop.fs.s3native.S3xLoginHelper.Login: Create an instance with no login details.
S3xLoginHelper.Login(String, String) - Constructor for class org.apache.hadoop.fs.s3native.S3xLoginHelper.Login
SECONDS_FLAG - Static variable in class org.apache.hadoop.fs.s3a.s3guard.S3GuardTool
SECRET_KEY - Static variable in class org.apache.hadoop.fs.s3a.Constants
SECURE_CONNECTIONS - Static variable in class org.apache.hadoop.fs.s3a.Constants
seek(long) - Method in class org.apache.hadoop.fs.s3a.S3AInputStream
seekBackwards(long) - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation.InputStreamStatistics: Seek backwards, incrementing the seek and backward seek counters.
seekForwards(long) - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation.InputStreamStatistics: Record a forward seek, adding a seek operation, a forward seek operation, and any bytes skipped.
seekOperations - Variable in class org.apache.hadoop.fs.s3a.S3AInstrumentation.InputStreamStatistics
seekToNewSource(long) - Method in class org.apache.hadoop.fs.s3a.S3AInputStream
serialize() - Method in class org.apache.hadoop.fs.s3.INode: Deprecated.
SERVER_SIDE_ENCRYPTION_AES256 - Static variable in class org.apache.hadoop.fs.s3a.Constants: Deprecated.
SERVER_SIDE_ENCRYPTION_ALGORITHM - Static variable in class org.apache.hadoop.fs.s3a.Constants
SERVER_SIDE_ENCRYPTION_KEY - Static variable in class org.apache.hadoop.fs.s3a.Constants: Used to specify which AWS KMS key to use if Constants.SERVER_SIDE_ENCRYPTION_ALGORITHM is SSE-KMS (will default to aws/s3 master key if left blank).
SESSION_TOKEN - Static variable in class org.apache.hadoop.fs.s3a.Constants
setAuthoritative(boolean) - Method in class org.apache.hadoop.fs.s3a.s3guard.DirListingMetadata: Marks this directory listing as full and authoritative.
setBucketOption(Configuration, String, String, String) - Static method in class org.apache.hadoop.fs.s3a.S3AUtils: Set a bucket-specific property to a particular value.
setFilesystem(S3AFileSystem) - Method in class org.apache.hadoop.fs.s3a.s3guard.S3GuardTool
setInputPolicy(S3AInputPolicy) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem: Change the input policy for this FS.
setOptionalCopyObjectRequestParameters(CopyObjectRequest) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem
setOptionalMultipartUploadRequestParameters(InitiateMultipartUploadRequest) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem
setReadahead(Long) - Method in class org.apache.hadoop.fs.s3a.S3AInputStream
setReuseLastProvider(boolean) - Method in class org.apache.hadoop.fs.s3a.AWSCredentialProviderList: Reuse the last provider?
setStore(MetadataStore) - Method in class org.apache.hadoop.fs.s3a.s3guard.S3GuardTool
setupConfig(Configuration) - Method in class org.apache.hadoop.fs.s3a.InconsistentAmazonS3Client
setWorkingDirectory(Path) - Method in class org.apache.hadoop.fs.s3.S3FileSystem: Deprecated.
setWorkingDirectory(Path) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem: Set the current working directory for the given file system.
setWorkingDirectory(Path) - Method in class org.apache.hadoop.fs.s3native.NativeS3FileSystem: Set the working directory to the given directory.
SharedInstanceProfileCredentialsProvider - Class in org.apache.hadoop.fs.s3a: Deprecated.
Please use InstanceProfileCredentialsProvider instead.
SIGNING_ALGORITHM - Static variable in class org.apache.hadoop.fs.s3a.Constants
SimpleAWSCredentialsProvider - Class in org.apache.hadoop.fs.s3a: Support simple credentials for authenticating with AWS.
SimpleAWSCredentialsProvider(Configuration) - Constructor for class org.apache.hadoop.fs.s3a.SimpleAWSCredentialsProvider
SOCKET_RECV_BUFFER - Static variable in class org.apache.hadoop.fs.s3a.Constants
SOCKET_SEND_BUFFER - Static variable in class org.apache.hadoop.fs.s3a.Constants
SOCKET_TIMEOUT - Static variable in class org.apache.hadoop.fs.s3a.Constants
SSE_C_NO_KEY_ERROR - Static variable in class org.apache.hadoop.fs.s3a.S3AUtils: Encryption SSE-C used but the config lacks an encryption key.
SSE_S3_WITH_KEY_ERROR - Static variable in class org.apache.hadoop.fs.s3a.S3AUtils: Encryption SSE-S3 is used but the caller also set an encryption key.
Statistic - Enum in org.apache.hadoop.fs.s3a: Statistic which are collected in S3A.
storeBlock(Block, File) - Method in interface org.apache.hadoop.fs.s3.FileSystemStore: Deprecated.
storeClosed() - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation.S3GuardInstrumentation
storeINode(Path, INode) - Method in interface org.apache.hadoop.fs.s3.FileSystemStore: Deprecated.
storeNotFound(FileNotFoundException) - Static method in class org.apache.hadoop.fs.s3a.s3guard.S3GuardTool: Handle store not found by converting to an exit exception with specific error code.
streamClose(boolean, long) - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation.InputStreamStatistics: The inner stream was closed.
streamCounter(String, String) - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation: Create a counter in the stream map: these are unregistered in the public metrics.
streamCounter(Statistic) - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation: Create a counter in the stream map: these are unregistered in the public metrics.
streamOpened() - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation.InputStreamStatistics: The inner stream was opened.
stringify(AmazonServiceException) - Static method in class org.apache.hadoop.fs.s3a.S3AUtils: Get low level details of an amazon exception for logging; multi-line.
stringify(AmazonS3Exception) - Static method in class org.apache.hadoop.fs.s3a.S3AUtils: Get low level details of an amazon exception for logging; multi-line.
stringify(S3ObjectSummary) - Static method in class org.apache.hadoop.fs.s3a.S3AUtils: String information about a summary entry for debug messages.

T

TemporaryAWSCredentialsProvider - Class in org.apache.hadoop.fs.s3a: Support session credentials for authenticating with AWS.
TemporaryAWSCredentialsProvider(Configuration) - Constructor for class org.apache.hadoop.fs.s3a.TemporaryAWSCredentialsProvider
tombstone(Path) - Static method in class org.apache.hadoop.fs.s3a.s3guard.PathMetadata: Create a tombstone from the current time.
toString() - Method in class org.apache.hadoop.fs.s3.Block: Deprecated.
toString() - Method in class org.apache.hadoop.fs.s3a.AnonymousAWSCredentialsProvider
toString() - Method in class org.apache.hadoop.fs.s3a.AWSCredentialProviderList: The string value is this class name and the string values of nested providers.
toString() - Method in class org.apache.hadoop.fs.s3a.BasicAWSCredentialsProvider
toString() - Method in class org.apache.hadoop.fs.s3a.S3AFileStatus
toString() - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem
toString() - Method in enum org.apache.hadoop.fs.s3a.S3AInputPolicy
toString() - Method in class org.apache.hadoop.fs.s3a.S3AInputStream: String value includes statistics as well as stream state.
toString() - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation.InputStreamStatistics: String operator describes all the current statistics.
toString() - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation.OutputStreamStatistics
toString() - Method in class org.apache.hadoop.fs.s3a.s3guard.DirListingMetadata
toString() - Method in class org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore
toString() - Method in class org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore
toString() - Method in class org.apache.hadoop.fs.s3a.s3guard.NullMetadataStore
toString() - Method in class org.apache.hadoop.fs.s3a.s3guard.PathMetadata
toString() - Method in class org.apache.hadoop.fs.s3a.SimpleAWSCredentialsProvider
toString() - Method in enum org.apache.hadoop.fs.s3a.Statistic: The string value is simply the symbol.
toString() - Method in class org.apache.hadoop.fs.s3a.TemporaryAWSCredentialsProvider
toString(URI) - Static method in class org.apache.hadoop.fs.s3native.S3xLoginHelper: Create a stripped down string value for error messages.
toUri(String) - Static method in class org.apache.hadoop.fs.s3a.s3guard.S3GuardTool: Convert a path to a URI, catching any URISyntaxException and converting to an invalid args exception.
translateException(String, Path, AmazonClientException) - Static method in class org.apache.hadoop.fs.s3a.S3AUtils: Translate an exception raised in an operation into an IOException.
translateException(String, String, AmazonClientException) - Static method in class org.apache.hadoop.fs.s3a.S3AUtils: Translate an exception raised in an operation into an IOException.
Tristate - Enum in org.apache.hadoop.fs.s3a: Simple enum to express {true, false, don't know}.

U

updateParameters(Map<String, String>) - Method in class org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore
updateParameters(Map<String, String>) - Method in class org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore
updateParameters(Map<String, String>) - Method in interface org.apache.hadoop.fs.s3a.s3guard.MetadataStore: Tune/update parameters for an existing table.
updateParameters(Map<String, String>) - Method in class org.apache.hadoop.fs.s3a.s3guard.NullMetadataStore
uploadCompleted() - Method in class org.apache.hadoop.fs.s3a.ProgressableProgressListener: Method to invoke after upload has completed.
UploadInfo - Class in org.apache.hadoop.fs.s3a: Simple struct that contains information about a S3 upload.
UploadInfo(Upload, long) - Constructor for class org.apache.hadoop.fs.s3a.UploadInfo
uploadPart(UploadPartRequest) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem: Upload part of a multi-partition file.
USER_AGENT_PREFIX - Static variable in class org.apache.hadoop.fs.s3a.Constants

V

valueOf(String) - Static method in enum org.apache.hadoop.fs.s3a.S3AEncryptionMethods: Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum org.apache.hadoop.fs.s3a.S3AInputPolicy: Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum org.apache.hadoop.fs.s3a.Statistic: Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum org.apache.hadoop.fs.s3a.Tristate: Returns the enum constant of this type with the specified name.
values() - Static method in enum org.apache.hadoop.fs.s3a.S3AEncryptionMethods: Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum org.apache.hadoop.fs.s3a.S3AInputPolicy: Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum org.apache.hadoop.fs.s3a.Statistic: Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum org.apache.hadoop.fs.s3a.Tristate: Returns an array containing the constants of this enum type, in the order they are declared.
verifyBucketExists() - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem: Verify that the bucket exists.
VERSION - Static variable in class org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore: Current version number.
VERSION_MARKER - Static variable in class org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore: parent/child name to use in the version marker.
VersionMismatchException - Exception in org.apache.hadoop.fs.s3: Deprecated.
VersionMismatchException(String, String) - Constructor for exception org.apache.hadoop.fs.s3.VersionMismatchException: Deprecated.

W

withExitCode(boolean) - Method in exception org.apache.hadoop.fs.s3a.RenameFailedException: Set the exit code.
withoutTombstones() - Method in class org.apache.hadoop.fs.s3a.s3guard.DirListingMetadata
write(int) - Method in class org.apache.hadoop.fs.s3a.S3AOutputStream
write(byte[], int, int) - Method in class org.apache.hadoop.fs.s3a.S3AOutputStream
WRITE_FLAG - Static variable in class org.apache.hadoop.fs.s3a.s3guard.S3GuardTool

A B C D E F G H I K L M N O P Q R S T U V W