Skip navigation links
A B C D E F G H I K L M N O P R S T U V W 

A

aborted - Variable in class org.apache.hadoop.fs.s3a.S3AInstrumentation.InputStreamStatistics
 
ACCESS_KEY - Static variable in class org.apache.hadoop.fs.s3a.Constants
 
add(AWSCredentialsProvider) - Method in class org.apache.hadoop.fs.s3a.AWSCredentialProviderList
Add a new provider.
AnonymousAWSCredentialsProvider - Class in org.apache.hadoop.fs.s3a
AnonymousAWSCredentialsProvider supports anonymous access to AWS services through the AWS SDK.
AnonymousAWSCredentialsProvider() - Constructor for class org.apache.hadoop.fs.s3a.AnonymousAWSCredentialsProvider
 
append(Path, int, Progressable) - Method in class org.apache.hadoop.fs.s3.S3FileSystem
Deprecated.
This optional operation is not yet supported.
append(Path, int, Progressable) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem
Append to an existing file (optional operation).
append(Path, int, Progressable) - Method in class org.apache.hadoop.fs.s3native.NativeS3FileSystem
This optional operation is not yet supported.
available() - Method in class org.apache.hadoop.fs.s3a.S3AInputStream
 
AWS_CREDENTIALS_PROVIDER - Static variable in class org.apache.hadoop.fs.s3a.Constants
 
AWSClientIOException - Exception in org.apache.hadoop.fs.s3a
IOException equivalent of an AmazonClientException.
AWSClientIOException(String, AmazonClientException) - Constructor for exception org.apache.hadoop.fs.s3a.AWSClientIOException
 
AWSCredentialProviderList - Class in org.apache.hadoop.fs.s3a
A list of providers.
AWSCredentialProviderList() - Constructor for class org.apache.hadoop.fs.s3a.AWSCredentialProviderList
Empty instance.
AWSCredentialProviderList(Collection<AWSCredentialsProvider>) - Constructor for class org.apache.hadoop.fs.s3a.AWSCredentialProviderList
Create with an initial list of providers.
AWSS3IOException - Exception in org.apache.hadoop.fs.s3a
Wrap a AmazonS3Exception as an IOE, relaying all getters.
AWSS3IOException(String, AmazonS3Exception) - Constructor for exception org.apache.hadoop.fs.s3a.AWSS3IOException
Instantiate.
AWSServiceIOException - Exception in org.apache.hadoop.fs.s3a
A specific exception from AWS operations.
AWSServiceIOException(String, AmazonServiceException) - Constructor for exception org.apache.hadoop.fs.s3a.AWSServiceIOException
Instantiate.

B

backwardSeekOperations - Variable in class org.apache.hadoop.fs.s3a.S3AInstrumentation.InputStreamStatistics
 
BasicAWSCredentialsProvider - Class in org.apache.hadoop.fs.s3a
BasicAWSCredentialsProvider supports static configuration of access key ID and secret access key for use with the AWS SDK.
BasicAWSCredentialsProvider(String, String) - Constructor for class org.apache.hadoop.fs.s3a.BasicAWSCredentialsProvider
 
Block - Class in org.apache.hadoop.fs.s3
Deprecated.
Block(long, long) - Constructor for class org.apache.hadoop.fs.s3.Block
Deprecated.
 
blockExists(long) - Method in interface org.apache.hadoop.fs.s3.FileSystemStore
Deprecated.
 
blocksActivelyAllocated() - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation.OutputStreamStatistics
Get counters of blocks actively allocated; my be inaccurate if the numbers change during the (non-synchronized) calculation.
blocksAllocated() - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation.OutputStreamStatistics
 
blocksReleased() - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation.OutputStreamStatistics
 
BUFFER_DIR - Static variable in class org.apache.hadoop.fs.s3a.Constants
 
buildFSURI(URI) - Static method in class org.apache.hadoop.fs.s3native.S3xLoginHelper
Build the filesystem URI.
bytesBackwardsOnSeek - Variable in class org.apache.hadoop.fs.s3a.S3AInstrumentation.InputStreamStatistics
 
bytesDiscardedInAbort - Variable in class org.apache.hadoop.fs.s3a.S3AInstrumentation.InputStreamStatistics
 
bytesRead - Variable in class org.apache.hadoop.fs.s3a.S3AInstrumentation.InputStreamStatistics
 
bytesRead(long) - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation.InputStreamStatistics
Increment the bytes read counter by the number of bytes; no-op if the argument is negative.
bytesReadInClose - Variable in class org.apache.hadoop.fs.s3a.S3AInstrumentation.InputStreamStatistics
 
bytesSkippedOnSeek - Variable in class org.apache.hadoop.fs.s3a.S3AInstrumentation.InputStreamStatistics
 

C

CANNED_ACL - Static variable in class org.apache.hadoop.fs.s3a.Constants
 
canonicalizeUri(URI) - Method in class org.apache.hadoop.fs.s3.S3FileSystem
Deprecated.
 
canonicalizeUri(URI) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem
 
canonicalizeUri(URI) - Method in class org.apache.hadoop.fs.s3native.NativeS3FileSystem
 
canonicalizeUri(URI, int) - Static method in class org.apache.hadoop.fs.s3native.S3xLoginHelper
Canonicalize the given URI.
checkNotEmpty() - Method in class org.apache.hadoop.fs.s3a.AWSCredentialProviderList
Verify that the provider list is not empty.
checkPath(Path) - Method in class org.apache.hadoop.fs.s3.S3FileSystem
Deprecated.
Check that a Path belongs to this FileSystem.
checkPath(Path) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem
Check that a Path belongs to this FileSystem.
checkPath(Path) - Method in class org.apache.hadoop.fs.s3native.NativeS3FileSystem
Check that a Path belongs to this FileSystem.
checkPath(Configuration, URI, Path, int) - Static method in class org.apache.hadoop.fs.s3native.S3xLoginHelper
Check the path, ignoring authentication details.
close() - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem
Close the filesystem.
close() - Method in class org.apache.hadoop.fs.s3a.S3AInputStream
Close the stream.
close() - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation.InputStreamStatistics
Close triggers the merge of statistics into the filesystem's instrumentation instance.
close() - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation.OutputStreamStatistics
Output stream has closed.
close() - Method in class org.apache.hadoop.fs.s3a.S3AOutputStream
 
closeAll(Logger, Closeable...) - Static method in class org.apache.hadoop.fs.s3a.S3AUtils
Close the Closeable objects and ignore any Exception or null pointers.
closed - Variable in class org.apache.hadoop.fs.s3a.S3AInstrumentation.InputStreamStatistics
 
closeOperations - Variable in class org.apache.hadoop.fs.s3a.S3AInstrumentation.InputStreamStatistics
 
Constants - Class in org.apache.hadoop.fs.s3a
All the constants used with the S3AFileSystem.
CONTEXT - Static variable in class org.apache.hadoop.fs.s3a.S3AInstrumentation
 
continueListObjects(ObjectListing) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem
List the next set of objects.
copyFromLocalFile(boolean, boolean, Path, Path) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem
The src file is on the local disk.
CORE_THREADS - Static variable in class org.apache.hadoop.fs.s3a.Constants
Deprecated.
counter(String, String) - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation
Create a counter in the registry.
counter(Statistic) - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation
Create a counter in the registry.
create(Path, FsPermission, boolean, int, short, long, Progressable) - Method in class org.apache.hadoop.fs.s3.S3FileSystem
Deprecated.
 
create(Path, FsPermission, boolean, int, short, long, Progressable) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem
Create an FSDataOutputStream at the indicated Path with write-progress reporting.
create(Path, FsPermission, boolean, int, short, long, Progressable) - Method in class org.apache.hadoop.fs.s3native.NativeS3FileSystem
 
createAWSCredentialProviderSet(URI, Configuration, URI) - Static method in class org.apache.hadoop.fs.s3a.S3AUtils
Create the AWS credentials from the providers and the URI.
createFileStatus(Path, S3ObjectSummary, long, String) - Static method in class org.apache.hadoop.fs.s3a.S3AUtils
Create a files status instance from a listing.
createNonRecursive(Path, FsPermission, EnumSet<CreateFlag>, int, short, long, Progressable) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem
CredentialInitializationException - Exception in org.apache.hadoop.fs.s3a
Exception which Hadoop's AWSCredentialsProvider implementations should throw when there is a problem with the credential setup.
CredentialInitializationException(String, Throwable) - Constructor for exception org.apache.hadoop.fs.s3a.CredentialInitializationException
 
CredentialInitializationException(String) - Constructor for exception org.apache.hadoop.fs.s3a.CredentialInitializationException
 

D

dateToLong(Date) - Static method in class org.apache.hadoop.fs.s3a.S3AUtils
Date to long conversion.
decrementGauge(Statistic, long) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem
Decrement a gauge by a specific value.
decrementGauge(Statistic, long) - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation
Decrement a specific gauge.
DEFAULT_BLOCKSIZE - Static variable in class org.apache.hadoop.fs.s3a.S3AFileSystem
Default blocksize as used in blocksize and FS status queries.
DEFAULT_CANNED_ACL - Static variable in class org.apache.hadoop.fs.s3a.Constants
 
DEFAULT_ESTABLISH_TIMEOUT - Static variable in class org.apache.hadoop.fs.s3a.Constants
 
DEFAULT_FAST_BUFFER_SIZE - Static variable in class org.apache.hadoop.fs.s3a.Constants
 
DEFAULT_FAST_UPLOAD - Static variable in class org.apache.hadoop.fs.s3a.Constants
 
DEFAULT_FAST_UPLOAD_ACTIVE_BLOCKS - Static variable in class org.apache.hadoop.fs.s3a.Constants
Limit of queued block upload operations before writes block.
DEFAULT_FAST_UPLOAD_BUFFER - Static variable in class org.apache.hadoop.fs.s3a.Constants
Default buffer option: "disk".
DEFAULT_KEEPALIVE_TIME - Static variable in class org.apache.hadoop.fs.s3a.Constants
 
DEFAULT_MAX_ERROR_RETRIES - Static variable in class org.apache.hadoop.fs.s3a.Constants
 
DEFAULT_MAX_PAGING_KEYS - Static variable in class org.apache.hadoop.fs.s3a.Constants
 
DEFAULT_MAX_THREADS - Static variable in class org.apache.hadoop.fs.s3a.Constants
 
DEFAULT_MAX_TOTAL_TASKS - Static variable in class org.apache.hadoop.fs.s3a.Constants
 
DEFAULT_MAXIMUM_CONNECTIONS - Static variable in class org.apache.hadoop.fs.s3a.Constants
 
DEFAULT_MIN_MULTIPART_THRESHOLD - Static variable in class org.apache.hadoop.fs.s3a.Constants
 
DEFAULT_MULTIPART_SIZE - Static variable in class org.apache.hadoop.fs.s3a.Constants
 
DEFAULT_PURGE_EXISTING_MULTIPART - Static variable in class org.apache.hadoop.fs.s3a.Constants
 
DEFAULT_PURGE_EXISTING_MULTIPART_AGE - Static variable in class org.apache.hadoop.fs.s3a.Constants
 
DEFAULT_READAHEAD_RANGE - Static variable in class org.apache.hadoop.fs.s3a.Constants
 
DEFAULT_S3_CLIENT_FACTORY_IMPL - Static variable in class org.apache.hadoop.fs.s3a.Constants
 
DEFAULT_SECURE_CONNECTIONS - Static variable in class org.apache.hadoop.fs.s3a.Constants
 
DEFAULT_SOCKET_RECV_BUFFER - Static variable in class org.apache.hadoop.fs.s3a.Constants
 
DEFAULT_SOCKET_SEND_BUFFER - Static variable in class org.apache.hadoop.fs.s3a.Constants
 
DEFAULT_SOCKET_TIMEOUT - Static variable in class org.apache.hadoop.fs.s3a.Constants
 
delete(Path, boolean) - Method in class org.apache.hadoop.fs.s3.S3FileSystem
Deprecated.
 
delete(Path, boolean) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem
Delete a Path.
delete(Path, boolean) - Method in class org.apache.hadoop.fs.s3native.NativeS3FileSystem
 
deleteBlock(Block) - Method in interface org.apache.hadoop.fs.s3.FileSystemStore
Deprecated.
 
deleteINode(Path) - Method in interface org.apache.hadoop.fs.s3.FileSystemStore
Deprecated.
 
deserialize(InputStream) - Static method in class org.apache.hadoop.fs.s3.INode
Deprecated.
 
DIRECTORY_INODE - Static variable in class org.apache.hadoop.fs.s3.INode
Deprecated.
 
directoryCreated() - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation
Indicate that S3A created a directory.
directoryDeleted() - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation
Indicate that S3A just deleted a directory.
dump() - Method in interface org.apache.hadoop.fs.s3.FileSystemStore
Deprecated.
Diagnostic method to dump all INodes to the console.
dump(String, String, String, boolean) - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation
Dump all the metrics to a string.

E

EMPTY - Static variable in class org.apache.hadoop.fs.s3native.S3xLoginHelper.Login
 
ENABLE_MULTI_DELETE - Static variable in class org.apache.hadoop.fs.s3a.Constants
 
ENDPOINT - Static variable in class org.apache.hadoop.fs.s3a.Constants
 
ensureOutputParameterInRange(String, long) - Static method in class org.apache.hadoop.fs.s3a.S3AUtils
Ensure that the long value is in the range of an integer.
equals(Object) - Method in class org.apache.hadoop.fs.s3a.S3AFileStatus
Compare if this object is equal to another object.
equals(Object) - Method in class org.apache.hadoop.fs.s3native.S3xLoginHelper.Login
Equality test matches user and password.
errorIgnored() - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation
Note that an error was ignored.
ESTABLISH_TIMEOUT - Static variable in class org.apache.hadoop.fs.s3a.Constants
 
exists(Path) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem
Override superclass so as to add statistic collection.
extractException(String, String, ExecutionException) - Static method in class org.apache.hadoop.fs.s3a.S3AUtils
Extract an exception from a failed future, and convert to an IOE.
extractLoginDetails(URI) - Static method in class org.apache.hadoop.fs.s3native.S3xLoginHelper
Extract the login details from a URI.
extractLoginDetailsWithWarnings(URI) - Static method in class org.apache.hadoop.fs.s3native.S3xLoginHelper
Extract the login details from a URI, logging a warning if the URI contains these.

F

fakeDirsDeleted(int) - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation
Indicate that fake directory request was made.
FAST_BUFFER_SIZE - Static variable in class org.apache.hadoop.fs.s3a.Constants
Deprecated.
FAST_UPLOAD - Static variable in class org.apache.hadoop.fs.s3a.Constants
 
FAST_UPLOAD_ACTIVE_BLOCKS - Static variable in class org.apache.hadoop.fs.s3a.Constants
Maximum Number of blocks a single output stream can have active (uploading, or queued to the central FileSystem instance's pool of queued operations.
FAST_UPLOAD_BUFFER - Static variable in class org.apache.hadoop.fs.s3a.Constants
What buffer to use.
FAST_UPLOAD_BUFFER_ARRAY - Static variable in class org.apache.hadoop.fs.s3a.Constants
Use an in-memory array.
FAST_UPLOAD_BUFFER_DISK - Static variable in class org.apache.hadoop.fs.s3a.Constants
Buffer blocks to disk: "disk".
FAST_UPLOAD_BYTEBUFFER - Static variable in class org.apache.hadoop.fs.s3a.Constants
Use a byte buffer.
FILE_TYPES - Static variable in class org.apache.hadoop.fs.s3.INode
Deprecated.
 
fileCreated() - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation
Indicate that S3A created a file.
fileDeleted(int) - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation
Indicate that S3A deleted one or more file.s
filesCopied(int, long) - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation
Indicate that S3A copied some files within the store.
FileSystemStore - Interface in org.apache.hadoop.fs.s3
Deprecated.
finishedWrite(String) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem
Perform post-write actions.
flush() - Method in class org.apache.hadoop.fs.s3a.S3AOutputStream
 
forwardSeekOperations - Variable in class org.apache.hadoop.fs.s3a.S3AInstrumentation.InputStreamStatistics
 
fromSymbol(String) - Static method in enum org.apache.hadoop.fs.s3a.Statistic
Get a statistic from a symbol.
FS_S3A - Static variable in class org.apache.hadoop.fs.s3a.Constants
 
FS_S3A_BLOCK_SIZE - Static variable in class org.apache.hadoop.fs.s3a.Constants
 
FS_S3A_BUCKET_PREFIX - Static variable in class org.apache.hadoop.fs.s3a.Constants
Prefix for S3A bucket-specific properties: "fs.s3a.bucket.".
FS_S3A_PREFIX - Static variable in class org.apache.hadoop.fs.s3a.Constants
Prefix for all S3A properties: "fs.s3a.".

G

gauge(String, String) - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation
Create a gauge in the registry.
getAccessKey() - Method in class org.apache.hadoop.fs.s3.S3Credentials
Deprecated.
 
getAdditionalDetails() - Method in exception org.apache.hadoop.fs.s3a.AWSS3IOException
 
getAWSAccessKeys(URI, Configuration) - Static method in class org.apache.hadoop.fs.s3a.S3AUtils
Return the access key and secret for S3 API use.
getBlocks() - Method in class org.apache.hadoop.fs.s3.INode
Deprecated.
 
getBucket() - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem
Get the bucket of this filesystem.
getBytesPendingUpload() - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation.OutputStreamStatistics
Get the number of bytes pending upload.
getCanonicalServiceName() - Method in class org.apache.hadoop.fs.s3.S3FileSystem
Deprecated.
 
getCanonicalServiceName() - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem
Override getCanonicalServiceName because we don't support token in S3A.
getCanonicalServiceName() - Method in class org.apache.hadoop.fs.s3native.NativeS3FileSystem
 
getCause() - Method in exception org.apache.hadoop.fs.s3a.AWSClientIOException
 
getCause() - Method in exception org.apache.hadoop.fs.s3a.AWSS3IOException
 
getCause() - Method in exception org.apache.hadoop.fs.s3a.AWSServiceIOException
 
getContentRangeFinish() - Method in class org.apache.hadoop.fs.s3a.S3AInputStream
 
getContentRangeStart() - Method in class org.apache.hadoop.fs.s3a.S3AInputStream
 
getCounterValue(Statistic) - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation
Get the value of a counter.
getCounterValue(String) - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation
Get the value of a counter.
getCredentials() - Method in class org.apache.hadoop.fs.s3a.AnonymousAWSCredentialsProvider
 
getCredentials() - Method in class org.apache.hadoop.fs.s3a.AWSCredentialProviderList
Iterate through the list of providers, to find one with credentials.
getCredentials() - Method in class org.apache.hadoop.fs.s3a.BasicAWSCredentialsProvider
 
getCredentials() - Method in class org.apache.hadoop.fs.s3a.SimpleAWSCredentialsProvider
 
getCredentials() - Method in class org.apache.hadoop.fs.s3a.TemporaryAWSCredentialsProvider
 
getDefaultBlockSize() - Method in class org.apache.hadoop.fs.s3.S3FileSystem
Deprecated.
 
getDefaultBlockSize() - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem
Deprecated.
use FileSystem.getDefaultBlockSize(Path) instead
getDefaultBlockSize() - Method in class org.apache.hadoop.fs.s3native.NativeS3FileSystem
 
getDefaultPort() - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem
 
getDescription() - Method in enum org.apache.hadoop.fs.s3a.Statistic
 
getErrorCode() - Method in exception org.apache.hadoop.fs.s3a.AWSServiceIOException
 
getErrorResponseXml() - Method in exception org.apache.hadoop.fs.s3a.AWSS3IOException
 
getExitCode() - Method in exception org.apache.hadoop.fs.s3a.RenameFailedException
 
getExtendedRequestId() - Method in exception org.apache.hadoop.fs.s3a.AWSS3IOException
 
getFileStatus(Path) - Method in class org.apache.hadoop.fs.s3.S3FileSystem
Deprecated.
FileStatus for S3 file systems.
getFileStatus(Path) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem
Return a file status object that represents the path.
getFileStatus(Path) - Method in class org.apache.hadoop.fs.s3native.NativeS3FileSystem
 
getFileType() - Method in class org.apache.hadoop.fs.s3.INode
Deprecated.
 
getId() - Method in class org.apache.hadoop.fs.s3.Block
Deprecated.
 
getInputPolicy() - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem
Get the input policy for this FS instance.
getInstance() - Static method in class org.apache.hadoop.fs.s3a.SharedInstanceProfileCredentialsProvider
Returns the singleton instance.
getInstrumentation() - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem
Get S3A Instrumentation.
getLength() - Method in class org.apache.hadoop.fs.s3.Block
Deprecated.
 
getLong(String) - Method in class org.apache.hadoop.fs.s3a.S3AStorageStatistics
 
getLongStatistics() - Method in class org.apache.hadoop.fs.s3a.S3AStorageStatistics
 
getMessage() - Method in exception org.apache.hadoop.fs.s3a.AWSClientIOException
 
getModificationTime() - Method in class org.apache.hadoop.fs.s3a.S3AFileStatus
Get the modification time of the file/directory.
getMultipartSizeProperty(Configuration, String, long) - Static method in class org.apache.hadoop.fs.s3a.S3AUtils
Get a size property from the configuration: this property must be at least equal to Constants.MULTIPART_MIN_SIZE.
getMultiPartThreshold() - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem
Get the threshold for multipart files.
getObjectMetadata(Path) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem
Low-level call to get at the object metadata.
getObjectMetadata(String) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem
Request object metadata; increments counters in the process.
getPartitionSize() - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem
Get the partition size for multipart operations.
getPassword() - Method in class org.apache.hadoop.fs.s3native.S3xLoginHelper.Login
 
getPolicy(String) - Static method in enum org.apache.hadoop.fs.s3a.S3AInputPolicy
Choose an FS access policy.
getPos() - Method in class org.apache.hadoop.fs.s3a.S3AInputStream
 
getRawResponseContent() - Method in exception org.apache.hadoop.fs.s3a.AWSServiceIOException
 
getReadahead() - Method in class org.apache.hadoop.fs.s3a.S3AInputStream
Get the current readahead value.
getRegistry() - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation
Get the metrics registry.
getRequestId() - Method in exception org.apache.hadoop.fs.s3a.AWSServiceIOException
 
getS3AStreamStatistics() - Method in class org.apache.hadoop.fs.s3a.S3AInputStream
Access the input stream statistics.
getScheme() - Method in class org.apache.hadoop.fs.s3.S3FileSystem
Deprecated.
Return the protocol scheme for the FileSystem.
getScheme() - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem
Return the protocol scheme for the FileSystem.
getScheme() - Method in class org.apache.hadoop.fs.s3a.S3AStorageStatistics
 
getScheme() - Method in class org.apache.hadoop.fs.s3native.NativeS3FileSystem
Return the protocol scheme for the FileSystem.
getSecretAccessKey() - Method in class org.apache.hadoop.fs.s3.S3Credentials
Deprecated.
 
getSerializedLength() - Method in class org.apache.hadoop.fs.s3.INode
Deprecated.
 
getServiceName() - Method in exception org.apache.hadoop.fs.s3a.AWSServiceIOException
 
getStatusCode() - Method in exception org.apache.hadoop.fs.s3a.AWSServiceIOException
 
getStorageStatistics() - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem
Get the storage statistics of this filesystem.
getSymbol() - Method in enum org.apache.hadoop.fs.s3a.Statistic
 
getUri() - Method in class org.apache.hadoop.fs.s3.S3FileSystem
Deprecated.
 
getUri() - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem
Returns a URI whose scheme and authority identify this FileSystem.
getUri() - Method in class org.apache.hadoop.fs.s3native.NativeS3FileSystem
 
getUriDefaultPort() - Method in class org.apache.hadoop.fs.s3a.S3A
 
getUser() - Method in class org.apache.hadoop.fs.s3native.S3xLoginHelper.Login
 
getUsername() - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem
Get the username of the FS.
getVersion() - Method in interface org.apache.hadoop.fs.s3.FileSystemStore
Deprecated.
 
getWorkingDirectory() - Method in class org.apache.hadoop.fs.s3.S3FileSystem
Deprecated.
 
getWorkingDirectory() - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem
Get the current working directory for the given file system.
getWorkingDirectory() - Method in class org.apache.hadoop.fs.s3native.NativeS3FileSystem
 
globStatus(Path) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem
Increments the statistic Statistic.INVOCATION_GLOB_STATUS.
globStatus(Path, PathFilter) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem
Override superclass so as to add statistic collection.

H

hashCode() - Method in class org.apache.hadoop.fs.s3a.S3AFileStatus
Returns a hash code value for the object, which is defined as the hash code of the path name.
hashCode() - Method in class org.apache.hadoop.fs.s3native.S3xLoginHelper.Login
 
hasLogin() - Method in class org.apache.hadoop.fs.s3native.S3xLoginHelper.Login
Predicate to verify login details are defined.

I

incrementCounter(Statistic, long) - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation
Increment a specific counter.
incrementCounter(Statistic, AtomicLong) - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation
Increment a specific counter.
incrementCounter(Statistic, long) - Method in class org.apache.hadoop.fs.s3a.S3AStorageStatistics
Increment a specific counter.
incrementGauge(Statistic, long) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem
Increment a gauge by a specific value.
incrementGauge(Statistic, long) - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation
Increment a specific gauge.
incrementPutCompletedStatistics(boolean, long) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem
At the end of a put/multipart upload operation, update the relevant counters and gauges.
incrementPutProgressStatistics(String, long) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem
Callback for use in progress callbacks from put/multipart upload events.
incrementPutStartStatistics(long) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem
At the start of a put/multipart upload operation, update the relevant counters.
incrementReadOperations() - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem
Increment read operations.
incrementStatistic(Statistic) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem
Increment a statistic by 1.
incrementStatistic(Statistic, long) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem
Increment a statistic by a specific value.
incrementWriteOperations() - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem
Increment the write operation counter.
initialize(URI, Configuration) - Method in interface org.apache.hadoop.fs.s3.FileSystemStore
Deprecated.
 
initialize(URI) - Method in class org.apache.hadoop.fs.s3.MigrationTool
Deprecated.
 
initialize(URI, Configuration) - Method in class org.apache.hadoop.fs.s3.S3Credentials
Deprecated.
 
initialize(URI, Configuration) - Method in class org.apache.hadoop.fs.s3.S3FileSystem
Deprecated.
 
initialize(URI, Configuration) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem
Called after a new FileSystem instance is constructed.
initialize(URI, Configuration) - Method in class org.apache.hadoop.fs.s3native.NativeS3FileSystem
 
innerListStatus(Path) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem
List the statuses of the files/directories in the given path if the path is a directory.
INode - Class in org.apache.hadoop.fs.s3
Deprecated.
INode(INode.FileType, Block[]) - Constructor for class org.apache.hadoop.fs.s3.INode
Deprecated.
 
inodeExists(Path) - Method in interface org.apache.hadoop.fs.s3.FileSystemStore
Deprecated.
 
INPUT_FADV_NORMAL - Static variable in class org.apache.hadoop.fs.s3a.Constants
General input.
INPUT_FADV_RANDOM - Static variable in class org.apache.hadoop.fs.s3a.Constants
Optimized purely for random seek+read/positionedRead operations; The performance of sequential IO may be reduced in exchange for more efficient seek() operations.
INPUT_FADV_SEQUENTIAL - Static variable in class org.apache.hadoop.fs.s3a.Constants
Optimized for sequential access.
INPUT_FADVISE - Static variable in class org.apache.hadoop.fs.s3a.Constants
Which input strategy to use for buffering, seeking and similar when reading data.
isDirectory() - Method in class org.apache.hadoop.fs.s3.INode
Deprecated.
 
isDirectory(Path) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem
Override superclass so as to add statistic collection.
isEmptyDirectory() - Method in class org.apache.hadoop.fs.s3a.S3AFileStatus
 
isFile() - Method in class org.apache.hadoop.fs.s3.INode
Deprecated.
 
isFile(Path) - Method in class org.apache.hadoop.fs.s3.S3FileSystem
Deprecated.
 
isFile(Path) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem
Override superclass so as to add statistic collection.
isRetryable() - Method in exception org.apache.hadoop.fs.s3a.AWSServiceIOException
 
isRetryable() - Method in exception org.apache.hadoop.fs.s3a.CredentialInitializationException
This exception is not going to go away if you try calling it again.
isReuseLastProvider() - Method in class org.apache.hadoop.fs.s3a.AWSCredentialProviderList
isTracked(String) - Method in class org.apache.hadoop.fs.s3a.S3AStorageStatistics
 

K

KEEPALIVE_TIME - Static variable in class org.apache.hadoop.fs.s3a.Constants
 

L

listDeepSubPaths(Path) - Method in interface org.apache.hadoop.fs.s3.FileSystemStore
Deprecated.
 
listFiles(Path, boolean) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem
.
Listing - Class in org.apache.hadoop.fs.s3a
Place for the S3A listing classes; keeps all the small classes under control.
Listing(S3AFileSystem) - Constructor for class org.apache.hadoop.fs.s3a.Listing
 
listLocatedStatus(Path) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem
Override superclass so as to add statistic collection.
listLocatedStatus(Path, PathFilter) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem
.
listObjects(ListObjectsRequest) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem
Initiate a listObjects operation, incrementing metrics in the process.
listProviderNames() - Method in class org.apache.hadoop.fs.s3a.AWSCredentialProviderList
List all the providers' names.
listStatus(Path) - Method in class org.apache.hadoop.fs.s3.S3FileSystem
Deprecated.
 
listStatus(Path) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem
List the statuses of the files/directories in the given path if the path is a directory.
listStatus(Path) - Method in class org.apache.hadoop.fs.s3native.NativeS3FileSystem
If f is a file, this method will make a single call to S3.
listSubPaths(Path) - Method in interface org.apache.hadoop.fs.s3.FileSystemStore
Deprecated.
 
LOG - Static variable in class org.apache.hadoop.fs.s3a.S3AFileSystem
 
LOG - Static variable in class org.apache.hadoop.fs.s3a.S3AInputStream
 
LOG - Static variable in class org.apache.hadoop.fs.s3a.S3AOutputStream
 
LOG - Static variable in class org.apache.hadoop.fs.s3native.NativeS3FileSystem
 
Login() - Constructor for class org.apache.hadoop.fs.s3native.S3xLoginHelper.Login
Create an instance with no login details.
Login(String, String) - Constructor for class org.apache.hadoop.fs.s3native.S3xLoginHelper.Login
 
LOGIN_WARNING - Static variable in class org.apache.hadoop.fs.s3native.S3xLoginHelper
 
lookupGauge(String) - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation
Look up a gauge.
lookupMetric(String) - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation
Look up a metric from both the registered set and the lighter weight stream entries.

M

main(String[]) - Static method in class org.apache.hadoop.fs.s3.MigrationTool
Deprecated.
 
markSupported() - Method in class org.apache.hadoop.fs.s3a.S3AInputStream
 
MAX_ERROR_RETRIES - Static variable in class org.apache.hadoop.fs.s3a.Constants
 
MAX_MULTIPART_COUNT - Static variable in class org.apache.hadoop.fs.s3a.Constants
Maximum number of partitions in a multipart upload: 10000.
MAX_PAGING_KEYS - Static variable in class org.apache.hadoop.fs.s3a.Constants
 
MAX_THREADS - Static variable in class org.apache.hadoop.fs.s3a.Constants
 
MAX_TOTAL_TASKS - Static variable in class org.apache.hadoop.fs.s3a.Constants
 
MAXIMUM_CONNECTIONS - Static variable in class org.apache.hadoop.fs.s3a.Constants
 
MigrationTool - Class in org.apache.hadoop.fs.s3
Deprecated.
MigrationTool() - Constructor for class org.apache.hadoop.fs.s3.MigrationTool
Deprecated.
 
MIN_MULTIPART_THRESHOLD - Static variable in class org.apache.hadoop.fs.s3a.Constants
 
mkdirs(Path, FsPermission) - Method in class org.apache.hadoop.fs.s3.S3FileSystem
Deprecated.
 
mkdirs(Path, FsPermission) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem
Make the given path and all non-existent parents into directories.
mkdirs(Path, FsPermission) - Method in class org.apache.hadoop.fs.s3native.NativeS3FileSystem
 
MULTIPART_MIN_SIZE - Static variable in class org.apache.hadoop.fs.s3a.Constants
The minimum multipart size which S3 supports.
MULTIPART_SIZE - Static variable in class org.apache.hadoop.fs.s3a.Constants
 

N

NAME - Static variable in class org.apache.hadoop.fs.s3a.AnonymousAWSCredentialsProvider
 
NAME - Static variable in class org.apache.hadoop.fs.s3a.BasicAWSCredentialsProvider
 
NAME - Static variable in class org.apache.hadoop.fs.s3a.S3AStorageStatistics
 
NAME - Static variable in class org.apache.hadoop.fs.s3a.SimpleAWSCredentialsProvider
 
NAME - Static variable in class org.apache.hadoop.fs.s3a.TemporaryAWSCredentialsProvider
 
NativeS3FileSystem - Class in org.apache.hadoop.fs.s3native
A FileSystem for reading and writing files stored on Amazon S3.
NativeS3FileSystem() - Constructor for class org.apache.hadoop.fs.s3native.NativeS3FileSystem
 
NativeS3FileSystem(NativeFileSystemStore) - Constructor for class org.apache.hadoop.fs.s3native.NativeS3FileSystem
 
newObjectMetadata() - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem
Create a new object metadata instance.
newObjectMetadata(long) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem
Create a new object metadata instance.
newPutObjectRequest(String, ObjectMetadata, File) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem
Create a putObject request.
NO_AWS_CREDENTIAL_PROVIDERS - Static variable in class org.apache.hadoop.fs.s3a.AWSCredentialProviderList
 

O

objectRepresentsDirectory(String, long) - Static method in class org.apache.hadoop.fs.s3a.S3AUtils
Predicate: does the object represent a directory?.
open(Path, int) - Method in class org.apache.hadoop.fs.s3.S3FileSystem
Deprecated.
 
open(Path, int) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem
Opens an FSDataInputStream at the indicated Path.
open(Path, int) - Method in class org.apache.hadoop.fs.s3native.NativeS3FileSystem
 
openOperations - Variable in class org.apache.hadoop.fs.s3a.S3AInstrumentation.InputStreamStatistics
 
org.apache.hadoop.fs.s3 - package org.apache.hadoop.fs.s3
A distributed, block-based implementation of FileSystem that uses Amazon S3 as a backing store.
org.apache.hadoop.fs.s3a - package org.apache.hadoop.fs.s3a
S3A Filesystem.
org.apache.hadoop.fs.s3native - package org.apache.hadoop.fs.s3native
A distributed implementation of FileSystem for reading and writing files on Amazon S3.
OutputStreamStatistics(FileSystem.Statistics) - Constructor for class org.apache.hadoop.fs.s3a.S3AInstrumentation.OutputStreamStatistics
 

P

PATH_STYLE_ACCESS - Static variable in class org.apache.hadoop.fs.s3a.Constants
 
ProgressableProgressListener - Class in org.apache.hadoop.fs.s3a
Listener to progress from AWS regarding transfers.
ProgressableProgressListener(S3AFileSystem, String, Upload, Progressable) - Constructor for class org.apache.hadoop.fs.s3a.ProgressableProgressListener
Instantiate.
progressChanged(ProgressEvent) - Method in class org.apache.hadoop.fs.s3a.ProgressableProgressListener
 
propagateBucketOptions(Configuration, String) - Static method in class org.apache.hadoop.fs.s3a.S3AUtils
Propagates bucket-specific settings into generic S3A configuration keys.
PROXY_DOMAIN - Static variable in class org.apache.hadoop.fs.s3a.Constants
 
PROXY_HOST - Static variable in class org.apache.hadoop.fs.s3a.Constants
 
PROXY_PASSWORD - Static variable in class org.apache.hadoop.fs.s3a.Constants
 
PROXY_PORT - Static variable in class org.apache.hadoop.fs.s3a.Constants
 
PROXY_USERNAME - Static variable in class org.apache.hadoop.fs.s3a.Constants
 
PROXY_WORKSTATION - Static variable in class org.apache.hadoop.fs.s3a.Constants
 
purge() - Method in interface org.apache.hadoop.fs.s3.FileSystemStore
Deprecated.
Delete everything.
PURGE_EXISTING_MULTIPART - Static variable in class org.apache.hadoop.fs.s3a.Constants
 
PURGE_EXISTING_MULTIPART_AGE - Static variable in class org.apache.hadoop.fs.s3a.Constants
 
putObject(PutObjectRequest) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem
Start a transfer-manager managed async PUT of an object, incrementing the put requests and put bytes counters.
putObjectDirect(PutObjectRequest) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem
PUT an object directly (i.e.

R

read() - Method in class org.apache.hadoop.fs.s3a.S3AInputStream
 
read(byte[], int, int) - Method in class org.apache.hadoop.fs.s3a.S3AInputStream
This updates the statistics on read operations started and whether or not the read operation "completed", that is: returned the exact number of bytes requested.
READAHEAD_RANGE - Static variable in class org.apache.hadoop.fs.s3a.Constants
read ahead buffer size to prevent connection re-establishments.
readException() - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation.InputStreamStatistics
An ignored stream read exception was received.
readExceptions - Variable in class org.apache.hadoop.fs.s3a.S3AInstrumentation.InputStreamStatistics
 
readFully(long, byte[], int, int) - Method in class org.apache.hadoop.fs.s3a.S3AInputStream
Subclass readFully() operation which only seeks at the start of the series of operations; seeking back at the end.
readFullyOperations - Variable in class org.apache.hadoop.fs.s3a.S3AInstrumentation.InputStreamStatistics
 
readFullyOperationStarted(long, long) - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation.InputStreamStatistics
A PositionedRead.read(position, buffer, offset, length) operation has just started.
readOperationCompleted(int, int) - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation.InputStreamStatistics
A read operation has completed.
readOperations - Variable in class org.apache.hadoop.fs.s3a.S3AInstrumentation.InputStreamStatistics
 
readOperationStarted(long, long) - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation.InputStreamStatistics
A read(byte[] buf, int off, int len) operation has started.
readsIncomplete - Variable in class org.apache.hadoop.fs.s3a.S3AInstrumentation.InputStreamStatistics
 
refresh() - Method in class org.apache.hadoop.fs.s3a.AnonymousAWSCredentialsProvider
 
refresh() - Method in class org.apache.hadoop.fs.s3a.AWSCredentialProviderList
Refresh all child entries.
refresh() - Method in class org.apache.hadoop.fs.s3a.BasicAWSCredentialsProvider
 
refresh() - Method in class org.apache.hadoop.fs.s3a.SimpleAWSCredentialsProvider
 
refresh() - Method in class org.apache.hadoop.fs.s3a.TemporaryAWSCredentialsProvider
 
remainingInCurrentRequest() - Method in class org.apache.hadoop.fs.s3a.S3AInputStream
Bytes left in the current request.
remainingInFile() - Method in class org.apache.hadoop.fs.s3a.S3AInputStream
Bytes left in stream.
rename(Path, Path) - Method in class org.apache.hadoop.fs.s3.S3FileSystem
Deprecated.
 
rename(Path, Path) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem
Renames Path src to Path dst.
rename(Path, Path) - Method in class org.apache.hadoop.fs.s3native.NativeS3FileSystem
 
RenameFailedException - Exception in org.apache.hadoop.fs.s3a
Error to indicate that a specific rename failed.
RenameFailedException(String, String, Throwable) - Constructor for exception org.apache.hadoop.fs.s3a.RenameFailedException
 
RenameFailedException(String, String, String) - Constructor for exception org.apache.hadoop.fs.s3a.RenameFailedException
 
RenameFailedException(Path, Path, String) - Constructor for exception org.apache.hadoop.fs.s3a.RenameFailedException
 
reset() - Method in class org.apache.hadoop.fs.s3a.S3AStorageStatistics
 
resetConnection() - Method in class org.apache.hadoop.fs.s3a.S3AInputStream
Forcibly reset the stream, by aborting the connection.
retrieveBlock(Block, long) - Method in interface org.apache.hadoop.fs.s3.FileSystemStore
Deprecated.
 
retrieveINode(Path) - Method in interface org.apache.hadoop.fs.s3.FileSystemStore
Deprecated.
 
run(String[]) - Method in class org.apache.hadoop.fs.s3.MigrationTool
Deprecated.
 

S

S3_BLOCK_SIZE_DEFAULT - Static variable in class org.apache.hadoop.fs.s3.S3FileSystemConfigKeys
Deprecated.
 
S3_BLOCK_SIZE_KEY - Static variable in class org.apache.hadoop.fs.s3.S3FileSystemConfigKeys
Deprecated.
 
S3_BYTES_PER_CHECKSUM_DEFAULT - Static variable in class org.apache.hadoop.fs.s3.S3FileSystemConfigKeys
Deprecated.
 
S3_BYTES_PER_CHECKSUM_KEY - Static variable in class org.apache.hadoop.fs.s3.S3FileSystemConfigKeys
Deprecated.
 
S3_CLIENT_FACTORY_IMPL - Static variable in class org.apache.hadoop.fs.s3a.Constants
 
S3_CLIENT_WRITE_PACKET_SIZE_DEFAULT - Static variable in class org.apache.hadoop.fs.s3.S3FileSystemConfigKeys
Deprecated.
 
S3_CLIENT_WRITE_PACKET_SIZE_KEY - Static variable in class org.apache.hadoop.fs.s3.S3FileSystemConfigKeys
Deprecated.
 
S3_NATIVE_BLOCK_SIZE_DEFAULT - Static variable in class org.apache.hadoop.fs.s3native.S3NativeFileSystemConfigKeys
 
S3_NATIVE_BLOCK_SIZE_KEY - Static variable in class org.apache.hadoop.fs.s3native.S3NativeFileSystemConfigKeys
 
S3_NATIVE_BYTES_PER_CHECKSUM_DEFAULT - Static variable in class org.apache.hadoop.fs.s3native.S3NativeFileSystemConfigKeys
 
S3_NATIVE_BYTES_PER_CHECKSUM_KEY - Static variable in class org.apache.hadoop.fs.s3native.S3NativeFileSystemConfigKeys
 
S3_NATIVE_CLIENT_WRITE_PACKET_SIZE_DEFAULT - Static variable in class org.apache.hadoop.fs.s3native.S3NativeFileSystemConfigKeys
 
S3_NATIVE_CLIENT_WRITE_PACKET_SIZE_KEY - Static variable in class org.apache.hadoop.fs.s3native.S3NativeFileSystemConfigKeys
 
S3_NATIVE_REPLICATION_DEFAULT - Static variable in class org.apache.hadoop.fs.s3native.S3NativeFileSystemConfigKeys
 
S3_NATIVE_REPLICATION_KEY - Static variable in class org.apache.hadoop.fs.s3native.S3NativeFileSystemConfigKeys
 
S3_NATIVE_STREAM_BUFFER_SIZE_DEFAULT - Static variable in class org.apache.hadoop.fs.s3native.S3NativeFileSystemConfigKeys
 
S3_NATIVE_STREAM_BUFFER_SIZE_KEY - Static variable in class org.apache.hadoop.fs.s3native.S3NativeFileSystemConfigKeys
 
S3_REPLICATION_DEFAULT - Static variable in class org.apache.hadoop.fs.s3.S3FileSystemConfigKeys
Deprecated.
 
S3_REPLICATION_KEY - Static variable in class org.apache.hadoop.fs.s3.S3FileSystemConfigKeys
Deprecated.
 
S3_STREAM_BUFFER_SIZE_DEFAULT - Static variable in class org.apache.hadoop.fs.s3.S3FileSystemConfigKeys
Deprecated.
 
S3_STREAM_BUFFER_SIZE_KEY - Static variable in class org.apache.hadoop.fs.s3.S3FileSystemConfigKeys
Deprecated.
 
S3A - Class in org.apache.hadoop.fs.s3a
S3A implementation of AbstractFileSystem.
S3A(URI, Configuration) - Constructor for class org.apache.hadoop.fs.s3a.S3A
 
S3A_DEFAULT_PORT - Static variable in class org.apache.hadoop.fs.s3a.Constants
 
S3A_SECURITY_CREDENTIAL_PROVIDER_PATH - Static variable in class org.apache.hadoop.fs.s3a.Constants
Extra set of security credentials which will be prepended to that set in "hadoop.security.credential.provider.path".
S3AFileStatus - Class in org.apache.hadoop.fs.s3a
File status for an S3A "file".
S3AFileStatus(boolean, Path, String) - Constructor for class org.apache.hadoop.fs.s3a.S3AFileStatus
Create a directory status.
S3AFileStatus(long, long, Path, long, String) - Constructor for class org.apache.hadoop.fs.s3a.S3AFileStatus
A simple file.
S3AFileSystem - Class in org.apache.hadoop.fs.s3a
The core S3A Filesystem implementation.
S3AFileSystem() - Constructor for class org.apache.hadoop.fs.s3a.S3AFileSystem
 
S3AInputPolicy - Enum in org.apache.hadoop.fs.s3a
Filesystem input policy.
S3AInputStream - Class in org.apache.hadoop.fs.s3a
The input stream for an S3A object.
S3AInputStream(String, String, long, AmazonS3, FileSystem.Statistics, S3AInstrumentation, long, S3AInputPolicy) - Constructor for class org.apache.hadoop.fs.s3a.S3AInputStream
 
S3AInstrumentation - Class in org.apache.hadoop.fs.s3a
Instrumentation of S3a.
S3AInstrumentation(URI) - Constructor for class org.apache.hadoop.fs.s3a.S3AInstrumentation
 
S3AInstrumentation.InputStreamStatistics - Class in org.apache.hadoop.fs.s3a
Statistics updated by an input stream during its actual operation.
S3AInstrumentation.OutputStreamStatistics - Class in org.apache.hadoop.fs.s3a
Statistics updated by an output stream during its actual operation.
S3AOutputStream - Class in org.apache.hadoop.fs.s3a
Output stream to save data to S3.
S3AOutputStream(Configuration, S3AFileSystem, String, Progressable) - Constructor for class org.apache.hadoop.fs.s3a.S3AOutputStream
 
S3AStorageStatistics - Class in org.apache.hadoop.fs.s3a
Storage statistics for S3A.
S3AStorageStatistics() - Constructor for class org.apache.hadoop.fs.s3a.S3AStorageStatistics
 
S3AUtils - Class in org.apache.hadoop.fs.s3a
Utility methods for S3A code.
S3Credentials - Class in org.apache.hadoop.fs.s3
Deprecated.
S3Credentials() - Constructor for class org.apache.hadoop.fs.s3.S3Credentials
Deprecated.
 
S3Exception - Exception in org.apache.hadoop.fs.s3
Deprecated.
S3Exception(Throwable) - Constructor for exception org.apache.hadoop.fs.s3.S3Exception
Deprecated.
 
S3FileSystem - Class in org.apache.hadoop.fs.s3
Deprecated.
S3FileSystem() - Constructor for class org.apache.hadoop.fs.s3.S3FileSystem
Deprecated.
 
S3FileSystem(FileSystemStore) - Constructor for class org.apache.hadoop.fs.s3.S3FileSystem
Deprecated.
 
S3FileSystemConfigKeys - Class in org.apache.hadoop.fs.s3
Deprecated.
S3FileSystemConfigKeys() - Constructor for class org.apache.hadoop.fs.s3.S3FileSystemConfigKeys
Deprecated.
 
S3FileSystemException - Exception in org.apache.hadoop.fs.s3
Deprecated.
S3FileSystemException(String) - Constructor for exception org.apache.hadoop.fs.s3.S3FileSystemException
Deprecated.
 
S3N_FOLDER_SUFFIX - Static variable in class org.apache.hadoop.fs.s3a.Constants
 
S3NativeFileSystemConfigKeys - Class in org.apache.hadoop.fs.s3native
This class contains constants for configuration keys used in the s3 file system.
S3NativeFileSystemConfigKeys() - Constructor for class org.apache.hadoop.fs.s3native.S3NativeFileSystemConfigKeys
 
S3xLoginHelper - Class in org.apache.hadoop.fs.s3native
Class to aid logging in to S3 endpoints.
S3xLoginHelper.Login - Class in org.apache.hadoop.fs.s3native
Simple tuple of login details.
SECRET_KEY - Static variable in class org.apache.hadoop.fs.s3a.Constants
 
SECURE_CONNECTIONS - Static variable in class org.apache.hadoop.fs.s3a.Constants
 
seek(long) - Method in class org.apache.hadoop.fs.s3a.S3AInputStream
 
seekBackwards(long) - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation.InputStreamStatistics
Seek backwards, incrementing the seek and backward seek counters.
seekForwards(long) - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation.InputStreamStatistics
Record a forward seek, adding a seek operation, a forward seek operation, and any bytes skipped.
seekOperations - Variable in class org.apache.hadoop.fs.s3a.S3AInstrumentation.InputStreamStatistics
 
seekToNewSource(long) - Method in class org.apache.hadoop.fs.s3a.S3AInputStream
 
serialize() - Method in class org.apache.hadoop.fs.s3.INode
Deprecated.
 
SERVER_SIDE_ENCRYPTION_AES256 - Static variable in class org.apache.hadoop.fs.s3a.Constants
The standard encryption algorithm AWS supports.
SERVER_SIDE_ENCRYPTION_ALGORITHM - Static variable in class org.apache.hadoop.fs.s3a.Constants
 
SESSION_TOKEN - Static variable in class org.apache.hadoop.fs.s3a.Constants
 
setInputPolicy(S3AInputPolicy) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem
Change the input policy for this FS.
setReadahead(Long) - Method in class org.apache.hadoop.fs.s3a.S3AInputStream
 
setReuseLastProvider(boolean) - Method in class org.apache.hadoop.fs.s3a.AWSCredentialProviderList
Reuse the last provider?
setWorkingDirectory(Path) - Method in class org.apache.hadoop.fs.s3.S3FileSystem
Deprecated.
 
setWorkingDirectory(Path) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem
Set the current working directory for the given file system.
setWorkingDirectory(Path) - Method in class org.apache.hadoop.fs.s3native.NativeS3FileSystem
Set the working directory to the given directory.
SharedInstanceProfileCredentialsProvider - Class in org.apache.hadoop.fs.s3a
A subclass of InstanceProfileCredentialsProvider that enforces instantiation of only a single instance.
SIGNING_ALGORITHM - Static variable in class org.apache.hadoop.fs.s3a.Constants
 
SimpleAWSCredentialsProvider - Class in org.apache.hadoop.fs.s3a
Support simple credentials for authenticating with AWS.
SimpleAWSCredentialsProvider(URI, Configuration) - Constructor for class org.apache.hadoop.fs.s3a.SimpleAWSCredentialsProvider
 
SOCKET_RECV_BUFFER - Static variable in class org.apache.hadoop.fs.s3a.Constants
 
SOCKET_SEND_BUFFER - Static variable in class org.apache.hadoop.fs.s3a.Constants
 
SOCKET_TIMEOUT - Static variable in class org.apache.hadoop.fs.s3a.Constants
 
Statistic - Enum in org.apache.hadoop.fs.s3a
Statistic which are collected in S3A.
storeBlock(Block, File) - Method in interface org.apache.hadoop.fs.s3.FileSystemStore
Deprecated.
 
storeINode(Path, INode) - Method in interface org.apache.hadoop.fs.s3.FileSystemStore
Deprecated.
 
streamClose(boolean, long) - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation.InputStreamStatistics
The inner stream was closed.
streamCounter(String, String) - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation
Create a counter in the stream map: these are unregistered in the public metrics.
streamCounter(Statistic) - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation
Create a counter in the stream map: these are unregistered in the public metrics.
streamOpened() - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation.InputStreamStatistics
The inner stream was opened.
stringify(AmazonServiceException) - Static method in class org.apache.hadoop.fs.s3a.S3AUtils
Get low level details of an amazon exception for logging; multi-line.
stringify(AmazonS3Exception) - Static method in class org.apache.hadoop.fs.s3a.S3AUtils
Get low level details of an amazon exception for logging; multi-line.
stringify(S3ObjectSummary) - Static method in class org.apache.hadoop.fs.s3a.S3AUtils
String information about a summary entry for debug messages.

T

TemporaryAWSCredentialsProvider - Class in org.apache.hadoop.fs.s3a
Support session credentials for authenticating with AWS.
TemporaryAWSCredentialsProvider(URI, Configuration) - Constructor for class org.apache.hadoop.fs.s3a.TemporaryAWSCredentialsProvider
 
toString() - Method in class org.apache.hadoop.fs.s3.Block
Deprecated.
 
toString() - Method in class org.apache.hadoop.fs.s3a.AnonymousAWSCredentialsProvider
 
toString() - Method in class org.apache.hadoop.fs.s3a.AWSCredentialProviderList
The string value is this class name and the string values of nested providers.
toString() - Method in class org.apache.hadoop.fs.s3a.BasicAWSCredentialsProvider
 
toString() - Method in class org.apache.hadoop.fs.s3a.S3AFileStatus
 
toString() - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem
 
toString() - Method in enum org.apache.hadoop.fs.s3a.S3AInputPolicy
 
toString() - Method in class org.apache.hadoop.fs.s3a.S3AInputStream
String value includes statistics as well as stream state.
toString() - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation.InputStreamStatistics
String operator describes all the current statistics.
toString() - Method in class org.apache.hadoop.fs.s3a.S3AInstrumentation.OutputStreamStatistics
 
toString() - Method in class org.apache.hadoop.fs.s3a.SimpleAWSCredentialsProvider
 
toString() - Method in enum org.apache.hadoop.fs.s3a.Statistic
The string value is simply the symbol.
toString() - Method in class org.apache.hadoop.fs.s3a.TemporaryAWSCredentialsProvider
 
toString(URI) - Static method in class org.apache.hadoop.fs.s3native.S3xLoginHelper
Create a stripped down string value for error messages.
translateException(String, Path, AmazonClientException) - Static method in class org.apache.hadoop.fs.s3a.S3AUtils
Translate an exception raised in an operation into an IOException.
translateException(String, String, AmazonClientException) - Static method in class org.apache.hadoop.fs.s3a.S3AUtils
Translate an exception raised in an operation into an IOException.

U

uploadCompleted() - Method in class org.apache.hadoop.fs.s3a.ProgressableProgressListener
Method to invoke after upload has completed.
uploadPart(UploadPartRequest) - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem
Upload part of a multi-partition file.
USER_AGENT_PREFIX - Static variable in class org.apache.hadoop.fs.s3a.Constants
 

V

valueOf(String) - Static method in enum org.apache.hadoop.fs.s3a.S3AInputPolicy
Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum org.apache.hadoop.fs.s3a.Statistic
Returns the enum constant of this type with the specified name.
values() - Static method in enum org.apache.hadoop.fs.s3a.S3AInputPolicy
Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum org.apache.hadoop.fs.s3a.Statistic
Returns an array containing the constants of this enum type, in the order they are declared.
verifyBucketExists() - Method in class org.apache.hadoop.fs.s3a.S3AFileSystem
Verify that the bucket exists.
VersionMismatchException - Exception in org.apache.hadoop.fs.s3
Deprecated.
VersionMismatchException(String, String) - Constructor for exception org.apache.hadoop.fs.s3.VersionMismatchException
Deprecated.
 

W

withExitCode(boolean) - Method in exception org.apache.hadoop.fs.s3a.RenameFailedException
Set the exit code.
write(int) - Method in class org.apache.hadoop.fs.s3a.S3AOutputStream
 
write(byte[], int, int) - Method in class org.apache.hadoop.fs.s3a.S3AOutputStream
 
A B C D E F G H I K L M N O P R S T U V W 
Skip navigation links

Copyright © 2017 Apache Software Foundation. All Rights Reserved.