A B C D E F G H I J L M N O P Q R S T U V W

A

AbstractGoogleAsyncWriteChannel<T extends com.google.api.client.googleapis.services.AbstractGoogleClientRequest<S>,S> - Class in com.google.cloud.hadoop.util

AbstractGoogleAsyncWriteChannel(ClientRequestHelper<S>, ExecutorService, AsyncWriteChannelOptions) - Constructor for class com.google.cloud.hadoop.util.AbstractGoogleAsyncWriteChannel

Construct a new channel using the given ExecutorService to run background uploads.

ACCESS_NOT_CONFIGURED_REASON - Static variable in class com.google.cloud.hadoop.util.ApiErrorExtractor

AccessBoundary - Class in com.google.cloud.hadoop.util

An access boundary used to generate a downscoped access token.

AccessBoundary() - Constructor for class com.google.cloud.hadoop.util.AccessBoundary

AccessBoundary.Action - Enum in com.google.cloud.hadoop.util

accessDenied(IOException) - Method in class com.google.cloud.hadoop.util.ApiErrorExtractor

Determines if the given exception indicates 'access denied'.

accessDeniedNonRecoverable(IOException) - Method in class com.google.cloud.hadoop.util.ApiErrorExtractor

Determines if the exception is a non-recoverable access denied code (such as account closed or marked for deletion).

ACCOUNT_DISABLED_REASON - Static variable in class com.google.cloud.hadoop.util.ApiErrorExtractor

action() - Method in class com.google.cloud.hadoop.util.AccessBoundary

ALL_ERRORS - Static variable in interface com.google.cloud.hadoop.util.RetryDeterminer

Always retries.

andThen(Function<? super R, ? extends V>) - Method in interface com.google.cloud.hadoop.util.CheckedFunction

Returns a composed function that first applies this function to its input, and then applies the after function to the result.

ApiErrorExtractor - Class in com.google.cloud.hadoop.util

Translates exceptions from API calls into higher-level meaning, while allowing injectability for testing how API errors are handled.

ApiErrorExtractor() - Constructor for class com.google.cloud.hadoop.util.ApiErrorExtractor

apply(T) - Method in interface com.google.cloud.hadoop.util.CheckedFunction

Applies this function to the given argument.

arbitraryInputStreamSupplier(Supplier<InputStream>) - Static method in class com.google.cloud.hadoop.util.testing.MockHttpTransportHelper

Return an arbitrary InputStream supplier.

AsyncWriteChannelOptions - Class in com.google.cloud.hadoop.util

Options for the AbstractGoogleAsyncWriteChannel.

AsyncWriteChannelOptions() - Constructor for class com.google.cloud.hadoop.util.AsyncWriteChannelOptions

AsyncWriteChannelOptions.Builder - Class in com.google.cloud.hadoop.util

Mutable builder for the GoogleCloudStorageWriteChannelOptions class.

AsyncWriteChannelOptions.PipeType - Enum in com.google.cloud.hadoop.util

Pipe used for output stream.

awaitTermination(long, TimeUnit) - Method in class com.google.cloud.hadoop.util.LazyExecutorService

B

badRequest(IOException) - Method in class com.google.cloud.hadoop.util.ApiErrorExtractor

Determines if the given exception indicates bad request.

BaseAbstractGoogleAsyncWriteChannel<T> - Class in com.google.cloud.hadoop.util

Skeletal implementation of a WritableByteChannel that executes an asynchronous upload operation and optionally handles the result.

BaseAbstractGoogleAsyncWriteChannel(ExecutorService, AsyncWriteChannelOptions) - Constructor for class com.google.cloud.hadoop.util.BaseAbstractGoogleAsyncWriteChannel

Construct a new channel using the given ExecutorService to run background uploads.

bucketName() - Method in class com.google.cloud.hadoop.util.AccessBoundary

BUFFER_SIZE_DEFAULT - Static variable in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions

Default upload buffer size.

build() - Method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions.Builder

build() - Method in class com.google.cloud.hadoop.util.CredentialOptions.Builder

build() - Method in class com.google.cloud.hadoop.util.RequesterPaysOptions.Builder

build() - Method in class com.google.cloud.hadoop.util.RetryHttpInitializerOptions.Builder

builder() - Static method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions

Builder() - Constructor for class com.google.cloud.hadoop.util.AsyncWriteChannelOptions.Builder

builder() - Static method in class com.google.cloud.hadoop.util.CredentialOptions

Builder() - Constructor for class com.google.cloud.hadoop.util.CredentialOptions.Builder

builder() - Static method in class com.google.cloud.hadoop.util.RequesterPaysOptions

Builder() - Constructor for class com.google.cloud.hadoop.util.RequesterPaysOptions.Builder

builder() - Static method in class com.google.cloud.hadoop.util.RetryHttpInitializerOptions

Builder() - Constructor for class com.google.cloud.hadoop.util.RetryHttpInitializerOptions.Builder

C

ChainingHttpRequestInitializer - Class in com.google.cloud.hadoop.util

HttpRequestInitializer that composes handlers and interceptors supplied by component handlers.

ChainingHttpRequestInitializer(HttpRequestInitializer...) - Constructor for class com.google.cloud.hadoop.util.ChainingHttpRequestInitializer

channelOptions - Variable in class com.google.cloud.hadoop.util.BaseAbstractGoogleAsyncWriteChannel

CheckedFunction<T,R,E extends Throwable> - Interface in com.google.cloud.hadoop.util

Represents a function that accepts one argument and produces a result that can throw checked exception.

clientError(IOException) - Method in class com.google.cloud.hadoop.util.ApiErrorExtractor

Determines if the exception is a client error.

ClientRequestHelper<S> - Class in com.google.cloud.hadoop.util

ClientRequestHelper provides wrapper methods around final methods of AbstractGoogleClientRequest to allow overriding them if necessary.

ClientRequestHelper() - Constructor for class com.google.cloud.hadoop.util.ClientRequestHelper

close() - Method in class com.google.cloud.hadoop.util.BaseAbstractGoogleAsyncWriteChannel

Closes this channel.

com.google.cloud.hadoop.util - package com.google.cloud.hadoop.util

com.google.cloud.hadoop.util.interceptors - package com.google.cloud.hadoop.util.interceptors

com.google.cloud.hadoop.util.testing - package com.google.cloud.hadoop.util.testing

compose(Function<? super V, ? extends T>) - Method in interface com.google.cloud.hadoop.util.CheckedFunction

Returns a composed function that first applies the before function to its input, and then applies this function to the result.

ComputeCredentialWithRetry(ComputeCredential.Builder) - Constructor for class com.google.cloud.hadoop.util.CredentialFactory.ComputeCredentialWithRetry

create(String, String, AccessBoundary.Action) - Static method in class com.google.cloud.hadoop.util.AccessBoundary

create(String) - Static method in class com.google.cloud.hadoop.util.RedactedString

createApacheHttpTransport(URI, Credentials) - Static method in class com.google.cloud.hadoop.util.HttpTransportFactory

Create an ApacheHttpTransport for calling Google APIs with an optional HTTP proxy.

createHttpTransport(HttpTransportFactory.HttpTransportType) - Static method in class com.google.cloud.hadoop.util.HttpTransportFactory

Create an HttpTransport with socketKeepAlive true

createHttpTransport(HttpTransportFactory.HttpTransportType, String, RedactedString, RedactedString) - Static method in class com.google.cloud.hadoop.util.HttpTransportFactory

Create an HttpTransport based on a type class and an optional HTTP proxy.

createHttpTransport(HttpTransportFactory.HttpTransportType, String, RedactedString, RedactedString, Duration) - Static method in class com.google.cloud.hadoop.util.HttpTransportFactory

Create an HttpTransport based on a type class, optional HTTP proxy and optional socket read timeout.

createNetHttpTransport(URI, PasswordAuthentication, Duration) - Static method in class com.google.cloud.hadoop.util.HttpTransportFactory

Create an NetHttpTransport for calling Google APIs with an optional HTTP proxy.

createRequest(InputStreamContent) - Method in class com.google.cloud.hadoop.util.AbstractGoogleAsyncWriteChannel

Create an API request to upload the given InputStreamContent.

createResponseFromException(IOException) - Method in class com.google.cloud.hadoop.util.BaseAbstractGoogleAsyncWriteChannel

Derived classes may optionally intercept an IOException thrown from the execute() method of a prepared request that came from #createRequest, and return a reconstituted "response" object if the IOException can be handled as a success; for example, if the caller already has an identifier for an object, and the response is used solely for obtaining the same identifier, and the IOException is a handled "409 Already Exists" type of exception, then the derived class may override this method to return the expected "identifier" response.

CredentialAdapter - Class in com.google.cloud.hadoop.util

A wrapper for using Credential with the Google API Client Libraries for Java.

CredentialAdapter(Credential) - Constructor for class com.google.cloud.hadoop.util.CredentialAdapter

CredentialFactory - Class in com.google.cloud.hadoop.util

Miscellaneous helper methods for getting a Credential from various sources.

CredentialFactory(CredentialOptions) - Constructor for class com.google.cloud.hadoop.util.CredentialFactory

CredentialFactory.ComputeCredentialWithRetry - Class in com.google.cloud.hadoop.util

A subclass of ComputeCredential that properly sets request initializers.

CredentialFactory.CredentialHttpRetryInitializer - Class in com.google.cloud.hadoop.util

Simple HttpRequestInitializer that retries requests that result in 5XX response codes and IO Exceptions with an exponential backoff.

CredentialFactory.GoogleCredentialWithRetry - Class in com.google.cloud.hadoop.util

A subclass of GoogleCredential that properly wires specified HttpRequestInitializer through the @{link Credential#executeRefreshToken} override.

CredentialHttpRetryInitializer() - Constructor for class com.google.cloud.hadoop.util.CredentialFactory.CredentialHttpRetryInitializer

CredentialHttpRetryInitializer(Credential) - Constructor for class com.google.cloud.hadoop.util.CredentialFactory.CredentialHttpRetryInitializer

CredentialOptions - Class in com.google.cloud.hadoop.util

Configuration for how components should obtain Credentials.

CredentialOptions() - Constructor for class com.google.cloud.hadoop.util.CredentialOptions

CredentialOptions.Builder - Class in com.google.cloud.hadoop.util

Builder for CredentialOptions

D

dataRangeResponse(byte[], long, long) - Static method in class com.google.cloud.hadoop.util.testing.MockHttpTransportHelper

dataResponse(byte[]) - Static method in class com.google.cloud.hadoop.util.testing.MockHttpTransportHelper

dataResponse(Map<String, Object>, byte[]) - Static method in class com.google.cloud.hadoop.util.testing.MockHttpTransportHelper

DEFAULT - Static variable in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions

DEFAULT - Static variable in class com.google.cloud.hadoop.util.RequesterPaysOptions

DEFAULT - Static variable in interface com.google.cloud.hadoop.util.RetryDeterminer

Retries exception when either SOCKET_ERRORS or SERVER_ERRORS would retry.

DEFAULT - Static variable in class com.google.cloud.hadoop.util.RetryHttpInitializerOptions

DEFAULT_CONNECT_TIMEOUT - Static variable in class com.google.cloud.hadoop.util.RetryHttpInitializerOptions

DEFAULT_DEFAULT_USER_AGENT - Static variable in class com.google.cloud.hadoop.util.RetryHttpInitializerOptions

DEFAULT_GRPC_WRITE_MESSAGE_TIMEOUT_MILLIS - Static variable in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions

DEFAULT_GRPC_WRITE_TIMEOUT - Static variable in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions

Default timeout for grpc write stream.

DEFAULT_HTTP_HEADERS - Static variable in class com.google.cloud.hadoop.util.RetryHttpInitializerOptions

DEFAULT_MAX_REQUEST_RETRIES - Static variable in class com.google.cloud.hadoop.util.RetryHttpInitializerOptions

DEFAULT_NUM_REQUESTS_BUFFERED_GRPC - Static variable in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions

Default number of insert requests to retain, in case we need to rewind and resume an upload

DEFAULT_READ_TIMEOUT - Static variable in class com.google.cloud.hadoop.util.RetryHttpInitializerOptions

DEFAULT_SCOPES - Static variable in class com.google.cloud.hadoop.util.CredentialFactory

DEFAULT_TRANSPORT_TYPE - Static variable in class com.google.cloud.hadoop.util.HttpTransportFactory

DIRECT_UPLOAD_ENABLED_DEFAULT - Static variable in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions

Default of whether to use direct upload.

E

emptyResponse(int) - Static method in class com.google.cloud.hadoop.util.testing.MockHttpTransportHelper

ErrorTypeExtractor - Interface in com.google.cloud.hadoop.util

Translates exceptions from API calls into ErrorType

ErrorTypeExtractor.ErrorType - Enum in com.google.cloud.hadoop.util

execute(Runnable) - Method in class com.google.cloud.hadoop.util.LazyExecutorService

Always throws a RejectedExecutionException because using this method does not make sense from either a lazy execution perspective or a cached result perspective.

executeRefreshToken() - Method in class com.google.cloud.hadoop.util.CredentialFactory.ComputeCredentialWithRetry

executeRefreshToken() - Method in class com.google.cloud.hadoop.util.CredentialFactory.GoogleCredentialWithRetry

executeRefreshToken() - Method in class com.google.cloud.hadoop.util.GoogleCredentialWithIamAccessToken

F

FIELD_SIZE_TOO_LARGE_REASON - Static variable in class com.google.cloud.hadoop.util.ApiErrorExtractor

fieldSizeTooLarge(IOException) - Method in class com.google.cloud.hadoop.util.ApiErrorExtractor

Determines if the given exception indicates 'field size too large'.

G

GCCL_INVOCATION_ID_PREFIX - Static variable in class com.google.cloud.hadoop.util.interceptors.InvocationIdInterceptor

getAuthClientId() - Method in class com.google.cloud.hadoop.util.CredentialOptions

getAuthClientSecret() - Method in class com.google.cloud.hadoop.util.CredentialOptions

getAuthRefreshToken() - Method in class com.google.cloud.hadoop.util.CredentialOptions

getBuckets() - Method in class com.google.cloud.hadoop.util.RequesterPaysOptions

getBufferSize() - Method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions

getConnectTimeout() - Method in class com.google.cloud.hadoop.util.RetryHttpInitializerOptions

A connection timeout - maximum time to wait until connection will be established.

getContentType() - Method in class com.google.cloud.hadoop.util.AbstractGoogleAsyncWriteChannel

getCredential(List<String>) - Method in class com.google.cloud.hadoop.util.CredentialFactory

Get the credential as configured.

getCredential() - Method in class com.google.cloud.hadoop.util.RetryHttpInitializer

getCredentialFromMetadataServiceAccount() - Static method in class com.google.cloud.hadoop.util.CredentialFactory

Initializes OAuth2 credential using preconfigured ServiceAccount settings on the local GCE VM.

getCredentialFromPrivateKeyServiceAccount(List<String>, HttpTransport) - Method in class com.google.cloud.hadoop.util.CredentialFactory

Initializes OAuth2 credential from a private keyfile, as described in OAuth2 Service Accounts.

getDebugInfo(IOException) - Method in class com.google.cloud.hadoop.util.ApiErrorExtractor

getDefaultUserAgent() - Method in class com.google.cloud.hadoop.util.RetryHttpInitializerOptions

A String to set as the user-agent when initializing an HTTP request if it doesn't already have a "User-Agent" header.

getErrorCode() - Method in enum com.google.cloud.hadoop.util.testing.MockHttpTransportHelper.ErrorResponses

getErrorDomain() - Method in enum com.google.cloud.hadoop.util.testing.MockHttpTransportHelper.ErrorResponses

getErrorInfo(IOException) - Method in class com.google.cloud.hadoop.util.ApiErrorExtractor

Get the first ErrorInfo from an IOException if it is an instance of GoogleJsonResponseException, otherwise return null.

getErrorMessage(IOException) - Method in class com.google.cloud.hadoop.util.ApiErrorExtractor

Extracts the error message.

getErrorMessage() - Method in enum com.google.cloud.hadoop.util.testing.MockHttpTransportHelper.ErrorResponses

getErrorReason() - Method in enum com.google.cloud.hadoop.util.testing.MockHttpTransportHelper.ErrorResponses

getErrorType(Exception) - Method in interface com.google.cloud.hadoop.util.ErrorTypeExtractor

getErrorType(Exception) - Method in class com.google.cloud.hadoop.util.GrpcErrorTypeExtractor

getGrpcWriteMessageTimeoutMillis() - Method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions

getGrpcWriteTimeout() - Method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions

getHttpHeaders() - Method in class com.google.cloud.hadoop.util.RetryHttpInitializerOptions

An additional HTTP headers to set in an HTTP request.

getHttpStatusCode(GoogleJsonResponseException) - Method in class com.google.cloud.hadoop.util.ApiErrorExtractor

Returns HTTP status code from the given exception.

getJsonError(IOException) - Method in class com.google.cloud.hadoop.util.ApiErrorExtractor

If the exception is a GoogleJsonResponseException, get the error details, else return null.

getJsonResponseException(Throwable) - Static method in class com.google.cloud.hadoop.util.ApiErrorExtractor

getMaxRequestRetries() - Method in class com.google.cloud.hadoop.util.RetryHttpInitializerOptions

A max number of retries for an HTTP request.

getMode() - Method in class com.google.cloud.hadoop.util.RequesterPaysOptions

getNumberOfBufferedRequests() - Method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions

getPipeBufferSize() - Method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions

getPipeType() - Method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions

getProjectId() - Method in class com.google.cloud.hadoop.util.RequesterPaysOptions

getPropertyOrDefault(Class<?>, String, String, String) - Static method in class com.google.cloud.hadoop.util.PropertyUtil

Get the value of a property or a default value if there's an error retrieving the property key.

getProxyAddress() - Method in class com.google.cloud.hadoop.util.CredentialOptions

getProxyPassword() - Method in class com.google.cloud.hadoop.util.CredentialOptions

getProxyUsername() - Method in class com.google.cloud.hadoop.util.CredentialOptions

getReadTimeout() - Method in class com.google.cloud.hadoop.util.RetryHttpInitializerOptions

A read timeout from an established connection - maximum time to wait for a read form an established connection to finish.

getRequestHeaders(AbstractGoogleClientRequest<S>) - Method in class com.google.cloud.hadoop.util.ClientRequestHelper

Wraps AbstractGoogleClientRequest.getRequestHeaders().

getResourceString() - Method in class com.google.cloud.hadoop.util.BaseAbstractGoogleAsyncWriteChannel

getResponseCode() - Method in enum com.google.cloud.hadoop.util.testing.MockHttpTransportHelper.ErrorResponses

getServiceAccountEmail() - Method in class com.google.cloud.hadoop.util.CredentialOptions

getServiceAccountJsonKeyFile() - Method in class com.google.cloud.hadoop.util.CredentialOptions

getServiceAccountKeyFile() - Method in class com.google.cloud.hadoop.util.CredentialOptions

getServiceAccountPrivateKey() - Method in class com.google.cloud.hadoop.util.CredentialOptions

getServiceAccountPrivateKeyId() - Method in class com.google.cloud.hadoop.util.CredentialOptions

getTokenServerUrl() - Method in class com.google.cloud.hadoop.util.CredentialOptions

getTransportType() - Method in class com.google.cloud.hadoop.util.CredentialOptions

getUploadCacheSize() - Method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions

getUploadChunkSize() - Method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions

GLOBAL_DOMAIN - Static variable in class com.google.cloud.hadoop.util.ApiErrorExtractor

GOOG_API_CLIENT - Static variable in class com.google.cloud.hadoop.util.interceptors.InvocationIdInterceptor

GoogleCredentialWithIamAccessToken - Class in com.google.cloud.hadoop.util

A Credential to generate or refresh IAM access token.

GoogleCredentialWithIamAccessToken(HttpTransport, HttpRequestInitializer, String, ImmutableList<String>) - Constructor for class com.google.cloud.hadoop.util.GoogleCredentialWithIamAccessToken

GoogleCredentialWithIamAccessToken(HttpTransport, HttpRequestInitializer, String, ImmutableList<String>, Clock) - Constructor for class com.google.cloud.hadoop.util.GoogleCredentialWithIamAccessToken

GRPC_CHECKSUMS_ENABLED_DEFAULT - Static variable in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions

Default of whether to enabled checksums for gRPC.

GrpcErrorTypeExtractor - Class in com.google.cloud.hadoop.util

Implementation for ErrorTypeExtractor for exception specifically thrown from gRPC path.

H

handleResponse(T) - Method in class com.google.cloud.hadoop.util.BaseAbstractGoogleAsyncWriteChannel

Handle the API response.

HttpTransportFactory - Class in com.google.cloud.hadoop.util

Factory for creating HttpTransport types.

HttpTransportFactory() - Constructor for class com.google.cloud.hadoop.util.HttpTransportFactory

HttpTransportFactory.HttpTransportType - Enum in com.google.cloud.hadoop.util

Types of HttpTransports the factory can create.

I

identity() - Static method in interface com.google.cloud.hadoop.util.CheckedFunction

Returns a function that always returns its input argument.

initialize() - Method in class com.google.cloud.hadoop.util.BaseAbstractGoogleAsyncWriteChannel

Initialize this channel object for writing.

initialize(HttpRequest) - Method in class com.google.cloud.hadoop.util.ChainingHttpRequestInitializer

initialize(HttpRequest) - Method in class com.google.cloud.hadoop.util.CredentialFactory.CredentialHttpRetryInitializer

initialize(HttpRequest) - Method in class com.google.cloud.hadoop.util.RetryHttpInitializer

inputStreamResponse(String, Object, InputStream) - Static method in class com.google.cloud.hadoop.util.testing.MockHttpTransportHelper

inputStreamResponse(Map<String, Object>, InputStream) - Static method in class com.google.cloud.hadoop.util.testing.MockHttpTransportHelper

INSTANCE - Static variable in class com.google.cloud.hadoop.util.ApiErrorExtractor

Singleton instance of the ApiErrorExtractor.

INSTANCE - Static variable in class com.google.cloud.hadoop.util.GrpcErrorTypeExtractor

intercept(HttpRequest) - Method in class com.google.cloud.hadoop.util.interceptors.InvocationIdInterceptor

internalServerError(IOException) - Method in class com.google.cloud.hadoop.util.ApiErrorExtractor

Determines if the exception is an internal server error.

InvocationIdInterceptor - Class in com.google.cloud.hadoop.util.interceptors

HTTP request interceptor to attach unique identifier i.e.

InvocationIdInterceptor(HttpExecuteInterceptor) - Constructor for class com.google.cloud.hadoop.util.interceptors.InvocationIdInterceptor

invokeAll(Collection<? extends Callable<T>>) - Method in class com.google.cloud.hadoop.util.LazyExecutorService

ExecutorService requires that this method should not return until all tasks are completed, which precludes lazy execution.

invokeAll(Collection<? extends Callable<T>>, long, TimeUnit) - Method in class com.google.cloud.hadoop.util.LazyExecutorService

ExecutorService requires that this method should not return until all tasks are completed or the timeout expires, which precludes lazy execution.

invokeAny(Collection<? extends Callable<T>>) - Method in class com.google.cloud.hadoop.util.LazyExecutorService

Always throws a RejectedExecutionException because using this method does not make sense from either a lazy execution perspective or a cached result perspective.

invokeAny(Collection<? extends Callable<T>>, long, TimeUnit) - Method in class com.google.cloud.hadoop.util.LazyExecutorService

Always throws a RejectedExecutionException because using this method does not make sense from either a lazy execution perspective or a cached result perspective.

IoExceptionHelper - Class in com.google.cloud.hadoop.util

Translates exceptions from API calls into higher-level meaning, while allowing injectability for testing how API errors are handled.

isDirectUploadEnabled() - Method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions

isDirectUploadEnabled() - Method in class com.google.cloud.hadoop.util.BaseAbstractGoogleAsyncWriteChannel

Returns true if direct media uploads are enabled.

isGrpcChecksumsEnabled() - Method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions

isIoError(Throwable) - Static method in class com.google.cloud.hadoop.util.IoExceptionHelper

Determines if a given Throwable is caused by an IO error.

isNullCredentialEnabled() - Method in class com.google.cloud.hadoop.util.CredentialOptions

isOpen() - Method in class com.google.cloud.hadoop.util.BaseAbstractGoogleAsyncWriteChannel

Tells whether this channel is open.

isReadTimedOut(IOException) - Static method in class com.google.cloud.hadoop.util.IoExceptionHelper

Determines if a given IOException is caused by a timed out read.

isServiceAccountEnabled() - Method in class com.google.cloud.hadoop.util.CredentialOptions

isShutdown() - Method in class com.google.cloud.hadoop.util.LazyExecutorService

isSocketError(Throwable) - Static method in class com.google.cloud.hadoop.util.IoExceptionHelper

Determines if a given Throwable is caused by a socket error.

isTerminated() - Method in class com.google.cloud.hadoop.util.LazyExecutorService

itemAlreadyExists(IOException) - Method in class com.google.cloud.hadoop.util.ApiErrorExtractor

Determines if the given exception indicates 'item already exists'.

itemNotFound(IOException) - Method in class com.google.cloud.hadoop.util.ApiErrorExtractor

Determines if the given exception indicates 'item not found'.

J

JSON_FACTORY - Static variable in class com.google.cloud.hadoop.util.testing.MockHttpTransportHelper

jsonDataResponse(Object) - Static method in class com.google.cloud.hadoop.util.testing.MockHttpTransportHelper

jsonErrorResponse(MockHttpTransportHelper.ErrorResponses) - Static method in class com.google.cloud.hadoop.util.testing.MockHttpTransportHelper

L

LazyExecutorService - Class in com.google.cloud.hadoop.util

Defers execution to the time that a method that expresses interest in the result (get or isDone) is called on the Future.

LazyExecutorService() - Constructor for class com.google.cloud.hadoop.util.LazyExecutorService

Creates an instance using a MoreExecutors.newDirectExecutorService() for the backing service.

LazyExecutorService(ExecutorService) - Constructor for class com.google.cloud.hadoop.util.LazyExecutorService

Creates an instance using the given ExecutorService as the backing service.

logger - Static variable in class com.google.cloud.hadoop.util.BaseAbstractGoogleAsyncWriteChannel

LoggingMediaHttpUploaderProgressListener - Class in com.google.cloud.hadoop.util

Logs the status of uploads.

LoggingMediaHttpUploaderProgressListener(String, long) - Constructor for class com.google.cloud.hadoop.util.LoggingMediaHttpUploaderProgressListener

Creates a upload progress listener that emits relevant statistics about the progress of the upload.

M

mockBatchTransport(int, LowLevelHttpResponse...) - Static method in class com.google.cloud.hadoop.util.testing.MockHttpTransportHelper

MockHttpTransportHelper - Class in com.google.cloud.hadoop.util.testing

Utility methods for testing with MockHttpTransport

MockHttpTransportHelper.ErrorResponses - Enum in com.google.cloud.hadoop.util.testing

HTTP JSON API error responses

mockTransport(Object...) - Static method in class com.google.cloud.hadoop.util.testing.MockHttpTransportHelper

N

nextBackOffMillis() - Method in class com.google.cloud.hadoop.util.RetryBoundedBackOff

nextSleep(BackOff, Sleeper, Exception) - Static method in class com.google.cloud.hadoop.util.ResilientOperation

Determines the amount to sleep for and sleeps if needed.

O

objectName() - Method in class com.google.cloud.hadoop.util.AccessBoundary

P

PIPE_BUFFER_SIZE_DEFAULT - Static variable in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions

Default pipe buffer size.

PIPE_TYPE_DEFAULT - Static variable in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions

preconditionNotMet(IOException) - Method in class com.google.cloud.hadoop.util.ApiErrorExtractor

Determines if the given IOException indicates 'precondition not met' Recursively checks getCause() if outer exception isn't an instance of the correct class.

progressChanged(MediaHttpUploader) - Method in class com.google.cloud.hadoop.util.LoggingMediaHttpUploaderProgressListener

PropertyUtil - Class in com.google.cloud.hadoop.util

Helpers for interacting with properties files

PropertyUtil() - Constructor for class com.google.cloud.hadoop.util.PropertyUtil

Q

QUOTA_EXCEEDED_REASON - Static variable in class com.google.cloud.hadoop.util.ApiErrorExtractor

quotaExceeded(IOException) - Method in class com.google.cloud.hadoop.util.ApiErrorExtractor

Determines if a given Throwable is caused by Quota Exceeded.

R

rangeNotSatisfiable(IOException) - Method in class com.google.cloud.hadoop.util.ApiErrorExtractor

Determines if the given exception indicates 'range not satisfiable'.

RATE_LIMIT_ERRORS - Static variable in interface com.google.cloud.hadoop.util.RetryDeterminer

A rate limited determiner that uses a default ApiErrorExtractor.

RATE_LIMITED_REASON - Static variable in class com.google.cloud.hadoop.util.ApiErrorExtractor

rateLimited(IOException) - Method in class com.google.cloud.hadoop.util.ApiErrorExtractor

Determines if a given Throwable is caused by a rate limit being applied.

recursiveCheckForCode(IOException, int) - Method in class com.google.cloud.hadoop.util.ApiErrorExtractor

Recursively checks getCause() if outer exception isn't an instance of the correct class.

RedactedString - Class in com.google.cloud.hadoop.util

Holder class for string values that should not be logged and displayed when toString method called.

RedactedString() - Constructor for class com.google.cloud.hadoop.util.RedactedString

refreshAccessToken() - Method in class com.google.cloud.hadoop.util.CredentialAdapter

REQUESTER_PAYS_BUCKETS_DEFAULT - Static variable in class com.google.cloud.hadoop.util.RequesterPaysOptions

Default value for RequesterPaysOptions.getBuckets().

REQUESTER_PAYS_MODE_DEFAULT - Static variable in class com.google.cloud.hadoop.util.RequesterPaysOptions

Default value for RequesterPaysOptions.getMode().

RequesterPaysOptions - Class in com.google.cloud.hadoop.util

Options for the GCS Requester Pays feature.

RequesterPaysOptions() - Constructor for class com.google.cloud.hadoop.util.RequesterPaysOptions

RequesterPaysOptions.Builder - Class in com.google.cloud.hadoop.util

Builder for RequesterPaysOptions

RequesterPaysOptions.RequesterPaysMode - Enum in com.google.cloud.hadoop.util

Operational modes of GCS Requester Pays feature.

requestFailure(IOException) - Method in class com.google.cloud.hadoop.util.ApiErrorExtractor

Determines if the given exception indicates intermittent request failure or failure caused by user error.

reset() - Method in class com.google.cloud.hadoop.util.RetryBoundedBackOff

ResilientOperation - Class in com.google.cloud.hadoop.util

A class which defines static functions to be called to make a user-provided function more resilient by attempting retries.

ResilientOperation() - Constructor for class com.google.cloud.hadoop.util.ResilientOperation

RESOURCE_NOT_READY_REASON - Static variable in class com.google.cloud.hadoop.util.ApiErrorExtractor

resourceNotReady(IOException) - Method in class com.google.cloud.hadoop.util.ApiErrorExtractor

Determines if the given exception indicates 'resource not ready'.

retry(Callable<T>, BackOff, RetryDeterminer<? super X>, Class<X>, Sleeper) - Static method in class com.google.cloud.hadoop.util.ResilientOperation

Retries the given executable function in the case of transient errors defined by the RetryDeterminer.

retry(Callable<T>, BackOff, RetryDeterminer<? super X>, Class<X>) - Static method in class com.google.cloud.hadoop.util.ResilientOperation

Retries the given executable function in the case of transient errors defined by the RetryDeterminer and uses default sleeper.

RetryBoundedBackOff - Class in com.google.cloud.hadoop.util

An implementation of BackOff that limits the number of calls on another BackOff.

RetryBoundedBackOff(BackOff, int) - Constructor for class com.google.cloud.hadoop.util.RetryBoundedBackOff

RetryBoundedBackOff takes a BackOff and limits the retries.

RetryDeterminer<X extends Exception> - Interface in com.google.cloud.hadoop.util

This abstract class is designed to tell if an exception is transient and should result in a retry or not, and should result in a returned exception to the caller.

RetryHttpInitializer - Class in com.google.cloud.hadoop.util

RetryHttpInitializer(Credential, String) - Constructor for class com.google.cloud.hadoop.util.RetryHttpInitializer

RetryHttpInitializer(Credential, RetryHttpInitializerOptions) - Constructor for class com.google.cloud.hadoop.util.RetryHttpInitializer

RetryHttpInitializerOptions - Class in com.google.cloud.hadoop.util

Options for the RetryHttpInitializer class.

RetryHttpInitializerOptions() - Constructor for class com.google.cloud.hadoop.util.RetryHttpInitializerOptions

RetryHttpInitializerOptions.Builder - Class in com.google.cloud.hadoop.util

Builder for RetryHttpInitializerOptions

S

SERVER_ERRORS - Static variable in interface com.google.cloud.hadoop.util.RetryDeterminer

Server errors RetryDeterminer decides to retry on HttpResponseExceptions that return a 500.

setAuthClientId(String) - Method in class com.google.cloud.hadoop.util.CredentialOptions.Builder

setAuthClientSecret(RedactedString) - Method in class com.google.cloud.hadoop.util.CredentialOptions.Builder

setAuthRefreshToken(RedactedString) - Method in class com.google.cloud.hadoop.util.CredentialOptions.Builder

setBuckets(Collection<String>) - Method in class com.google.cloud.hadoop.util.RequesterPaysOptions.Builder

setBuckets(String...) - Method in class com.google.cloud.hadoop.util.RequesterPaysOptions.Builder

setBufferSize(int) - Method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions.Builder

setChunkSize(AbstractGoogleClientRequest<S>, int) - Method in class com.google.cloud.hadoop.util.ClientRequestHelper

Wraps AbstractGoogleClientRequest.getMediaHttpUploader().

setConnectTimeout(Duration) - Method in class com.google.cloud.hadoop.util.RetryHttpInitializerOptions.Builder

setDefaultUserAgent(String) - Method in class com.google.cloud.hadoop.util.RetryHttpInitializerOptions.Builder

setDirectUploadEnabled(boolean) - Method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions.Builder

setDirectUploadEnabled(AbstractGoogleClientRequest<S>, boolean) - Method in class com.google.cloud.hadoop.util.ClientRequestHelper

Configures the clientRequest to enable/disable direct (single-request) uploads according to enable.

setGrpcChecksumsEnabled(boolean) - Method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions.Builder

Enable gRPC checksumming.

setGrpcWriteMessageTimeoutMillis(long) - Method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions.Builder

setGrpcWriteTimeout(long) - Method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions.Builder

setHttpHeaders(Map<String, String>) - Method in class com.google.cloud.hadoop.util.RetryHttpInitializerOptions.Builder

setMaxRequestRetries(int) - Method in class com.google.cloud.hadoop.util.RetryHttpInitializerOptions.Builder

setMode(RequesterPaysOptions.RequesterPaysMode) - Method in class com.google.cloud.hadoop.util.RequesterPaysOptions.Builder

setNullCredentialEnabled(boolean) - Method in class com.google.cloud.hadoop.util.CredentialOptions.Builder

setNumberOfBufferedRequests(long) - Method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions.Builder

setPipeBufferSize(int) - Method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions.Builder

setPipeType(AsyncWriteChannelOptions.PipeType) - Method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions.Builder

setProjectId(String) - Method in class com.google.cloud.hadoop.util.RequesterPaysOptions.Builder

setProxyAddress(String) - Method in class com.google.cloud.hadoop.util.CredentialOptions.Builder

setProxyPassword(RedactedString) - Method in class com.google.cloud.hadoop.util.CredentialOptions.Builder

setProxyUsername(RedactedString) - Method in class com.google.cloud.hadoop.util.CredentialOptions.Builder

setReadTimeout(Duration) - Method in class com.google.cloud.hadoop.util.RetryHttpInitializerOptions.Builder

setServiceAccountEmail(String) - Method in class com.google.cloud.hadoop.util.CredentialOptions.Builder

setServiceAccountEnabled(boolean) - Method in class com.google.cloud.hadoop.util.CredentialOptions.Builder

setServiceAccountJsonKeyFile(String) - Method in class com.google.cloud.hadoop.util.CredentialOptions.Builder

setServiceAccountKeyFile(String) - Method in class com.google.cloud.hadoop.util.CredentialOptions.Builder

setServiceAccountPrivateKey(RedactedString) - Method in class com.google.cloud.hadoop.util.CredentialOptions.Builder

setServiceAccountPrivateKeyId(RedactedString) - Method in class com.google.cloud.hadoop.util.CredentialOptions.Builder

setTokenServerUrl(String) - Method in class com.google.cloud.hadoop.util.CredentialOptions.Builder

setTransportType(HttpTransportFactory.HttpTransportType) - Method in class com.google.cloud.hadoop.util.CredentialOptions.Builder

setUploadCacheSize(int) - Method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions.Builder

setUploadChunkSize(int) - Method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions.Builder

shouldRetry(X) - Method in interface com.google.cloud.hadoop.util.RetryDeterminer

Determines if we should attempt a retry depending on the caught exception.

shutdown() - Method in class com.google.cloud.hadoop.util.LazyExecutorService

Shuts this service down, but leaves the backing service untouched.

shutdownNow() - Method in class com.google.cloud.hadoop.util.LazyExecutorService

Trying to interpret the assumptions about the contract of this method in the light of this implementation, it seems most reasonable to take the view that all tasks are running, even if the processing has not actually started.

SOCKET_ERRORS - Static variable in interface com.google.cloud.hadoop.util.RetryDeterminer

Socket errors retry determiner retries on socket exceptions.

startUpload(InputStream) - Method in class com.google.cloud.hadoop.util.AbstractGoogleAsyncWriteChannel

startUpload(InputStream) - Method in class com.google.cloud.hadoop.util.BaseAbstractGoogleAsyncWriteChannel

Create a new thread which handles the upload.

STATUS_CODE_RANGE_NOT_SATISFIABLE - Static variable in class com.google.cloud.hadoop.util.ApiErrorExtractor

submit(Callable<T>) - Method in class com.google.cloud.hadoop.util.LazyExecutorService

submit(Runnable, T) - Method in class com.google.cloud.hadoop.util.LazyExecutorService

submit(Runnable) - Method in class com.google.cloud.hadoop.util.LazyExecutorService

T

threadPool - Variable in class com.google.cloud.hadoop.util.BaseAbstractGoogleAsyncWriteChannel

toBuilder() - Method in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions

toBuilder() - Method in class com.google.cloud.hadoop.util.CredentialOptions

toBuilder() - Method in class com.google.cloud.hadoop.util.RequesterPaysOptions

toBuilder() - Method in class com.google.cloud.hadoop.util.RetryHttpInitializerOptions

toString() - Method in class com.google.cloud.hadoop.util.RedactedString

toUserPresentableException(IOException, String) - Method in class com.google.cloud.hadoop.util.ApiErrorExtractor

Converts the exception to a user-presentable error message.

toUserPresentableMessage(IOException, String) - Method in class com.google.cloud.hadoop.util.ApiErrorExtractor

Converts the exception to a user-presentable error message.

toUserPresentableMessage(IOException) - Method in class com.google.cloud.hadoop.util.ApiErrorExtractor

See ApiErrorExtractor.toUserPresentableMessage(IOException, String).

U

unauthorized(IOException) - Method in class com.google.cloud.hadoop.util.ApiErrorExtractor

Determines if the given exception indicates the request was unauthenticated.

UPLOAD_CACHE_SIZE_DEFAULT - Static variable in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions

Default upload cache size.

UPLOAD_CHUNK_SIZE_DEFAULT - Static variable in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions

Default upload chunk size.

UPLOAD_CHUNK_SIZE_GRANULARITY - Static variable in class com.google.cloud.hadoop.util.AsyncWriteChannelOptions

Upload chunk size granularity

uploadOperation - Variable in class com.google.cloud.hadoop.util.BaseAbstractGoogleAsyncWriteChannel

USAGE_LIMITS_DOMAIN - Static variable in class com.google.cloud.hadoop.util.ApiErrorExtractor

USER_PROJECT_MISSING_MESSAGE - Static variable in class com.google.cloud.hadoop.util.ApiErrorExtractor

USER_RATE_LIMITED_REASON - Static variable in class com.google.cloud.hadoop.util.ApiErrorExtractor

userProjectMissing(IOException) - Method in class com.google.cloud.hadoop.util.ApiErrorExtractor

Determines if the given exception indicates that 'userProject' is missing in request.

V

value() - Method in class com.google.cloud.hadoop.util.RedactedString

valueOf(String) - Static method in enum com.google.cloud.hadoop.util.AccessBoundary.Action

Returns the enum constant of this type with the specified name.

valueOf(String) - Static method in enum com.google.cloud.hadoop.util.AsyncWriteChannelOptions.PipeType

Returns the enum constant of this type with the specified name.

valueOf(String) - Static method in enum com.google.cloud.hadoop.util.ErrorTypeExtractor.ErrorType

Returns the enum constant of this type with the specified name.

valueOf(String) - Static method in enum com.google.cloud.hadoop.util.HttpTransportFactory.HttpTransportType

Returns the enum constant of this type with the specified name.

valueOf(String) - Static method in enum com.google.cloud.hadoop.util.RequesterPaysOptions.RequesterPaysMode

Returns the enum constant of this type with the specified name.

valueOf(String) - Static method in enum com.google.cloud.hadoop.util.testing.MockHttpTransportHelper.ErrorResponses

Returns the enum constant of this type with the specified name.

values() - Static method in enum com.google.cloud.hadoop.util.AccessBoundary.Action

Returns an array containing the constants of this enum type, in the order they are declared.

values() - Static method in enum com.google.cloud.hadoop.util.AsyncWriteChannelOptions.PipeType

Returns an array containing the constants of this enum type, in the order they are declared.

values() - Static method in enum com.google.cloud.hadoop.util.ErrorTypeExtractor.ErrorType

Returns an array containing the constants of this enum type, in the order they are declared.

values() - Static method in enum com.google.cloud.hadoop.util.HttpTransportFactory.HttpTransportType

Returns an array containing the constants of this enum type, in the order they are declared.

values() - Static method in enum com.google.cloud.hadoop.util.RequesterPaysOptions.RequesterPaysMode

Returns an array containing the constants of this enum type, in the order they are declared.

values() - Static method in enum com.google.cloud.hadoop.util.testing.MockHttpTransportHelper.ErrorResponses

Returns an array containing the constants of this enum type, in the order they are declared.

W

write(ByteBuffer) - Method in class com.google.cloud.hadoop.util.BaseAbstractGoogleAsyncWriteChannel

Writes contents of the given buffer to this channel.

A B C D E F G H I J L M N O P Q R S T U V W