Skip navigation links
A C D F G I K L N O R S T 

A

AssumeRoleAwsClientFactory - Class in org.apache.iceberg.aws
 
AssumeRoleAwsClientFactory() - Constructor for class org.apache.iceberg.aws.AssumeRoleAwsClientFactory
 
AwsClientFactories - Class in org.apache.iceberg.aws
 
AwsClientFactory - Interface in org.apache.iceberg.aws
Interface to customize AWS clients used by Iceberg.
AwsProperties - Class in org.apache.iceberg.aws
 
AwsProperties() - Constructor for class org.apache.iceberg.aws.AwsProperties
 
AwsProperties(Map<String, String>) - Constructor for class org.apache.iceberg.aws.AwsProperties
 

C

CLIENT_ASSUME_ROLE_ARN - Static variable in class org.apache.iceberg.aws.AwsProperties
CLIENT_ASSUME_ROLE_EXTERNAL_ID - Static variable in class org.apache.iceberg.aws.AwsProperties
CLIENT_ASSUME_ROLE_REGION - Static variable in class org.apache.iceberg.aws.AwsProperties
CLIENT_ASSUME_ROLE_TIMEOUT_SEC - Static variable in class org.apache.iceberg.aws.AwsProperties
CLIENT_ASSUME_ROLE_TIMEOUT_SEC_DEFAULT - Static variable in class org.apache.iceberg.aws.AwsProperties
 
CLIENT_ENABLE_ETAG_CHECK_DEFAULT - Static variable in class org.apache.iceberg.aws.AwsProperties
 
CLIENT_FACTORY - Static variable in class org.apache.iceberg.aws.AwsProperties
The implementation class of AwsClientFactory to customize AWS client configurations.
close() - Method in class org.apache.iceberg.aws.dynamodb.DynamoDbCatalog
 
close() - Method in class org.apache.iceberg.aws.glue.GlueCatalog
 
close() - Method in class org.apache.iceberg.aws.s3.S3FileIO
 
create() - Method in class org.apache.iceberg.aws.s3.S3OutputFile
Create an output stream for the specified location if the target object does not exist in S3 at the time of invocation.
createNamespace(Namespace, Map<String, String>) - Method in class org.apache.iceberg.aws.dynamodb.DynamoDbCatalog
 
createNamespace(Namespace, Map<String, String>) - Method in class org.apache.iceberg.aws.glue.GlueCatalog
 
createOrOverwrite() - Method in class org.apache.iceberg.aws.s3.S3OutputFile
 

D

defaultFactory() - Static method in class org.apache.iceberg.aws.AwsClientFactories
 
defaultLocationProperty() - Static method in class org.apache.iceberg.aws.dynamodb.DynamoDbCatalog
The property used to set a default location for tables in a namespace.
defaultWarehouseLocation(TableIdentifier) - Method in class org.apache.iceberg.aws.dynamodb.DynamoDbCatalog
 
defaultWarehouseLocation(TableIdentifier) - Method in class org.apache.iceberg.aws.glue.GlueCatalog
This method produces the same result as using a HiveCatalog.
deleteFile(String) - Method in class org.apache.iceberg.aws.s3.S3FileIO
 
dropNamespace(Namespace) - Method in class org.apache.iceberg.aws.dynamodb.DynamoDbCatalog
 
dropNamespace(Namespace) - Method in class org.apache.iceberg.aws.glue.GlueCatalog
 
dropTable(TableIdentifier, boolean) - Method in class org.apache.iceberg.aws.dynamodb.DynamoDbCatalog
 
dropTable(TableIdentifier, boolean) - Method in class org.apache.iceberg.aws.glue.GlueCatalog
 
dynamo() - Method in class org.apache.iceberg.aws.AssumeRoleAwsClientFactory
 
dynamo() - Method in interface org.apache.iceberg.aws.AwsClientFactory
Create a Amazon DynamoDB client
DYNAMODB_TABLE_NAME - Static variable in class org.apache.iceberg.aws.AwsProperties
DynamoDB table name for DynamoDbCatalog
DYNAMODB_TABLE_NAME_DEFAULT - Static variable in class org.apache.iceberg.aws.AwsProperties
 
DynamoDbCatalog - Class in org.apache.iceberg.aws.dynamodb
DynamoDB implementation of Iceberg catalog
DynamoDbCatalog() - Constructor for class org.apache.iceberg.aws.dynamodb.DynamoDbCatalog
 
dynamoDbTableName() - Method in class org.apache.iceberg.aws.AwsProperties
 

F

from(Map<String, String>) - Static method in class org.apache.iceberg.aws.AwsClientFactories
 
fromLocation(String, S3Client) - Static method in class org.apache.iceberg.aws.s3.S3InputFile
 
fromLocation(String, S3Client, AwsProperties) - Static method in class org.apache.iceberg.aws.s3.S3InputFile
 
fromLocation(String, S3Client) - Static method in class org.apache.iceberg.aws.s3.S3OutputFile
 
fromLocation(String, S3Client, AwsProperties) - Static method in class org.apache.iceberg.aws.s3.S3OutputFile
 

G

getConf() - Method in class org.apache.iceberg.aws.dynamodb.DynamoDbCatalog
 
getLength() - Method in class org.apache.iceberg.aws.s3.S3InputFile
Note: this may be stale if file was deleted since metadata is cached for size/existence checks.
glue() - Method in class org.apache.iceberg.aws.AssumeRoleAwsClientFactory
 
glue() - Method in interface org.apache.iceberg.aws.AwsClientFactory
create a AWS Glue client
GLUE_CATALOG_ID - Static variable in class org.apache.iceberg.aws.AwsProperties
The ID of the Glue Data Catalog where the tables reside.
GLUE_CATALOG_SKIP_ARCHIVE - Static variable in class org.apache.iceberg.aws.AwsProperties
If Glue should skip archiving an old table version when creating a new version in a commit.
GLUE_CATALOG_SKIP_ARCHIVE_DEFAULT - Static variable in class org.apache.iceberg.aws.AwsProperties
 
GlueCatalog - Class in org.apache.iceberg.aws.glue
 
GlueCatalog() - Constructor for class org.apache.iceberg.aws.glue.GlueCatalog
No-arg constructor to load the catalog dynamically.
glueCatalogId() - Method in class org.apache.iceberg.aws.AwsProperties
 
glueCatalogSkipArchive() - Method in class org.apache.iceberg.aws.AwsProperties
 

I

initialize(Map<String, String>) - Method in class org.apache.iceberg.aws.AssumeRoleAwsClientFactory
 
initialize(Map<String, String>) - Method in interface org.apache.iceberg.aws.AwsClientFactory
Initialize AWS client factory from catalog properties.
initialize(String, Map<String, String>) - Method in class org.apache.iceberg.aws.dynamodb.DynamoDbCatalog
 
initialize(String, Map<String, String>) - Method in class org.apache.iceberg.aws.glue.GlueCatalog
 
initialize(Map<String, String>) - Method in class org.apache.iceberg.aws.s3.S3FileIO
 
isS3ChecksumEnabled() - Method in class org.apache.iceberg.aws.AwsProperties
 
isValidIdentifier(TableIdentifier) - Method in class org.apache.iceberg.aws.glue.GlueCatalog
 

K

kms() - Method in class org.apache.iceberg.aws.AssumeRoleAwsClientFactory
 
kms() - Method in interface org.apache.iceberg.aws.AwsClientFactory
Create a AWS KMS client

L

listNamespaces(Namespace) - Method in class org.apache.iceberg.aws.dynamodb.DynamoDbCatalog
 
listNamespaces(Namespace) - Method in class org.apache.iceberg.aws.glue.GlueCatalog
 
listTables(Namespace) - Method in class org.apache.iceberg.aws.dynamodb.DynamoDbCatalog
 
listTables(Namespace) - Method in class org.apache.iceberg.aws.glue.GlueCatalog
 
loadNamespaceMetadata(Namespace) - Method in class org.apache.iceberg.aws.dynamodb.DynamoDbCatalog
 
loadNamespaceMetadata(Namespace) - Method in class org.apache.iceberg.aws.glue.GlueCatalog
 

N

name() - Method in class org.apache.iceberg.aws.dynamodb.DynamoDbCatalog
 
name() - Method in class org.apache.iceberg.aws.glue.GlueCatalog
 
newInputFile(String) - Method in class org.apache.iceberg.aws.s3.S3FileIO
 
newOutputFile(String) - Method in class org.apache.iceberg.aws.s3.S3FileIO
 
newStream() - Method in class org.apache.iceberg.aws.s3.S3InputFile
 
newTableOps(TableIdentifier) - Method in class org.apache.iceberg.aws.dynamodb.DynamoDbCatalog
 
newTableOps(TableIdentifier) - Method in class org.apache.iceberg.aws.glue.GlueCatalog
 

O

org.apache.iceberg.aws - package org.apache.iceberg.aws
 
org.apache.iceberg.aws.dynamodb - package org.apache.iceberg.aws.dynamodb
 
org.apache.iceberg.aws.glue - package org.apache.iceberg.aws.glue
 
org.apache.iceberg.aws.s3 - package org.apache.iceberg.aws.s3
 

R

removeProperties(Namespace, Set<String>) - Method in class org.apache.iceberg.aws.dynamodb.DynamoDbCatalog
 
removeProperties(Namespace, Set<String>) - Method in class org.apache.iceberg.aws.glue.GlueCatalog
 
renameTable(TableIdentifier, TableIdentifier) - Method in class org.apache.iceberg.aws.dynamodb.DynamoDbCatalog
 
renameTable(TableIdentifier, TableIdentifier) - Method in class org.apache.iceberg.aws.glue.GlueCatalog
Rename table in Glue is a drop table and create table.

S

s3() - Method in class org.apache.iceberg.aws.AssumeRoleAwsClientFactory
 
s3() - Method in interface org.apache.iceberg.aws.AwsClientFactory
create a Amazon S3 client
S3_CHECKSUM_ENABLED - Static variable in class org.apache.iceberg.aws.AwsProperties
Enables eTag checks for S3 PUT and MULTIPART upload requests.
S3FileIO - Class in org.apache.iceberg.aws.s3
FileIO implementation backed by S3.
S3FileIO() - Constructor for class org.apache.iceberg.aws.s3.S3FileIO
No-arg constructor to load the FileIO dynamically.
S3FileIO(SerializableSupplier<S3Client>) - Constructor for class org.apache.iceberg.aws.s3.S3FileIO
Constructor with custom s3 supplier and default AWS properties.
S3FileIO(SerializableSupplier<S3Client>, AwsProperties) - Constructor for class org.apache.iceberg.aws.s3.S3FileIO
Constructor with custom s3 supplier and AWS properties.
S3FILEIO_ACCESS_KEY_ID - Static variable in class org.apache.iceberg.aws.AwsProperties
Configure the static access key ID used to access S3FileIO.
S3FILEIO_ACL - Static variable in class org.apache.iceberg.aws.AwsProperties
Used to configure canned access control list (ACL) for S3 client to use during write.
S3FILEIO_ENDPOINT - Static variable in class org.apache.iceberg.aws.AwsProperties
Configure an alternative endpoint of the S3 service for S3FileIO to access.
S3FILEIO_MULTIPART_SIZE - Static variable in class org.apache.iceberg.aws.AwsProperties
The size of a single part for multipart upload requests in bytes (default: 32MB).
S3FILEIO_MULTIPART_SIZE_DEFAULT - Static variable in class org.apache.iceberg.aws.AwsProperties
 
S3FILEIO_MULTIPART_SIZE_MIN - Static variable in class org.apache.iceberg.aws.AwsProperties
 
S3FILEIO_MULTIPART_THRESHOLD_FACTOR - Static variable in class org.apache.iceberg.aws.AwsProperties
The threshold expressed as a factor times the multipart size at which to switch from uploading using a single put object request to uploading using multipart upload (default: 1.5).
S3FILEIO_MULTIPART_THRESHOLD_FACTOR_DEFAULT - Static variable in class org.apache.iceberg.aws.AwsProperties
 
S3FILEIO_MULTIPART_UPLOAD_THREADS - Static variable in class org.apache.iceberg.aws.AwsProperties
Number of threads to use for uploading parts to S3 (shared pool across all output streams), default to Runtime.availableProcessors()
S3FILEIO_SECRET_ACCESS_KEY - Static variable in class org.apache.iceberg.aws.AwsProperties
Configure the static secret access key used to access S3FileIO.
S3FILEIO_SESSION_TOKEN - Static variable in class org.apache.iceberg.aws.AwsProperties
Configure the static session token used to access S3FileIO.
S3FILEIO_SSE_KEY - Static variable in class org.apache.iceberg.aws.AwsProperties
If S3 encryption type is SSE-KMS, input is a KMS Key ID or ARN.
S3FILEIO_SSE_MD5 - Static variable in class org.apache.iceberg.aws.AwsProperties
If S3 encryption type is SSE-C, input is the base-64 MD5 digest of the secret key.
S3FILEIO_SSE_TYPE - Static variable in class org.apache.iceberg.aws.AwsProperties
Type of S3 Server side encryption used, default to AwsProperties.S3FILEIO_SSE_TYPE_NONE.
S3FILEIO_SSE_TYPE_CUSTOM - Static variable in class org.apache.iceberg.aws.AwsProperties
S3 SSE-C encryption.
S3FILEIO_SSE_TYPE_KMS - Static variable in class org.apache.iceberg.aws.AwsProperties
S3 SSE-KMS encryption.
S3FILEIO_SSE_TYPE_NONE - Static variable in class org.apache.iceberg.aws.AwsProperties
No server side encryption.
S3FILEIO_SSE_TYPE_S3 - Static variable in class org.apache.iceberg.aws.AwsProperties
S3 SSE-S3 encryption.
S3FILEIO_STAGING_DIRECTORY - Static variable in class org.apache.iceberg.aws.AwsProperties
Location to put staging files for upload to S3, default to temp directory set in java.io.tmpdir.
s3FileIoAcl() - Method in class org.apache.iceberg.aws.AwsProperties
 
s3FileIoMultiPartSize() - Method in class org.apache.iceberg.aws.AwsProperties
 
s3FileIOMultipartThresholdFactor() - Method in class org.apache.iceberg.aws.AwsProperties
 
s3FileIoMultipartUploadThreads() - Method in class org.apache.iceberg.aws.AwsProperties
 
s3FileIoSseKey() - Method in class org.apache.iceberg.aws.AwsProperties
 
s3FileIoSseMd5() - Method in class org.apache.iceberg.aws.AwsProperties
 
s3FileIoSseType() - Method in class org.apache.iceberg.aws.AwsProperties
 
s3fileIoStagingDirectory() - Method in class org.apache.iceberg.aws.AwsProperties
 
S3InputFile - Class in org.apache.iceberg.aws.s3
 
S3OutputFile - Class in org.apache.iceberg.aws.s3
 
S3RequestUtil - Class in org.apache.iceberg.aws.s3
 
setConf(Configuration) - Method in class org.apache.iceberg.aws.dynamodb.DynamoDbCatalog
 
setConf(Configuration) - Method in class org.apache.iceberg.aws.glue.GlueCatalog
 
setDynamoDbTableName(String) - Method in class org.apache.iceberg.aws.AwsProperties
 
setGlueCatalogId(String) - Method in class org.apache.iceberg.aws.AwsProperties
 
setGlueCatalogSkipArchive(boolean) - Method in class org.apache.iceberg.aws.AwsProperties
 
setProperties(Namespace, Map<String, String>) - Method in class org.apache.iceberg.aws.dynamodb.DynamoDbCatalog
 
setProperties(Namespace, Map<String, String>) - Method in class org.apache.iceberg.aws.glue.GlueCatalog
 
setS3ChecksumEnabled(boolean) - Method in class org.apache.iceberg.aws.AwsProperties
 
setS3FileIoAcl(ObjectCannedACL) - Method in class org.apache.iceberg.aws.AwsProperties
 
setS3FileIoMultiPartSize(int) - Method in class org.apache.iceberg.aws.AwsProperties
 
setS3FileIoMultipartThresholdFactor(double) - Method in class org.apache.iceberg.aws.AwsProperties
 
setS3FileIoMultipartUploadThreads(int) - Method in class org.apache.iceberg.aws.AwsProperties
 
setS3FileIoSseKey(String) - Method in class org.apache.iceberg.aws.AwsProperties
 
setS3FileIoSseMd5(String) - Method in class org.apache.iceberg.aws.AwsProperties
 
setS3FileIoSseType(String) - Method in class org.apache.iceberg.aws.AwsProperties
 
setS3fileIoStagingDirectory(String) - Method in class org.apache.iceberg.aws.AwsProperties
 

T

toInputFile() - Method in class org.apache.iceberg.aws.s3.S3OutputFile
 
A C D F G I K L N O R S T 
Skip navigation links