com.amazonaws.services.kinesisfirehose.model

Class ParquetSerDe

java.lang.Object

com.amazonaws.services.kinesisfirehose.model.ParquetSerDe

All Implemented Interfaces:

StructuredPojo, Serializable, Cloneable

@Generated(value="com.amazonaws:aws-java-sdk-code-generator")
public class ParquetSerDe
extends Object
implements Serializable, Cloneable, StructuredPojo

A serializer to use for converting data to the Parquet format before storing it in Amazon S3. For more information, see Apache Parquet.

See Also:

AWS API Documentation, Serialized Form

Constructor Summary

Constructors

Constructor and Description
ParquetSerDe()

Method Summary

Modifier and Type	Method and Description
ParquetSerDe	clone()
boolean	equals(Object obj)
Integer	getBlockSizeBytes() The Hadoop Distributed File System (HDFS) block size.
String	getCompression() The compression code to use over data blocks.
Boolean	getEnableDictionaryCompression() Indicates whether to enable dictionary compression.
Integer	getMaxPaddingBytes() The maximum amount of padding to apply.
Integer	getPageSizeBytes() The Parquet page size.
String	getWriterVersion() Indicates the version of row format to output.
int	hashCode()
Boolean	isEnableDictionaryCompression() Indicates whether to enable dictionary compression.
void	marshall(ProtocolMarshaller protocolMarshaller)
void	setBlockSizeBytes(Integer blockSizeBytes) The Hadoop Distributed File System (HDFS) block size.
void	setCompression(String compression) The compression code to use over data blocks.
void	setEnableDictionaryCompression(Boolean enableDictionaryCompression) Indicates whether to enable dictionary compression.
void	setMaxPaddingBytes(Integer maxPaddingBytes) The maximum amount of padding to apply.
void	setPageSizeBytes(Integer pageSizeBytes) The Parquet page size.
void	setWriterVersion(String writerVersion) Indicates the version of row format to output.
String	toString() Returns a string representation of this object.
ParquetSerDe	withBlockSizeBytes(Integer blockSizeBytes) The Hadoop Distributed File System (HDFS) block size.
ParquetSerDe	withCompression(ParquetCompression compression) The compression code to use over data blocks.
ParquetSerDe	withCompression(String compression) The compression code to use over data blocks.
ParquetSerDe	withEnableDictionaryCompression(Boolean enableDictionaryCompression) Indicates whether to enable dictionary compression.
ParquetSerDe	withMaxPaddingBytes(Integer maxPaddingBytes) The maximum amount of padding to apply.
ParquetSerDe	withPageSizeBytes(Integer pageSizeBytes) The Parquet page size.
ParquetSerDe	withWriterVersion(ParquetWriterVersion writerVersion) Indicates the version of row format to output.
ParquetSerDe	withWriterVersion(String writerVersion) Indicates the version of row format to output.

Methods inherited from class java.lang.Object

finalize, getClass, notify, notifyAll, wait, wait, wait

Constructor Detail

ParquetSerDe

public ParquetSerDe()

Method Detail

setBlockSizeBytes

public void setBlockSizeBytes(Integer blockSizeBytes)

The Hadoop Distributed File System (HDFS) block size. This is useful if you intend to copy the data from Amazon S3 to HDFS before querying. The default is 256 MiB and the minimum is 64 MiB. Kinesis Data Firehose uses this value for padding calculations.

Parameters:

blockSizeBytes - The Hadoop Distributed File System (HDFS) block size. This is useful if you intend to copy the data from Amazon S3 to HDFS before querying. The default is 256 MiB and the minimum is 64 MiB. Kinesis Data Firehose uses this value for padding calculations.

getBlockSizeBytes

public Integer getBlockSizeBytes()

The Hadoop Distributed File System (HDFS) block size. This is useful if you intend to copy the data from Amazon S3 to HDFS before querying. The default is 256 MiB and the minimum is 64 MiB. Kinesis Data Firehose uses this value for padding calculations.

Returns:

The Hadoop Distributed File System (HDFS) block size. This is useful if you intend to copy the data from Amazon S3 to HDFS before querying. The default is 256 MiB and the minimum is 64 MiB. Kinesis Data Firehose uses this value for padding calculations.

withBlockSizeBytes

public ParquetSerDe withBlockSizeBytes(Integer blockSizeBytes)

The Hadoop Distributed File System (HDFS) block size. This is useful if you intend to copy the data from Amazon S3 to HDFS before querying. The default is 256 MiB and the minimum is 64 MiB. Kinesis Data Firehose uses this value for padding calculations.

Parameters:

blockSizeBytes - The Hadoop Distributed File System (HDFS) block size. This is useful if you intend to copy the data from Amazon S3 to HDFS before querying. The default is 256 MiB and the minimum is 64 MiB. Kinesis Data Firehose uses this value for padding calculations.

Returns:

Returns a reference to this object so that method calls can be chained together.

setPageSizeBytes

public void setPageSizeBytes(Integer pageSizeBytes)

The Parquet page size. Column chunks are divided into pages. A page is conceptually an indivisible unit (in terms of compression and encoding). The minimum value is 64 KiB and the default is 1 MiB.

Parameters:

pageSizeBytes - The Parquet page size. Column chunks are divided into pages. A page is conceptually an indivisible unit (in terms of compression and encoding). The minimum value is 64 KiB and the default is 1 MiB.

getPageSizeBytes

public Integer getPageSizeBytes()

The Parquet page size. Column chunks are divided into pages. A page is conceptually an indivisible unit (in terms of compression and encoding). The minimum value is 64 KiB and the default is 1 MiB.

Returns:

The Parquet page size. Column chunks are divided into pages. A page is conceptually an indivisible unit (in terms of compression and encoding). The minimum value is 64 KiB and the default is 1 MiB.

withPageSizeBytes

public ParquetSerDe withPageSizeBytes(Integer pageSizeBytes)

The Parquet page size. Column chunks are divided into pages. A page is conceptually an indivisible unit (in terms of compression and encoding). The minimum value is 64 KiB and the default is 1 MiB.

Parameters:

pageSizeBytes - The Parquet page size. Column chunks are divided into pages. A page is conceptually an indivisible unit (in terms of compression and encoding). The minimum value is 64 KiB and the default is 1 MiB.

Returns:

Returns a reference to this object so that method calls can be chained together.

setCompression

public void setCompression(String compression)

The compression code to use over data blocks. The possible values are UNCOMPRESSED, SNAPPY, and GZIP, with the default being SNAPPY. Use SNAPPY for higher decompression speed. Use GZIP if the compression ratio is more important than speed.

Parameters:

compression - The compression code to use over data blocks. The possible values are UNCOMPRESSED, SNAPPY, and GZIP, with the default being SNAPPY. Use SNAPPY for higher decompression speed. Use GZIP if the compression ratio is more important than speed.

See Also:

ParquetCompression

getCompression

public String getCompression()

The compression code to use over data blocks. The possible values are UNCOMPRESSED, SNAPPY, and GZIP, with the default being SNAPPY. Use SNAPPY for higher decompression speed. Use GZIP if the compression ratio is more important than speed.

Returns:

The compression code to use over data blocks. The possible values are UNCOMPRESSED, SNAPPY, and GZIP, with the default being SNAPPY. Use SNAPPY for higher decompression speed. Use GZIP if the compression ratio is more important than speed.

See Also:

ParquetCompression

withCompression

public ParquetSerDe withCompression(String compression)

The compression code to use over data blocks. The possible values are UNCOMPRESSED, SNAPPY, and GZIP, with the default being SNAPPY. Use SNAPPY for higher decompression speed. Use GZIP if the compression ratio is more important than speed.

Parameters:

compression - The compression code to use over data blocks. The possible values are UNCOMPRESSED, SNAPPY, and GZIP, with the default being SNAPPY. Use SNAPPY for higher decompression speed. Use GZIP if the compression ratio is more important than speed.

Returns:

Returns a reference to this object so that method calls can be chained together.

See Also:

ParquetCompression

withCompression

public ParquetSerDe withCompression(ParquetCompression compression)

The compression code to use over data blocks. The possible values are UNCOMPRESSED, SNAPPY, and GZIP, with the default being SNAPPY. Use SNAPPY for higher decompression speed. Use GZIP if the compression ratio is more important than speed.

Parameters:

compression - The compression code to use over data blocks. The possible values are UNCOMPRESSED, SNAPPY, and GZIP, with the default being SNAPPY. Use SNAPPY for higher decompression speed. Use GZIP if the compression ratio is more important than speed.

Returns:

Returns a reference to this object so that method calls can be chained together.

See Also:

ParquetCompression

setEnableDictionaryCompression

public void setEnableDictionaryCompression(Boolean enableDictionaryCompression)

Indicates whether to enable dictionary compression.

Parameters:

enableDictionaryCompression - Indicates whether to enable dictionary compression.

getEnableDictionaryCompression

public Boolean getEnableDictionaryCompression()

Indicates whether to enable dictionary compression.

Returns:

Indicates whether to enable dictionary compression.

withEnableDictionaryCompression

public ParquetSerDe withEnableDictionaryCompression(Boolean enableDictionaryCompression)

Indicates whether to enable dictionary compression.

Parameters:

enableDictionaryCompression - Indicates whether to enable dictionary compression.

Returns:

Returns a reference to this object so that method calls can be chained together.

isEnableDictionaryCompression

public Boolean isEnableDictionaryCompression()

Indicates whether to enable dictionary compression.

Returns:

Indicates whether to enable dictionary compression.

setMaxPaddingBytes

public void setMaxPaddingBytes(Integer maxPaddingBytes)

The maximum amount of padding to apply. This is useful if you intend to copy the data from Amazon S3 to HDFS before querying. The default is 0.

Parameters:

maxPaddingBytes - The maximum amount of padding to apply. This is useful if you intend to copy the data from Amazon S3 to HDFS before querying. The default is 0.

getMaxPaddingBytes

public Integer getMaxPaddingBytes()

The maximum amount of padding to apply. This is useful if you intend to copy the data from Amazon S3 to HDFS before querying. The default is 0.

Returns:

The maximum amount of padding to apply. This is useful if you intend to copy the data from Amazon S3 to HDFS before querying. The default is 0.

withMaxPaddingBytes

public ParquetSerDe withMaxPaddingBytes(Integer maxPaddingBytes)

The maximum amount of padding to apply. This is useful if you intend to copy the data from Amazon S3 to HDFS before querying. The default is 0.

Parameters:

maxPaddingBytes - The maximum amount of padding to apply. This is useful if you intend to copy the data from Amazon S3 to HDFS before querying. The default is 0.

Returns:

Returns a reference to this object so that method calls can be chained together.

setWriterVersion

public void setWriterVersion(String writerVersion)

Indicates the version of row format to output. The possible values are V1 and V2. The default is V1.

Parameters:

writerVersion - Indicates the version of row format to output. The possible values are V1 and V2 . The default is V1.

See Also:

ParquetWriterVersion

getWriterVersion

public String getWriterVersion()

Indicates the version of row format to output. The possible values are V1 and V2. The default is V1.

Returns:

Indicates the version of row format to output. The possible values are V1 and V2. The default is V1.

See Also:

ParquetWriterVersion

withWriterVersion

public ParquetSerDe withWriterVersion(String writerVersion)

Indicates the version of row format to output. The possible values are V1 and V2. The default is V1.

Parameters:

writerVersion - Indicates the version of row format to output. The possible values are V1 and V2 . The default is V1.

Returns:

Returns a reference to this object so that method calls can be chained together.

See Also:

ParquetWriterVersion

withWriterVersion

public ParquetSerDe withWriterVersion(ParquetWriterVersion writerVersion)

Indicates the version of row format to output. The possible values are V1 and V2. The default is V1.

Parameters:

writerVersion - Indicates the version of row format to output. The possible values are V1 and V2 . The default is V1.

Returns:

Returns a reference to this object so that method calls can be chained together.

See Also:

ParquetWriterVersion

toString

public String toString()

Returns a string representation of this object. This is useful for testing and debugging. Sensitive data will be redacted from this string using a placeholder value.

Overrides:

toString in class Object

Returns:

A string representation of this object.

See Also:

Object.toString()

equals

public boolean equals(Object obj)

Overrides:

equals in class Object

hashCode

public int hashCode()

Overrides:

hashCode in class Object

clone

public ParquetSerDe clone()

Overrides:

clone in class Object

marshall

public void marshall(ProtocolMarshaller protocolMarshaller)

Specified by:

marshall in interface StructuredPojo