Package org.apache.parquet.hadoop.codec
Class CodecConfig
- java.lang.Object
-
- org.apache.parquet.hadoop.codec.CodecConfig
-
public abstract class CodecConfig extends Object
Template class and factory for accessing codec related configurations in different APIs(mapreduce or mapred), usefrom(org.apache.hadoop.mapred.JobConf)
for mapred API, usefrom(org.apache.hadoop.mapreduce.TaskAttemptContext)
for mapreduce API
-
-
Constructor Summary
Constructors Constructor Description CodecConfig()
-
Method Summary
All Methods Static Methods Instance Methods Abstract Methods Concrete Methods Modifier and Type Method Description static CodecConfig
from(org.apache.hadoop.mapred.JobConf jobConf)
use mapred api to read codec configstatic CodecConfig
from(org.apache.hadoop.mapreduce.TaskAttemptContext context)
use mapreduce api to read codec configorg.apache.parquet.hadoop.metadata.CompressionCodecName
getCodec()
abstract org.apache.hadoop.conf.Configuration
getConfiguration()
abstract Class
getHadoopOutputCompressorClass(Class defaultCodec)
static org.apache.parquet.hadoop.metadata.CompressionCodecName
getParquetCompressionCodec(org.apache.hadoop.conf.Configuration configuration)
abstract boolean
isHadoopCompressionSet()
static boolean
isParquetCompressionSet(org.apache.hadoop.conf.Configuration conf)
-
-
-
Method Detail
-
isHadoopCompressionSet
public abstract boolean isHadoopCompressionSet()
- Returns:
- if a compress flag is set from hadoop
-
getHadoopOutputCompressorClass
public abstract Class getHadoopOutputCompressorClass(Class defaultCodec)
- Parameters:
defaultCodec
- the codec to use when codec is not set in conf- Returns:
- codec specified in hadoop config
-
getConfiguration
public abstract org.apache.hadoop.conf.Configuration getConfiguration()
- Returns:
- configuration of the job
-
from
public static CodecConfig from(org.apache.hadoop.mapred.JobConf jobConf)
use mapred api to read codec config- Parameters:
jobConf
- a mapred job configuration- Returns:
- MapredCodecConfig
-
from
public static CodecConfig from(org.apache.hadoop.mapreduce.TaskAttemptContext context)
use mapreduce api to read codec config- Parameters:
context
- a mapreduce task attempt context- Returns:
- MapreduceCodecConfig
-
isParquetCompressionSet
public static boolean isParquetCompressionSet(org.apache.hadoop.conf.Configuration conf)
-
getParquetCompressionCodec
public static org.apache.parquet.hadoop.metadata.CompressionCodecName getParquetCompressionCodec(org.apache.hadoop.conf.Configuration configuration)
-
getCodec
public org.apache.parquet.hadoop.metadata.CompressionCodecName getCodec()
-
-