Package org.apache.parquet.hadoop.util
Class ContextUtil
- java.lang.Object
-
- org.apache.parquet.hadoop.util.ContextUtil
-
public class ContextUtil extends Object
Utility methods to allow applications to deal with inconsistencies between MapReduce Context Objects API between hadoop-0.20 and later versions.
-
-
Constructor Summary
Constructors Constructor Description ContextUtil()
-
Method Summary
All Methods Static Methods Concrete Methods Modifier and Type Method Description static org.apache.hadoop.conf.Configuration
getConfiguration(org.apache.hadoop.mapreduce.JobContext context)
Invoke getConfiguration() method on JobContext.static org.apache.hadoop.mapreduce.Counter
getCounter(org.apache.hadoop.mapreduce.TaskAttemptContext context, String groupName, String counterName)
static boolean
hasCounterMethod(org.apache.hadoop.mapreduce.TaskAttemptContext context)
static void
incrementCounter(org.apache.hadoop.mapreduce.Counter counter, long increment)
static org.apache.hadoop.mapreduce.Counter
newGenericCounter(String name, String displayName, long value)
static org.apache.hadoop.mapreduce.JobContext
newJobContext(org.apache.hadoop.conf.Configuration conf, org.apache.hadoop.mapreduce.JobID jobId)
Creates JobContext from a JobConf and jobId using the correct constructor for based on Hadoop version.static org.apache.hadoop.mapreduce.TaskAttemptContext
newTaskAttemptContext(org.apache.hadoop.conf.Configuration conf, org.apache.hadoop.mapreduce.TaskAttemptID taskAttemptId)
Creates TaskAttemptContext from a JobConf and jobId using the correct constructor for based on Hadoop version.
-
-
-
Method Detail
-
newJobContext
public static org.apache.hadoop.mapreduce.JobContext newJobContext(org.apache.hadoop.conf.Configuration conf, org.apache.hadoop.mapreduce.JobID jobId)
Creates JobContext from a JobConf and jobId using the correct constructor for based on Hadoop version.jobId
could be null.- Parameters:
conf
- a configurationjobId
- a job id- Returns:
- a job context
-
newTaskAttemptContext
public static org.apache.hadoop.mapreduce.TaskAttemptContext newTaskAttemptContext(org.apache.hadoop.conf.Configuration conf, org.apache.hadoop.mapreduce.TaskAttemptID taskAttemptId)
Creates TaskAttemptContext from a JobConf and jobId using the correct constructor for based on Hadoop version.- Parameters:
conf
- a configurationtaskAttemptId
- a task attempt id- Returns:
- a task attempt context
-
newGenericCounter
public static org.apache.hadoop.mapreduce.Counter newGenericCounter(String name, String displayName, long value)
- Parameters:
name
- a string namedisplayName
- a string display namevalue
- an initial value- Returns:
- with Hadoop 2 :
new GenericCounter(args)
,
with Hadoop 1 :new Counter(args)
-
getConfiguration
public static org.apache.hadoop.conf.Configuration getConfiguration(org.apache.hadoop.mapreduce.JobContext context)
Invoke getConfiguration() method on JobContext. Works with both Hadoop 1 and 2.- Parameters:
context
- a job context- Returns:
- the context's configuration
-
getCounter
public static org.apache.hadoop.mapreduce.Counter getCounter(org.apache.hadoop.mapreduce.TaskAttemptContext context, String groupName, String counterName)
-
hasCounterMethod
public static boolean hasCounterMethod(org.apache.hadoop.mapreduce.TaskAttemptContext context)
-
incrementCounter
public static void incrementCounter(org.apache.hadoop.mapreduce.Counter counter, long increment)
-
-