Package com.yahoo.vespa.hadoop.mapreduce
Class VespaOutputFormat
- java.lang.Object
-
- org.apache.hadoop.mapreduce.OutputFormat
-
- com.yahoo.vespa.hadoop.mapreduce.VespaOutputFormat
-
public class VespaOutputFormat extends org.apache.hadoop.mapreduce.OutputFormat
An output specification for writing to Vespa instances in a Map-Reduce job. Mainly returns an instance of aVespaRecordWriter
that does the actual feeding to Vespa.- Author:
- lesters
-
-
Constructor Summary
Constructors Constructor Description VespaOutputFormat()
VespaOutputFormat(java.util.Properties configOverride)
-
Method Summary
All Methods Instance Methods Concrete Methods Modifier and Type Method Description void
checkOutputSpecs(org.apache.hadoop.mapreduce.JobContext jobContext)
org.apache.hadoop.mapreduce.OutputCommitter
getOutputCommitter(org.apache.hadoop.mapreduce.TaskAttemptContext taskAttemptContext)
org.apache.hadoop.mapreduce.RecordWriter
getRecordWriter(org.apache.hadoop.mapreduce.TaskAttemptContext context)
-
-
-
Method Detail
-
getRecordWriter
public org.apache.hadoop.mapreduce.RecordWriter getRecordWriter(org.apache.hadoop.mapreduce.TaskAttemptContext context) throws java.io.IOException, java.lang.InterruptedException
- Specified by:
getRecordWriter
in classorg.apache.hadoop.mapreduce.OutputFormat
- Throws:
java.io.IOException
java.lang.InterruptedException
-
getOutputCommitter
public org.apache.hadoop.mapreduce.OutputCommitter getOutputCommitter(org.apache.hadoop.mapreduce.TaskAttemptContext taskAttemptContext) throws java.io.IOException, java.lang.InterruptedException
- Specified by:
getOutputCommitter
in classorg.apache.hadoop.mapreduce.OutputFormat
- Throws:
java.io.IOException
java.lang.InterruptedException
-
checkOutputSpecs
public void checkOutputSpecs(org.apache.hadoop.mapreduce.JobContext jobContext) throws java.io.IOException, java.lang.InterruptedException
- Specified by:
checkOutputSpecs
in classorg.apache.hadoop.mapreduce.OutputFormat
- Throws:
java.io.IOException
java.lang.InterruptedException
-
-