Package com.yahoo.vespa.hadoop.mapreduce

Class VespaOutputCommitter

java.lang.Object
org.apache.hadoop.mapreduce.OutputCommitter
com.yahoo.vespa.hadoop.mapreduce.VespaOutputCommitter
public class VespaOutputCommitter extends org.apache.hadoop.mapreduce.OutputCommitter
The output committer describes the commit task output for a Map-Reduce job. Not currently used, but is part of the Hadoop protocol since 2.7.
Author:
lesters

  • Constructor Summary

    Constructors
    Constructor
    Description
    VespaOutputCommitter()
     

  • Method Summary

    Modifier and Type
    Method
    Description
    void
    abortTask(org.apache.hadoop.mapreduce.TaskAttemptContext taskAttemptContext)
     
    void
    commitTask(org.apache.hadoop.mapreduce.TaskAttemptContext taskAttemptContext)
     
    boolean
    needsTaskCommit(org.apache.hadoop.mapreduce.TaskAttemptContext taskAttemptContext)
     
    void
    setupJob(org.apache.hadoop.mapreduce.JobContext jobContext)
     
    void
    setupTask(org.apache.hadoop.mapreduce.TaskAttemptContext taskAttemptContext)
     

    Methods inherited from class org.apache.hadoop.mapreduce.OutputCommitter

    abortJob, cleanupJob, commitJob, isCommitJobRepeatable, isRecoverySupported, isRecoverySupported, recoverTask

    Methods inherited from class java.lang.Object

    clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

  • Constructor Details

    • VespaOutputCommitter

      public VespaOutputCommitter()

  • Method Details

    • setupJob

      public void setupJob(org.apache.hadoop.mapreduce.JobContext jobContext) throws IOException
      Specified by:
      setupJob in class org.apache.hadoop.mapreduce.OutputCommitter
      Throws:
      IOException

    • setupTask

      public void setupTask(org.apache.hadoop.mapreduce.TaskAttemptContext taskAttemptContext) throws IOException
      Specified by:
      setupTask in class org.apache.hadoop.mapreduce.OutputCommitter
      Throws:
      IOException

    • needsTaskCommit

      public boolean needsTaskCommit(org.apache.hadoop.mapreduce.TaskAttemptContext taskAttemptContext) throws IOException
      Specified by:
      needsTaskCommit in class org.apache.hadoop.mapreduce.OutputCommitter
      Throws:
      IOException

    • commitTask

      public void commitTask(org.apache.hadoop.mapreduce.TaskAttemptContext taskAttemptContext) throws IOException
      Specified by:
      commitTask in class org.apache.hadoop.mapreduce.OutputCommitter
      Throws:
      IOException

    • abortTask

      public void abortTask(org.apache.hadoop.mapreduce.TaskAttemptContext taskAttemptContext) throws IOException
      Specified by:
      abortTask in class org.apache.hadoop.mapreduce.OutputCommitter
      Throws:
      IOException