Package com.yahoo.vespa.hadoop.mapreduce

Class VespaRecordWriter

java.lang.Object

org.apache.hadoop.mapreduce.RecordWriter<java.lang.Object,java.lang.Object>

com.yahoo.vespa.hadoop.mapreduce.VespaRecordWriter

public class VespaRecordWriter
extends org.apache.hadoop.mapreduce.RecordWriter<java.lang.Object,java.lang.Object>

VespaRecordWriter sends the output <key, value> to one or more Vespa endpoints using vespa-feed-client.

Author:

bjorncs

Constructor Summary

Constructors

Modifier	Constructor	Description
protected	VespaRecordWriter(VespaConfiguration config, VespaCounters counters)

Method Summary

Modifier and Type	Method	Description
void	close(org.apache.hadoop.mapreduce.TaskAttemptContext context)
protected void	onFeedClientInitialization(ai.vespa.feed.client.FeedClientBuilder builder)	Override method to alter FeedClient configuration
void	write(java.lang.Object key, java.lang.Object data)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

VespaRecordWriter

protected VespaRecordWriter(VespaConfiguration config,
                            VespaCounters counters)

Method Detail

write

public void write(java.lang.Object key,
                  java.lang.Object data)
           throws java.io.IOException

Specified by:

write in class org.apache.hadoop.mapreduce.RecordWriter<java.lang.Object,java.lang.Object>

Throws:

java.io.IOException

close

public void close(org.apache.hadoop.mapreduce.TaskAttemptContext context)
           throws java.io.IOException

Specified by:

close in class org.apache.hadoop.mapreduce.RecordWriter<java.lang.Object,java.lang.Object>

Throws:

java.io.IOException

onFeedClientInitialization

protected void onFeedClientInitialization(ai.vespa.feed.client.FeedClientBuilder builder)

Override method to alter FeedClient configuration