org.elasticsearch.hadoop.mr
Class ESOutputFormat

java.lang.Object
  org.apache.hadoop.mapreduce.OutputFormat
      org.elasticsearch.hadoop.mr.ESOutputFormat

All Implemented Interfaces:

OutputFormat, ConfigurationOptions

Direct Known Subclasses:

ESHiveOutputFormat

public class ESOutputFormat
extends OutputFormat
implements OutputFormat, ConfigurationOptions

ElasticSearch OutputFormat (old and new API) for adding data to an index inside ElasticSearch.

Nested Class Summary

static class	ESOutputFormat.ESOldAPIOutputCommitter
static class	ESOutputFormat.ESOutputCommitter
protected static class	ESOutputFormat.ESRecordWriter

Field Summary

Fields inherited from interface org.elasticsearch.hadoop.cfg.ConfigurationOptions

ES_BATCH_SIZE_BYTES, ES_BATCH_SIZE_BYTES_DEFAULT, ES_BATCH_SIZE_ENTRIES, ES_BATCH_SIZE_ENTRIES_DEFAULT, ES_BATCH_WRITE_REFRESH, ES_BATCH_WRITE_REFRESH_DEFAULT, ES_HOST, ES_HOST_DEFAULT, ES_HTTP_TIMEOUT, ES_HTTP_TIMEOUT_DEFAULT, ES_INDEX_AUTO_CREATE, ES_INDEX_AUTO_CREATE_DEFAULT, ES_INDEX_READ_MISSING_AS_EMPTY, ES_INDEX_READ_MISSING_AS_EMPTY_DEFAULT, ES_PORT, ES_PORT_DEFAULT, ES_RESOURCE, ES_SCROLL_KEEPALIVE, ES_SCROLL_KEEPALIVE_DEFAULT, ES_SCROLL_SIZE, ES_SCROLL_SIZE_DEFAULT, ES_SERIALIZATION_READER_CLASS, ES_SERIALIZATION_WRITER_CLASS

Constructor Summary

ESOutputFormat()

Method Summary

void	checkOutputSpecs(FileSystem ignored, JobConf cfg)
void	checkOutputSpecs(JobContext context)
OutputCommitter	getOutputCommitter(TaskAttemptContext context)
RecordWriter	getRecordWriter(FileSystem ignored, JobConf job, String name, Progressable progress)
RecordWriter	getRecordWriter(TaskAttemptContext context)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ESOutputFormat

public ESOutputFormat()

Method Detail

getRecordWriter

public RecordWriter getRecordWriter(TaskAttemptContext context)

Specified by:

getRecordWriter in class OutputFormat

checkOutputSpecs

public void checkOutputSpecs(JobContext context)
                      throws IOException

Specified by:

checkOutputSpecs in class OutputFormat

Throws:

IOException

getOutputCommitter

public OutputCommitter getOutputCommitter(TaskAttemptContext context)

Specified by:

getOutputCommitter in class OutputFormat

getRecordWriter

public RecordWriter getRecordWriter(FileSystem ignored,
                                    JobConf job,
                                    String name,
                                    Progressable progress)

Specified by:

getRecordWriter in interface OutputFormat

checkOutputSpecs

public void checkOutputSpecs(FileSystem ignored,
                             JobConf cfg)
                      throws IOException

Specified by:

checkOutputSpecs in interface OutputFormat

Throws:

IOException