org.apache.phoenix.mapreduce

Class JsonToKeyValueMapper

java.lang.Object

org.apache.hadoop.mapreduce.Mapper<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text,TableRowkeyPair,ImmutableBytesWritable>

org.apache.phoenix.mapreduce.FormatToBytesWritableMapper<Map<?,?>>

org.apache.phoenix.mapreduce.JsonToKeyValueMapper

public class JsonToKeyValueMapper
extends FormatToBytesWritableMapper<Map<?,?>>

MapReduce mapper that converts JSON input lines into KeyValues that can be written to HFiles.

KeyValues are produced by executing UPSERT statements on a Phoenix connection and then extracting the created KeyValues and rolling back the statement execution before it is committed to HBase.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.phoenix.mapreduce.FormatToBytesWritableMapper

FormatToBytesWritableMapper.DefaultImportPreUpsertKeyValueProcessor, FormatToBytesWritableMapper.LineParser<T>

Nested classes/interfaces inherited from class org.apache.hadoop.mapreduce.Mapper

org.apache.hadoop.mapreduce.Mapper.Context

Field Summary

Fields inherited from class org.apache.phoenix.mapreduce.FormatToBytesWritableMapper

COLUMN_INFO_CONFKEY, columnIndexes, conn, COUNTER_GROUP_NAME, IGNORE_INVALID_ROW_CONFKEY, LOGGER, LOGICAL_NAMES_CONFKEY, logicalNames, preUpdateProcessor, TABLE_NAME_CONFKEY, TABLE_NAMES_CONFKEY, tableNames, upsertExecutor, upsertListener

Constructor Summary

Constructors

Constructor and Description
JsonToKeyValueMapper()

Method Summary

Modifier and Type	Method and Description
protected UpsertExecutor<Map<?,?>,?>	buildUpsertExecutor(org.apache.hadoop.conf.Configuration conf)
protected FormatToBytesWritableMapper.LineParser<Map<?,?>>	getLineParser()
protected void	setup(org.apache.hadoop.mapreduce.Mapper.Context context)

Methods inherited from class org.apache.phoenix.mapreduce.FormatToBytesWritableMapper

cleanup, map

Methods inherited from class org.apache.hadoop.mapreduce.Mapper

run

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

JsonToKeyValueMapper

public JsonToKeyValueMapper()

Method Detail

getLineParser

protected FormatToBytesWritableMapper.LineParser<Map<?,?>> getLineParser()

Specified by:

getLineParser in class FormatToBytesWritableMapper<Map<?,?>>

setup

protected void setup(org.apache.hadoop.mapreduce.Mapper.Context context)
              throws IOException,
                     InterruptedException

Overrides:

setup in class FormatToBytesWritableMapper<Map<?,?>>

Throws:

IOException

InterruptedException

buildUpsertExecutor

protected UpsertExecutor<Map<?,?>,?> buildUpsertExecutor(org.apache.hadoop.conf.Configuration conf)

Specified by:

buildUpsertExecutor in class FormatToBytesWritableMapper<Map<?,?>>