@Public public final class HadoopReduceCombineFunction<KEYIN,VALUEIN,KEYOUT,VALUEOUT> extends org.apache.flink.api.common.functions.RichGroupReduceFunction<org.apache.flink.api.java.tuple.Tuple2<KEYIN,VALUEIN>,org.apache.flink.api.java.tuple.Tuple2<KEYOUT,VALUEOUT>> implements org.apache.flink.api.common.functions.GroupCombineFunction<org.apache.flink.api.java.tuple.Tuple2<KEYIN,VALUEIN>,org.apache.flink.api.java.tuple.Tuple2<KEYIN,VALUEIN>>, org.apache.flink.api.java.typeutils.ResultTypeQueryable<org.apache.flink.api.java.tuple.Tuple2<KEYOUT,VALUEOUT>>, Serializable
Constructor and Description |
---|
HadoopReduceCombineFunction(org.apache.hadoop.mapred.Reducer<KEYIN,VALUEIN,KEYOUT,VALUEOUT> hadoopReducer,
org.apache.hadoop.mapred.Reducer<KEYIN,VALUEIN,KEYIN,VALUEIN> hadoopCombiner)
Maps two Hadoop Reducer (mapred API) to a combinable Flink GroupReduceFunction.
|
HadoopReduceCombineFunction(org.apache.hadoop.mapred.Reducer<KEYIN,VALUEIN,KEYOUT,VALUEOUT> hadoopReducer,
org.apache.hadoop.mapred.Reducer<KEYIN,VALUEIN,KEYIN,VALUEIN> hadoopCombiner,
org.apache.hadoop.mapred.JobConf conf)
Maps two Hadoop Reducer (mapred API) to a combinable Flink GroupReduceFunction.
|
Modifier and Type | Method and Description |
---|---|
void |
combine(Iterable<org.apache.flink.api.java.tuple.Tuple2<KEYIN,VALUEIN>> values,
org.apache.flink.util.Collector<org.apache.flink.api.java.tuple.Tuple2<KEYIN,VALUEIN>> out) |
org.apache.flink.api.common.typeinfo.TypeInformation<org.apache.flink.api.java.tuple.Tuple2<KEYOUT,VALUEOUT>> |
getProducedType() |
void |
open(org.apache.flink.configuration.Configuration parameters) |
void |
reduce(Iterable<org.apache.flink.api.java.tuple.Tuple2<KEYIN,VALUEIN>> values,
org.apache.flink.util.Collector<org.apache.flink.api.java.tuple.Tuple2<KEYOUT,VALUEOUT>> out) |
public HadoopReduceCombineFunction(org.apache.hadoop.mapred.Reducer<KEYIN,VALUEIN,KEYOUT,VALUEOUT> hadoopReducer, org.apache.hadoop.mapred.Reducer<KEYIN,VALUEIN,KEYIN,VALUEIN> hadoopCombiner)
hadoopReducer
- The Hadoop Reducer that is mapped to a GroupReduceFunction.hadoopCombiner
- The Hadoop Reducer that is mapped to the combiner function.public HadoopReduceCombineFunction(org.apache.hadoop.mapred.Reducer<KEYIN,VALUEIN,KEYOUT,VALUEOUT> hadoopReducer, org.apache.hadoop.mapred.Reducer<KEYIN,VALUEIN,KEYIN,VALUEIN> hadoopCombiner, org.apache.hadoop.mapred.JobConf conf)
hadoopReducer
- The Hadoop Reducer that is mapped to a GroupReduceFunction.hadoopCombiner
- The Hadoop Reducer that is mapped to the combiner function.conf
- The JobConf that is used to configure both Hadoop Reducers.public void open(org.apache.flink.configuration.Configuration parameters) throws Exception
open
in interface org.apache.flink.api.common.functions.RichFunction
open
in class org.apache.flink.api.common.functions.AbstractRichFunction
Exception
public void reduce(Iterable<org.apache.flink.api.java.tuple.Tuple2<KEYIN,VALUEIN>> values, org.apache.flink.util.Collector<org.apache.flink.api.java.tuple.Tuple2<KEYOUT,VALUEOUT>> out) throws Exception
reduce
in interface org.apache.flink.api.common.functions.GroupReduceFunction<org.apache.flink.api.java.tuple.Tuple2<KEYIN,VALUEIN>,org.apache.flink.api.java.tuple.Tuple2<KEYOUT,VALUEOUT>>
reduce
in class org.apache.flink.api.common.functions.RichGroupReduceFunction<org.apache.flink.api.java.tuple.Tuple2<KEYIN,VALUEIN>,org.apache.flink.api.java.tuple.Tuple2<KEYOUT,VALUEOUT>>
Exception
public void combine(Iterable<org.apache.flink.api.java.tuple.Tuple2<KEYIN,VALUEIN>> values, org.apache.flink.util.Collector<org.apache.flink.api.java.tuple.Tuple2<KEYIN,VALUEIN>> out) throws Exception
Copyright © 2014–2018 The Apache Software Foundation. All rights reserved.