public class HudiRealtimeSplitConverter extends Object implements CustomSplitConverter
Modifier and Type | Field and Description |
---|---|
static String |
CUSTOM_SPLIT_CLASS_KEY |
Constructor and Description |
---|
HudiRealtimeSplitConverter() |
Modifier and Type | Method and Description |
---|---|
Optional<Map<String,String>> |
extractCustomSplitInfo(org.apache.hadoop.mapred.FileSplit split)
This method is expected to return optional.empty() if the FileSplit does not match the split converter.
|
Optional<org.apache.hadoop.mapred.FileSplit> |
recreateFileSplitWithCustomInfo(org.apache.hadoop.mapred.FileSplit split,
Map<String,String> customSplitInfo)
This method is expected to merge the customSplitInfo with split to recreate the custom FileSplit.
|
public static final String CUSTOM_SPLIT_CLASS_KEY
public Optional<Map<String,String>> extractCustomSplitInfo(org.apache.hadoop.mapred.FileSplit split)
CustomSplitConverter
extractCustomSplitInfo
in interface CustomSplitConverter
public Optional<org.apache.hadoop.mapred.FileSplit> recreateFileSplitWithCustomInfo(org.apache.hadoop.mapred.FileSplit split, Map<String,String> customSplitInfo) throws IOException
CustomSplitConverter
recreateFileSplitWithCustomInfo
in interface CustomSplitConverter
IOException
Copyright © 2012–2021. All rights reserved.