Parses the options for the occurs mappings.
Parses the options for the occurs mappings.
Parameters provided by spark.read.option(...)
Returns a mapping for OCCURS fields
Parses the options for the record length mappings.
Parses the options for the record length mappings.
Parameters provided by spark.read.option(...)
Returns a mapping from the record length field values to the actual record length
Parses the list of redefines and their corresponding segment ids.
Parses the list of redefines and their corresponding segment ids.
Example: For
sprak.read .option("redefine-segment-id-map:0", "COMPANY => C,D") .option("redefine-segment-id-map:1", "CONTACT => P")
The corresponding mapping will be:
"C" -> "COMPANY" "D" -> "COMPANY" "P" -> "PERSON"
Parameters provided by spark.read.option(...)
Returns a sequence of segment ids on the order of hierarchy levels
Parses the list of sergent redefine fields and their children for a hierarchical data.
Parses the list of sergent redefine fields and their children for a hierarchical data. Produces a mapping between redefined fields and their parents. Root level redefines are not added to the mapping since they don't have parents.
Example: For
spark.read .option("segment-children:0", "COMPANY => DEPT,CUSTOMER") .option("segment-children:1", "DEPT => EMPLOYEE,OFFICE")
The corresponding mapping will be:
"DEPT" -> "COMPANY" "CUSTOMER" -> "COMPANY" "EMPLOYEE" -> "DEPT" "OFFICE" -> "DEPT"
Parameters provided by spark.read.option(...)
Returns a mapping between redefined fields and their parents
This class provides methods for parsing the parameters set as Spark options.