public class BigtableRowToBeamRowFlat
extends org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PCollection<com.google.bigtable.v2.Row>,org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.Row>>
Requires a mapping which column family corresponds to which column
Bigtable Row
is mapped to Beam Row
in the following
way:
row: key, columnFamily[] -> BEAM_ROW
columnFamily: familyName, column[] -> not mapped directly
column: columnQualifier, cell[] -> most recent cell
cell: value, timestampMicros, labels -> VALUE
Mapped Beam Row
:
BEAM_ROW: ROW VALUE: Beam Schema
type except for ARRAY, DECIMAL, ITERABLE, MAP, ROW
Constructor and Description |
---|
BigtableRowToBeamRowFlat(org.apache.beam.sdk.schemas.Schema schema,
java.util.Map<java.lang.String,java.util.Set<java.lang.String>> columnsMapping) |
Modifier and Type | Method and Description |
---|---|
org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.Row> |
expand(org.apache.beam.sdk.values.PCollection<com.google.bigtable.v2.Row> input) |
public BigtableRowToBeamRowFlat(org.apache.beam.sdk.schemas.Schema schema, java.util.Map<java.lang.String,java.util.Set<java.lang.String>> columnsMapping)
public org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.Row> expand(org.apache.beam.sdk.values.PCollection<com.google.bigtable.v2.Row> input)
expand
in class org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PCollection<com.google.bigtable.v2.Row>,org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.Row>>