Package org.apache.beam.sdk.io.gcp.bigtable

Class BigtableRowToBeamRowFlat

  • All Implemented Interfaces:
    java.io.Serializable, org.apache.beam.sdk.transforms.display.HasDisplayData
    public class BigtableRowToBeamRowFlat
extends org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PCollection<com.google.bigtable.v2.Row>,​org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.Row>>
    Bigtable reference: .

    Requires a mapping which column family corresponds to which column

    Bigtable Row is mapped to Beam Row in the following way:

    row: key, columnFamily[] -> BEAM_ROW

    columnFamily: familyName, column[] -> not mapped directly

    column: columnQualifier, cell[] -> most recent cell

    cell: value, timestampMicros, labels -> VALUE

    Mapped Beam Row:

    BEAM_ROW: ROW

    VALUE: Beam Schema type except for ARRAY, DECIMAL, ITERABLE, MAP, ROW

    See Also:
    Serialized Form

    • Field Summary

      • Fields inherited from class org.apache.beam.sdk.transforms.PTransform

        name, resourceHints

    • Constructor Summary

      Constructors 
      Constructor Description
      BigtableRowToBeamRowFlat​(org.apache.beam.sdk.schemas.Schema schema, java.util.Map<java.lang.String,​java.util.Set<java.lang.String>> columnsMapping)  

    • Method Summary

      All Methods Instance Methods Concrete Methods 
      Modifier and Type Method Description
      org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.Row> expand​(org.apache.beam.sdk.values.PCollection<com.google.bigtable.v2.Row> input)  

      • Methods inherited from class org.apache.beam.sdk.transforms.PTransform

        compose, compose, getAdditionalInputs, getDefaultOutputCoder, getDefaultOutputCoder, getDefaultOutputCoder, getKindString, getName, getResourceHints, populateDisplayData, setResourceHints, toString, validate, validate

      • Methods inherited from class java.lang.Object

        clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

    • Constructor Detail

      • BigtableRowToBeamRowFlat

        public BigtableRowToBeamRowFlat​(org.apache.beam.sdk.schemas.Schema schema,
                                java.util.Map<java.lang.String,​java.util.Set<java.lang.String>> columnsMapping)

    • Method Detail

      • expand

        public org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.Row> expand​(org.apache.beam.sdk.values.PCollection<com.google.bigtable.v2.Row> input)
        Specified by:
        expand in class org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PCollection<com.google.bigtable.v2.Row>,​org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.Row>>