BigtableScioContext

Value Members

1. final def !=(arg0: Any): Boolean

   

   Definition Classes

   Any

2. final def ##(): Int

   

   Definition Classes

   Any

3. final def ==(arg0: Any): Boolean

   

   Definition Classes

   Any

4. final def asInstanceOf[T0]: T0

   

   Definition Classes

   Any

5. def bigtable(bigtableOptions: BigtableOptions, tableId: String, keyRange: ByteKeyRange, rowFilter: RowFilter): SCollection[Row]

   

   Get an SCollection for a Bigtable table.

6. def bigtable(projectId: String, instanceId: String, tableId: String, keyRange: ByteKeyRange = null, rowFilter: RowFilter = null): SCollection[Row]

   

   Get an SCollection for a Bigtable table.

7. def ensureTables(bigtableOptions: BigtableOptions, tablesAndColumnFamilies: Map[String, List[String]]): Unit

   

   Ensure that tables and column families exist.

   Ensure that tables and column families exist. Checks for existence of tables or creates them if they do not exist. Also checks for existence of column families within each table and creates them if they do not exist.

   tablesAndColumnFamilies

   A map of tables and column families. Keys are table names. Values are a list of column family names.

8. def ensureTables(projectId: String, instanceId: String, tablesAndColumnFamilies: Map[String, List[String]]): Unit

   

   Ensure that tables and column families exist.

   Ensure that tables and column families exist. Checks for existence of tables or creates them if they do not exist. Also checks for existence of column families within each table and creates them if they do not exist.

   tablesAndColumnFamilies

   A map of tables and column families. Keys are table names. Values are a list of column family names.

9. def getClass(): Class[_ <: AnyVal]

   

   Definition Classes

   AnyVal → Any

10. final def isInstanceOf[T0]: Boolean

    

    Definition Classes

    Any

11. val self: ScioContext

    

12. def toString(): String

    

    Definition Classes

    Any

13. def updateNumberOfBigtableNodes(bigtableOptions: BigtableOptions, numberOfNodes: Int, sleepDuration: Duration): Unit

    

    Updates all clusters within the specified Bigtable instance to a specified number of nodes.

    Updates all clusters within the specified Bigtable instance to a specified number of nodes. Useful for increasing the number of nodes at the beginning of a job and decreasing it at the end to lower costs yet still get high throughput during bulk ingests/dumps.

    sleepDuration

    How long to sleep after updating the number of nodes. Google recommends at least 20 minutes before the new nodes are fully functional

14. def updateNumberOfBigtableNodes(projectId: String, instanceId: String, numberOfNodes: Int, sleepDuration: Duration = DEFAULT_SLEEP_DURATION): Unit

    

    Updates all clusters within the specified Bigtable instance to a specified number of nodes.

    Updates all clusters within the specified Bigtable instance to a specified number of nodes. Useful for increasing the number of nodes at the beginning of a job and decreasing it at the end to lower costs yet still get high throughput during bulk ingests/dumps.

    sleepDuration

    How long to sleep after updating the number of nodes. Google recommends at least 20 minutes before the new nodes are fully functional