static details about the table, with custom metadata
list of region details
object that actually interacts with the physical storage
parent folder which contains folders with table names
function that generates region ids
Returns regions ids for all active regions.
Include all records between the given timestamps.
Include all records between the given timestamps.
if no data in storage layer, return None
Appends a new set of records to the audit table.
Appends a new set of records to the audit table.
Fails when is called second time on same instance.
records to append
column that returns java.sql.Timestamp that will be used for de-duplication on the primary keys
timestamp of when the append has happened. It will not be used for de-duplications
(new state of the AuditTable, count of appended records) or error
parent folder which contains folders with table names
Request optimisation of the storage layer.
Request optimisation of the storage layer.
Fails when is called second time on same instance.
timestamp of when the compaction is requested, will not be used for any filtering of the data
Maximum age of old region files kept in the .Trash folder after a compaction has happened.
the row number threshold to use for determining small regions to be compacted. Default is 50000000
a partitioner object that dictates how many partitions should be generated for a given region
Whether to recompact all regions regardless of size (i.e. ignore smallRegionRowThreshold)
new state of the AuditTable
Returns latest timestamp of records stored in the audit table.
Returns latest timestamp of records stored in the audit table.
Initializes audit table in the storage layer.
Initializes audit table in the storage layer. It will also persist all of the metadata (name, primary keys, custom meta) to the storage layer.
new state of the table or error
Each function that modifies the state of the storage layer must call this function in the first line.
Each function that modifies the state of the storage layer must call this function in the first line. As audit's table state can be modified only once.
Custom attributes assigned by the client application during table creation.
Custom attributes assigned by the client application during table creation.
function that generates region ids
list of region details
list of region details
Generates snapshot that contains only the latest records for the given timestamp.
Generates snapshot that contains only the latest records for the given timestamp. De-duplication happens on the primary keys.
use records that are closest to this timestamp
if no data in storage layer, return None
object that actually interacts with the physical storage
static details about the table, with custom metadata
Name of the table.
Name of the table.
Update the metadata for this table
Update the metadata for this table
the new metadata
new state of the AuditTable
Not thread safe.
Not thread safe. Protection against using mutator functions more than one time.
Implementation of the AuditTable which is backed up by append only block storage like HDFS.
Created by Alexei Perelighin on 2018/03/03