org.apache.hadoop.hbase.client

Class HTableMultiplexer

java.lang.Object

org.apache.hadoop.hbase.client.HTableMultiplexer

@InterfaceAudience.Public
@InterfaceStability.Evolving
public class HTableMultiplexer
extends Object

HTableMultiplexer provides a thread-safe non blocking PUT API across all the tables. Each put will be sharded into different buffer queues based on its destination region server. So each region server buffer queue will only have the puts which share the same destination. And each queue will have a flush worker thread to flush the puts request to the region server. If any queue is full, the HTableMultiplexer starts to drop the Put requests for that particular queue. Also all the puts will be retried as a configuration number before dropping. And the HTableMultiplexer can report the number of buffered requests and the number of the failed (dropped) requests in total or on per region server basis. This class is thread safe.

Constructor Summary

Constructors

Constructor and Description
HTableMultiplexer(org.apache.hadoop.conf.Configuration conf, int perRegionServerBufferQueueSize)

Method Summary

Methods

Modifier and Type	Method and Description
org.apache.hadoop.hbase.client.HTableMultiplexer.HTableMultiplexerStatus	getHTableMultiplexerStatus()
List<Put>	put(byte[] tableName, List<Put> puts)
boolean	put(byte[] tableName, Put put)
boolean	put(byte[] tableName, Put put, int retry)
List<Put>	put(TableName tableName, List<Put> puts) The puts request will be buffered by their corresponding buffer queue.
boolean	put(TableName tableName, Put put) The put request will be buffered by its corresponding buffer queue.
boolean	put(TableName tableName, Put put, int retry) The put request will be buffered by its corresponding buffer queue.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HTableMultiplexer

public HTableMultiplexer(org.apache.hadoop.conf.Configuration conf,
                 int perRegionServerBufferQueueSize)
                  throws ZooKeeperConnectionException

Parameters:

conf - The HBaseConfiguration

perRegionServerBufferQueueSize - determines the max number of the buffered Put ops for each region server before dropping the request.

Throws:

ZooKeeperConnectionException

Method Detail

put

public boolean put(TableName tableName,
          Put put)
            throws IOException

The put request will be buffered by its corresponding buffer queue. Return false if the queue is already full.

Parameters:

tableName -

put -

Returns:

true if the request can be accepted by its corresponding buffer queue.

Throws:

IOException

put

public boolean put(byte[] tableName,
          Put put)
            throws IOException

Throws:

IOException

put

public List<Put> put(TableName tableName,
            List<Put> puts)
              throws IOException

The puts request will be buffered by their corresponding buffer queue. Return the list of puts which could not be queued.

Parameters:

tableName -

puts -

Returns:

the list of puts which could not be queued

Throws:

IOException

put

public List<Put> put(byte[] tableName,
            List<Put> puts)
              throws IOException

Throws:

IOException

put

public boolean put(TableName tableName,
          Put put,
          int retry)
            throws IOException

The put request will be buffered by its corresponding buffer queue. And the put request will be retried before dropping the request. Return false if the queue is already full.

Parameters:

tableName -

put -

retry -

Returns:

true if the request can be accepted by its corresponding buffer queue.

Throws:

IOException

put

public boolean put(byte[] tableName,
          Put put,
          int retry)
            throws IOException

Throws:

IOException

getHTableMultiplexerStatus

public org.apache.hadoop.hbase.client.HTableMultiplexer.HTableMultiplexerStatus getHTableMultiplexerStatus()

Returns:

the current HTableMultiplexerStatus