org.apache.hadoop.hbase.master.assignment

Class AssignmentManager

java.lang.Object

org.apache.hadoop.hbase.master.assignment.AssignmentManager

All Implemented Interfaces:

ServerListener

@InterfaceAudience.Private
public class AssignmentManager
extends Object
implements ServerListener

The AssignmentManager is the coordinator for region assign/unassign operations.

• In-memory states of regions and servers are stored in RegionStates.
• hbase:meta state updates are handled by RegionStateStore.

Regions are created by CreateTable, Split, Merge. Regions are deleted by DeleteTable, Split, Merge. Assigns are triggered by CreateTable, EnableTable, Split, Merge, ServerCrash. Unassigns are triggered by DisableTable, Split, Merge

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	AssignmentManager.RegionInTransitionStat

Field Summary

Fields

Modifier and Type	Field and Description
static String	ASSIGN_DISPATCH_WAIT_MSEC_CONF_KEY
static String	ASSIGN_DISPATCH_WAITQ_MAX_CONF_KEY
static String	ASSIGN_MAX_ATTEMPTS
static String	BOOTSTRAP_THREAD_POOL_SIZE_CONF_KEY
static String	METRICS_RIT_STUCK_WARNING_THRESHOLD Region in Transition metrics threshold time
static String	RIT_CHORE_INTERVAL_MSEC_CONF_KEY

Constructor Summary

Constructors

Constructor and Description
AssignmentManager(MasterServices master)
AssignmentManager(MasterServices master, RegionStateStore stateStore)

Method Summary

Modifier and Type	Method and Description
protected boolean	addRegionInTransition(RegionStates.RegionStateNode regionNode, RegionTransitionProcedure procedure)
void	assign(HRegionInfo regionInfo)
void	assign(HRegionInfo regionInfo, boolean forceNewPlan)
void	assignMeta(HRegionInfo metaRegionInfo)
void	assignMeta(HRegionInfo metaRegionInfo, ServerName serverName)
void	checkIfShouldMoveSystemRegionAsync() Start a new thread to check if there are region servers whose versions are higher than others.
void	checkOnlineRegionsReportForMeta(RegionStates.ServerStateNode serverNode, Set<byte[]> regionNames)
AssignmentManager.RegionInTransitionStat	computeRegionInTransitionStat()
AssignProcedure	createAssignProcedure(HRegionInfo regionInfo, boolean forceNewPlan)
AssignProcedure	createAssignProcedure(HRegionInfo regionInfo, ServerName targetServer)
AssignProcedure[]	createAssignProcedures(Collection<HRegionInfo> regionInfo)
AssignProcedure[]	createAssignProcedures(Collection<HRegionInfo> regionInfo, boolean forceNewPlan)
AssignProcedure[]	createAssignProcedures(TableName tableName) Called by things like EnableTableProcedure to get a list of AssignProcedure to assign the regions of the table.
MergeTableRegionsProcedure	createMergeProcedure(HRegionInfo regionToMergeA, HRegionInfo regionToMergeB)
MoveRegionProcedure	createMoveRegionProcedure(RegionPlan plan)
MoveRegionProcedure[]	createReopenProcedures(Collection<HRegionInfo> regionInfo)
MoveRegionProcedure[]	createReopenProcedures(TableName tableName) Called by things like ModifyColumnFamilyProcedure to get a list of MoveRegionProcedure to reopen the regions of the table.
SplitTableRegionProcedure	createSplitProcedure(HRegionInfo regionToSplit, byte[] splitKey)
UnassignProcedure	createUnassignProcedure(HRegionInfo regionInfo, ServerName destinationServer, boolean force)
UnassignProcedure[]	createUnassignProcedures(TableName tableName) Called by things like DisableTableProcedure to get a list of UnassignProcedure to unassign the regions of the table.
void	deleteTable(TableName tableName) Delete the region states.
List<HRegionInfo>	getAssignedRegions()
protected int	getAssignMaxAttempts()
MetricsAssignmentManager	getAssignmentManagerMetrics()
org.apache.hadoop.conf.Configuration	getConfiguration()
List<ServerName>	getExcludedServersForSystemTable() Get a list of servers that this region can not assign to.
ProcedureEvent	getFailoverCleanupEvent()
List<ServerName>	getFavoredNodes(HRegionInfo regionInfo)
HRegionInfo	getMetaRegionFromName(byte[] regionName)
Set<HRegionInfo>	getMetaRegionSet()
int	getNumRegionsOpened()
List<HRegionInfo>	getOrderedRegions(List<HRegionInfo> regions) Used when assign regions, this method will put system regions in front of user regions
HRegionInfo	getRegionInfo(byte[] regionName)
RegionNormalizer	getRegionNormalizer()
List<RegionStates.RegionStateNode>	getRegionsInTransition()
RegionStates	getRegionStates()
RegionStateStore	getRegionStateStore()
Pair<Integer,Integer>	getReopenStatus(TableName tableName) Used by the client (via master) to identify if all regions have the schema updates
int	getServerVersion(ServerName serverName)
Map<ServerName,List<HRegionInfo>>	getSnapShotOfAssignment(Collection<HRegionInfo> regions)
boolean	hasRegionsInTransition()
boolean	isCarryingMeta(ServerName serverName)
boolean	isFailoverCleanupDone() Used by ServerCrashProcedure to make sure AssignmentManager has completed the failover cleanup before re-assigning regions of dead servers.
boolean	isMetaInitialized()
boolean	isMetaLoaded()
boolean	isMetaRegion(byte[] regionName)
boolean	isMetaRegionInTransition()
boolean	isRunning()
boolean	isTableDisabled(TableName tableName)
boolean	isTableEnabled(TableName tableName)
void	joinCluster()
void	killRegionServer(RegionStates.ServerStateNode serverNode)
void	killRegionServer(ServerName serverName)
void	markRegionAsClosed(RegionStates.RegionStateNode regionNode)
void	markRegionAsClosing(RegionStates.RegionStateNode regionNode)
void	markRegionAsMerged(HRegionInfo child, ServerName serverName, HRegionInfo mother, HRegionInfo father) When called here, the merge has happened.
void	markRegionAsOpened(RegionStates.RegionStateNode regionNode)
void	markRegionAsOpening(RegionStates.RegionStateNode regionNode)
void	markRegionAsSplit(HRegionInfo parent, ServerName serverName, HRegionInfo daughterA, HRegionInfo daughterB)
Future<byte[]>	moveAsync(RegionPlan regionPlan)
void	offlineRegion(HRegionInfo regionInfo)
void	onlineRegion(HRegionInfo regionInfo, ServerName serverName)
protected void	queueAssign(RegionStates.RegionStateNode regionNode) Add the assign operation to the assignment queue.
void	registerListener(AssignmentListener listener) Add the listener to the notification list.
protected void	removeRegionInTransition(RegionStates.RegionStateNode regionNode, RegionTransitionProcedure procedure)
void	reportOnlineRegions(ServerName serverName, int versionNumber, Set<byte[]> regionNames) the master will call this method when the RS send the regionServerReport().
org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos.ReportRegionStateTransitionResponse	reportRegionStateTransition(org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos.ReportRegionStateTransitionRequest req)
void	serverAdded(ServerName serverName) The server has joined the cluster.
void	serverRemoved(ServerName serverName) The server was removed from the cluster.
void	setFailoverCleanupDone(boolean b) Used by ServerCrashProcedure tests verify the ability to suspend the execution of the ServerCrashProcedure.
void	setRegionNormalizer(RegionNormalizer normalizer)
void	setRegionStateListener(RegionStateListener listener)
void	start()
void	stop()
void	submitServerCrash(ServerName serverName, boolean shouldSplitWal)
void	unassign(HRegionInfo regionInfo)
void	unassign(HRegionInfo regionInfo, boolean forceNewPlan)
void	undoRegionAsClosing(RegionStates.RegionStateNode regionNode)
void	undoRegionAsOpening(RegionStates.RegionStateNode regionNode)
boolean	unregisterListener(AssignmentListener listener) Remove the listener from the notification list.
boolean	waitForAssignment(HRegionInfo regionInfo)
boolean	waitForAssignment(HRegionInfo regionInfo, long timeout)
boolean	waitMetaInitialized(Procedure proc)
boolean	waitMetaInitialized(Procedure proc, HRegionInfo regionInfo)
boolean	waitMetaLoaded(Procedure proc)
protected boolean	waitServerReportEvent(ServerName serverName, Procedure proc)
protected void	wakeMetaLoadedEvent()
protected void	wakeServerReportEvent(RegionStates.ServerStateNode serverNode)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hadoop.hbase.master.ServerListener

waiting

Field Detail

BOOTSTRAP_THREAD_POOL_SIZE_CONF_KEY

public static final String BOOTSTRAP_THREAD_POOL_SIZE_CONF_KEY

See Also:

Constant Field Values

ASSIGN_DISPATCH_WAIT_MSEC_CONF_KEY

public static final String ASSIGN_DISPATCH_WAIT_MSEC_CONF_KEY

See Also:

Constant Field Values

ASSIGN_DISPATCH_WAITQ_MAX_CONF_KEY

public static final String ASSIGN_DISPATCH_WAITQ_MAX_CONF_KEY

See Also:

Constant Field Values

RIT_CHORE_INTERVAL_MSEC_CONF_KEY

public static final String RIT_CHORE_INTERVAL_MSEC_CONF_KEY

See Also:

Constant Field Values

ASSIGN_MAX_ATTEMPTS

public static final String ASSIGN_MAX_ATTEMPTS

See Also:

Constant Field Values

METRICS_RIT_STUCK_WARNING_THRESHOLD

public static final String METRICS_RIT_STUCK_WARNING_THRESHOLD

Region in Transition metrics threshold time

See Also:

Constant Field Values

Constructor Detail

AssignmentManager

public AssignmentManager(MasterServices master)

AssignmentManager

public AssignmentManager(MasterServices master,
                         RegionStateStore stateStore)

Method Detail

start

public void start()
           throws IOException

Throws:

IOException

stop

public void stop()

isRunning

public boolean isRunning()

getConfiguration

public org.apache.hadoop.conf.Configuration getConfiguration()

getAssignmentManagerMetrics

public MetricsAssignmentManager getAssignmentManagerMetrics()

getAssignMaxAttempts

protected int getAssignMaxAttempts()

registerListener

public void registerListener(AssignmentListener listener)

Add the listener to the notification list.

Parameters:

listener - The AssignmentListener to register

unregisterListener

public boolean unregisterListener(AssignmentListener listener)

Remove the listener from the notification list.

Parameters:

listener - The AssignmentListener to unregister

setRegionStateListener

public void setRegionStateListener(RegionStateListener listener)

setRegionNormalizer

public void setRegionNormalizer(RegionNormalizer normalizer)

getRegionNormalizer

public RegionNormalizer getRegionNormalizer()

getRegionStates

public RegionStates getRegionStates()

getRegionStateStore

public RegionStateStore getRegionStateStore()

getFavoredNodes

public List<ServerName> getFavoredNodes(HRegionInfo regionInfo)

isTableEnabled

public boolean isTableEnabled(TableName tableName)

isTableDisabled

public boolean isTableDisabled(TableName tableName)

isMetaRegion

public boolean isMetaRegion(byte[] regionName)

getMetaRegionFromName

public HRegionInfo getMetaRegionFromName(byte[] regionName)

isCarryingMeta

public boolean isCarryingMeta(ServerName serverName)

getMetaRegionSet

public Set<HRegionInfo> getMetaRegionSet()

isMetaInitialized

public boolean isMetaInitialized()

isMetaRegionInTransition

public boolean isMetaRegionInTransition()

waitMetaInitialized

public boolean waitMetaInitialized(Procedure proc)

waitMetaInitialized

public boolean waitMetaInitialized(Procedure proc,
                                   HRegionInfo regionInfo)

waitMetaLoaded

public boolean waitMetaLoaded(Procedure proc)

wakeMetaLoadedEvent

protected void wakeMetaLoadedEvent()

isMetaLoaded

public boolean isMetaLoaded()

assignMeta

public void assignMeta(HRegionInfo metaRegionInfo)
                throws IOException

Throws:

IOException

assignMeta

public void assignMeta(HRegionInfo metaRegionInfo,
                       ServerName serverName)
                throws IOException

Throws:

IOException

checkIfShouldMoveSystemRegionAsync

public void checkIfShouldMoveSystemRegionAsync()

Start a new thread to check if there are region servers whose versions are higher than others. If so, move all system table regions to RS with the highest version to keep compatibility. The reason is, RS in new version may not be able to access RS in old version when there are some incompatible changes.

assign

public void assign(HRegionInfo regionInfo)
            throws IOException

Throws:

IOException

assign

public void assign(HRegionInfo regionInfo,
                   boolean forceNewPlan)
            throws IOException

Throws:

IOException

unassign

public void unassign(HRegionInfo regionInfo)
              throws IOException

Throws:

IOException

unassign

public void unassign(HRegionInfo regionInfo,
                     boolean forceNewPlan)
              throws IOException

Throws:

IOException

moveAsync

public Future<byte[]> moveAsync(RegionPlan regionPlan)

waitForAssignment

public boolean waitForAssignment(HRegionInfo regionInfo)
                          throws IOException

Throws:

IOException

waitForAssignment

public boolean waitForAssignment(HRegionInfo regionInfo,
                                 long timeout)
                          throws IOException

Throws:

IOException

createAssignProcedures

public AssignProcedure[] createAssignProcedures(Collection<HRegionInfo> regionInfo)

createAssignProcedures

public AssignProcedure[] createAssignProcedures(Collection<HRegionInfo> regionInfo,
                                                boolean forceNewPlan)

createReopenProcedures

public MoveRegionProcedure[] createReopenProcedures(Collection<HRegionInfo> regionInfo)

createAssignProcedures

public AssignProcedure[] createAssignProcedures(TableName tableName)

Called by things like EnableTableProcedure to get a list of AssignProcedure to assign the regions of the table.

createUnassignProcedures

public UnassignProcedure[] createUnassignProcedures(TableName tableName)

Called by things like DisableTableProcedure to get a list of UnassignProcedure to unassign the regions of the table.

createReopenProcedures

public MoveRegionProcedure[] createReopenProcedures(TableName tableName)

Called by things like ModifyColumnFamilyProcedure to get a list of MoveRegionProcedure to reopen the regions of the table.

createAssignProcedure

public AssignProcedure createAssignProcedure(HRegionInfo regionInfo,
                                             boolean forceNewPlan)

createAssignProcedure

public AssignProcedure createAssignProcedure(HRegionInfo regionInfo,
                                             ServerName targetServer)

createUnassignProcedure

public UnassignProcedure createUnassignProcedure(HRegionInfo regionInfo,
                                                 ServerName destinationServer,
                                                 boolean force)

createMoveRegionProcedure

public MoveRegionProcedure createMoveRegionProcedure(RegionPlan plan)

createSplitProcedure

public SplitTableRegionProcedure createSplitProcedure(HRegionInfo regionToSplit,
                                                      byte[] splitKey)
                                               throws IOException

Throws:

IOException

createMergeProcedure

public MergeTableRegionsProcedure createMergeProcedure(HRegionInfo regionToMergeA,
                                                       HRegionInfo regionToMergeB)
                                                throws IOException

Throws:

IOException

deleteTable

public void deleteTable(TableName tableName)
                 throws IOException

Delete the region states. This is called by "DeleteTable"

Throws:

IOException

reportRegionStateTransition

public org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos.ReportRegionStateTransitionResponse reportRegionStateTransition(org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos.ReportRegionStateTransitionRequest req)
                                                                                                                                           throws PleaseHoldException

Throws:

PleaseHoldException

reportOnlineRegions

public void reportOnlineRegions(ServerName serverName,
                                int versionNumber,
                                Set<byte[]> regionNames)
                         throws YouAreDeadException

the master will call this method when the RS send the regionServerReport(). the report will contains the "hbase version" and the "online regions". this method will check the the online regions against the in-memory state of the AM, if there is a mismatch we will try to fence out the RS with the assumption that something went wrong on the RS side.

Throws:

YouAreDeadException

checkOnlineRegionsReportForMeta

public void checkOnlineRegionsReportForMeta(RegionStates.ServerStateNode serverNode,
                                            Set<byte[]> regionNames)

waitServerReportEvent

protected boolean waitServerReportEvent(ServerName serverName,
                                        Procedure proc)

wakeServerReportEvent

protected void wakeServerReportEvent(RegionStates.ServerStateNode serverNode)

computeRegionInTransitionStat

public AssignmentManager.RegionInTransitionStat computeRegionInTransitionStat()

joinCluster

public void joinCluster()
                 throws IOException

Throws:

IOException

isFailoverCleanupDone

public boolean isFailoverCleanupDone()

Used by ServerCrashProcedure to make sure AssignmentManager has completed the failover cleanup before re-assigning regions of dead servers. So that when re-assignment happens, AssignmentManager has proper region states.

setFailoverCleanupDone

public void setFailoverCleanupDone(boolean b)

Used by ServerCrashProcedure tests verify the ability to suspend the execution of the ServerCrashProcedure.

getFailoverCleanupEvent

public ProcedureEvent getFailoverCleanupEvent()

getNumRegionsOpened

public int getNumRegionsOpened()

submitServerCrash

public void submitServerCrash(ServerName serverName,
                              boolean shouldSplitWal)

offlineRegion

public void offlineRegion(HRegionInfo regionInfo)

onlineRegion

public void onlineRegion(HRegionInfo regionInfo,
                         ServerName serverName)

getSnapShotOfAssignment

public Map<ServerName,List<HRegionInfo>> getSnapShotOfAssignment(Collection<HRegionInfo> regions)

getReopenStatus

public Pair<Integer,Integer> getReopenStatus(TableName tableName)

Used by the client (via master) to identify if all regions have the schema updates

Parameters:

tableName -

Returns:

Pair indicating the status of the alter command (pending/total)

Throws:

IOException

getOrderedRegions

public List<HRegionInfo> getOrderedRegions(List<HRegionInfo> regions)

Used when assign regions, this method will put system regions in front of user regions

Parameters:

regions -

Returns:

A list of regions with system regions at front

addRegionInTransition

protected boolean addRegionInTransition(RegionStates.RegionStateNode regionNode,
                                        RegionTransitionProcedure procedure)

removeRegionInTransition

protected void removeRegionInTransition(RegionStates.RegionStateNode regionNode,
                                        RegionTransitionProcedure procedure)

hasRegionsInTransition

public boolean hasRegionsInTransition()

getRegionsInTransition

public List<RegionStates.RegionStateNode> getRegionsInTransition()

getAssignedRegions

public List<HRegionInfo> getAssignedRegions()

getRegionInfo

public HRegionInfo getRegionInfo(byte[] regionName)

markRegionAsOpening

public void markRegionAsOpening(RegionStates.RegionStateNode regionNode)
                         throws IOException

Throws:

IOException

undoRegionAsOpening

public void undoRegionAsOpening(RegionStates.RegionStateNode regionNode)

markRegionAsOpened

public void markRegionAsOpened(RegionStates.RegionStateNode regionNode)
                        throws IOException

Throws:

IOException

markRegionAsClosing

public void markRegionAsClosing(RegionStates.RegionStateNode regionNode)
                         throws IOException

Throws:

IOException

undoRegionAsClosing

public void undoRegionAsClosing(RegionStates.RegionStateNode regionNode)

markRegionAsClosed

public void markRegionAsClosed(RegionStates.RegionStateNode regionNode)
                        throws IOException

Throws:

IOException

markRegionAsSplit

public void markRegionAsSplit(HRegionInfo parent,
                              ServerName serverName,
                              HRegionInfo daughterA,
                              HRegionInfo daughterB)
                       throws IOException

Throws:

IOException

markRegionAsMerged

public void markRegionAsMerged(HRegionInfo child,
                               ServerName serverName,
                               HRegionInfo mother,
                               HRegionInfo father)
                        throws IOException

When called here, the merge has happened. The two merged regions have been unassigned and the above markRegionClosed has been called on each so they have been disassociated from a hosting Server. The merged region will be open after this call. The merged regions are removed from hbase:meta below> Later they are deleted from the filesystem by the catalog janitor running against hbase:meta. It notices when the merged region no longer holds references to the old regions.

Throws:

IOException

queueAssign

protected void queueAssign(RegionStates.RegionStateNode regionNode)

Add the assign operation to the assignment queue. The pending assignment operation will be processed, and each region will be assigned by a server using the balancer.

getExcludedServersForSystemTable

public List<ServerName> getExcludedServersForSystemTable()

Get a list of servers that this region can not assign to. For system table, we must assign them to a server with highest version.

serverAdded

public void serverAdded(ServerName serverName)

Description copied from interface: ServerListener

The server has joined the cluster.

Specified by:

serverAdded in interface ServerListener

Parameters:

serverName - The remote servers name.

serverRemoved

public void serverRemoved(ServerName serverName)

Description copied from interface: ServerListener

The server was removed from the cluster.

Specified by:

serverRemoved in interface ServerListener

Parameters:

serverName - The remote servers name.

getServerVersion

public int getServerVersion(ServerName serverName)

killRegionServer

public void killRegionServer(ServerName serverName)

killRegionServer

public void killRegionServer(RegionStates.ServerStateNode serverNode)