org.apache.hadoop.hbase.mapreduce
Class MultiTableSnapshotInputFormatImpl

java.lang.Object
  org.apache.hadoop.hbase.mapreduce.MultiTableSnapshotInputFormatImpl

@InterfaceAudience.LimitedPrivate(value="HBase")
@InterfaceStability.Evolving
public class MultiTableSnapshotInputFormatImpl
extends Object

Shared implementation of mapreduce code over multiple table snapshots. Utilized by both mapreduce (.MultiTableSnapshotInputFormat and mapred (MultiTableSnapshotInputFormat implementations.

Field Summary

static String	RESTORE_DIRS_KEY
static String	SNAPSHOT_TO_SCANS_KEY

Constructor Summary

MultiTableSnapshotInputFormatImpl()

Method Summary

Map<String,org.apache.hadoop.fs.Path>	getSnapshotDirs(org.apache.hadoop.conf.Configuration conf) Retrieve the directories into which snapshots have been restored from (RESTORE_DIRS_KEY)
Map<String,Collection<Scan>>	getSnapshotsToScans(org.apache.hadoop.conf.Configuration conf) Retrieve the snapshot name -> list mapping pushed to configuration by setSnapshotToScans(org.apache.hadoop.conf.Configuration, java.util.Map)
List<TableSnapshotInputFormatImpl.InputSplit>	getSplits(org.apache.hadoop.conf.Configuration conf) Return the list of splits extracted from the scans/snapshots pushed to conf by setInput(org.apache.hadoop.conf.Configuration, java.util.Map, org.apache.hadoop.fs.Path)
void	restoreSnapshots(org.apache.hadoop.conf.Configuration conf, Map<String,org.apache.hadoop.fs.Path> snapshotToDir, org.apache.hadoop.fs.FileSystem fs) Restore each (snapshot name, restore directory) pair in snapshotToDir
void	setInput(org.apache.hadoop.conf.Configuration conf, Map<String,Collection<Scan>> snapshotScans, org.apache.hadoop.fs.Path restoreDir) Configure conf to read from snapshotScans, with snapshots restored to a subdirectory of restoreDir.
void	setSnapshotDirs(org.apache.hadoop.conf.Configuration conf, Map<String,org.apache.hadoop.fs.Path> snapshotDirs)
void	setSnapshotToScans(org.apache.hadoop.conf.Configuration conf, Map<String,Collection<Scan>> snapshotScans) Push snapshotScans to conf (under the key SNAPSHOT_TO_SCANS_KEY)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

RESTORE_DIRS_KEY

public static final String RESTORE_DIRS_KEY

See Also:

Constant Field Values

SNAPSHOT_TO_SCANS_KEY

public static final String SNAPSHOT_TO_SCANS_KEY

See Also:

Constant Field Values

Constructor Detail

MultiTableSnapshotInputFormatImpl

public MultiTableSnapshotInputFormatImpl()

Method Detail

setInput

public void setInput(org.apache.hadoop.conf.Configuration conf,
                     Map<String,Collection<Scan>> snapshotScans,
                     org.apache.hadoop.fs.Path restoreDir)
              throws IOException

Configure conf to read from snapshotScans, with snapshots restored to a subdirectory of restoreDir. Sets: RESTORE_DIRS_KEY, SNAPSHOT_TO_SCANS_KEY

Parameters:

conf -

snapshotScans -

restoreDir -

Throws:

IOException

getSplits

public List<TableSnapshotInputFormatImpl.InputSplit> getSplits(org.apache.hadoop.conf.Configuration conf)
                                                        throws IOException

Return the list of splits extracted from the scans/snapshots pushed to conf by setInput(org.apache.hadoop.conf.Configuration, java.util.Map, org.apache.hadoop.fs.Path)

Parameters:

conf - Configuration to determine splits from

Returns:

Return the list of splits extracted from the scans/snapshots pushed to conf

Throws:

IOException

getSnapshotsToScans

public Map<String,Collection<Scan>> getSnapshotsToScans(org.apache.hadoop.conf.Configuration conf)
                                                 throws IOException

Retrieve the snapshot name -> list mapping pushed to configuration by setSnapshotToScans(org.apache.hadoop.conf.Configuration, java.util.Map)

Parameters:

conf - Configuration to extract name -> list mappings from.

Returns:

the snapshot name -> list mapping pushed to configuration

Throws:

IOException

setSnapshotToScans

public void setSnapshotToScans(org.apache.hadoop.conf.Configuration conf,
                               Map<String,Collection<Scan>> snapshotScans)
                        throws IOException

Push snapshotScans to conf (under the key SNAPSHOT_TO_SCANS_KEY)

Parameters:

conf -

snapshotScans -

Throws:

IOException

getSnapshotDirs

public Map<String,org.apache.hadoop.fs.Path> getSnapshotDirs(org.apache.hadoop.conf.Configuration conf)
                                                      throws IOException

Retrieve the directories into which snapshots have been restored from (RESTORE_DIRS_KEY)

Parameters:

conf - Configuration to extract restore directories from

Returns:

the directories into which snapshots have been restored from

Throws:

IOException

setSnapshotDirs

public void setSnapshotDirs(org.apache.hadoop.conf.Configuration conf,
                            Map<String,org.apache.hadoop.fs.Path> snapshotDirs)

restoreSnapshots

public void restoreSnapshots(org.apache.hadoop.conf.Configuration conf,
                             Map<String,org.apache.hadoop.fs.Path> snapshotToDir,
                             org.apache.hadoop.fs.FileSystem fs)
                      throws IOException

Restore each (snapshot name, restore directory) pair in snapshotToDir

Parameters:

conf - configuration to restore with

snapshotToDir - mapping from snapshot names to restore directories

fs - filesystem to do snapshot restoration on

Throws:

IOException