org.apache.hadoop.hdfs.server.aliasmap

Class InMemoryAliasMap

java.lang.Object

org.apache.hadoop.hdfs.server.aliasmap.InMemoryAliasMap

All Implemented Interfaces:

org.apache.hadoop.conf.Configurable, org.apache.hadoop.hdfs.server.aliasmap.InMemoryAliasMapProtocol

@InterfaceAudience.Public
 @InterfaceStability.Unstable
public class InMemoryAliasMap
extends Object
implements org.apache.hadoop.hdfs.server.aliasmap.InMemoryAliasMapProtocol, org.apache.hadoop.conf.Configurable

InMemoryAliasMap is an implementation of the InMemoryAliasMapProtocol for use with LevelDB.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static interface	InMemoryAliasMap.CheckedFunction2<T1,T2,R> CheckedFunction is akin to Function but specifies an IOException.

Nested classes/interfaces inherited from interface org.apache.hadoop.hdfs.server.aliasmap.InMemoryAliasMapProtocol

InMemoryAliasMapProtocol.IterationResult

Method Summary

Modifier and Type	Method and Description
void	close()
static org.apache.hadoop.hdfs.protocol.Block	fromBlockBytes(byte[] blockDbFormat)
static org.apache.hadoop.hdfs.protocol.ProvidedStorageLocation	fromProvidedStorageLocationBytes(byte[] providedStorageLocationDbFormat)
String	getBlockPoolId() Get the associated block pool id.
org.apache.hadoop.conf.Configuration	getConf()
static InMemoryAliasMap	init(org.apache.hadoop.conf.Configuration conf, String blockPoolID)
InMemoryAliasMapProtocol.IterationResult	list(Optional<org.apache.hadoop.hdfs.protocol.Block> marker) List the next batch of FileRegions in the alias map starting from the given marker.
Optional<org.apache.hadoop.hdfs.protocol.ProvidedStorageLocation>	read(org.apache.hadoop.hdfs.protocol.Block block) Gets the ProvidedStorageLocation associated with the specified block.
void	setConf(org.apache.hadoop.conf.Configuration conf)
static byte[]	toProtoBufBytes(org.apache.hadoop.hdfs.protocol.Block block)
static byte[]	toProtoBufBytes(org.apache.hadoop.hdfs.protocol.ProvidedStorageLocation providedStorageLocation)
void	write(org.apache.hadoop.hdfs.protocol.Block block, org.apache.hadoop.hdfs.protocol.ProvidedStorageLocation providedStorageLocation) Stores the block and it's associated ProvidedStorageLocation in the alias map.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

setConf

public void setConf(org.apache.hadoop.conf.Configuration conf)

Specified by:

setConf in interface org.apache.hadoop.conf.Configurable

getConf

public org.apache.hadoop.conf.Configuration getConf()

Specified by:

getConf in interface org.apache.hadoop.conf.Configurable

init

@Nonnull
public static InMemoryAliasMap init(org.apache.hadoop.conf.Configuration conf,
                                             String blockPoolID)
                                      throws IOException

Throws:

IOException

list

public InMemoryAliasMapProtocol.IterationResult list(Optional<org.apache.hadoop.hdfs.protocol.Block> marker)
                                              throws IOException

Description copied from interface: org.apache.hadoop.hdfs.server.aliasmap.InMemoryAliasMapProtocol

List the next batch of FileRegions in the alias map starting from the given marker. To retrieve all FileRegions stored in the alias map, multiple calls to this function might be required.

Specified by:

list in interface org.apache.hadoop.hdfs.server.aliasmap.InMemoryAliasMapProtocol

Parameters:

marker - the next block to get fileregions from.

Returns:

the InMemoryAliasMapProtocol.IterationResult with a set of FileRegions and the next marker.

Throws:

IOException

read

@Nonnull
public Optional<org.apache.hadoop.hdfs.protocol.ProvidedStorageLocation> read(@Nonnull
                                                                                       org.apache.hadoop.hdfs.protocol.Block block)
                                                                                throws IOException

Description copied from interface: org.apache.hadoop.hdfs.server.aliasmap.InMemoryAliasMapProtocol

Gets the ProvidedStorageLocation associated with the specified block.

Specified by:

read in interface org.apache.hadoop.hdfs.server.aliasmap.InMemoryAliasMapProtocol

Parameters:

block - the block to lookup

Returns:

the associated ProvidedStorageLocation.

Throws:

IOException

write

public void write(@Nonnull
                  org.apache.hadoop.hdfs.protocol.Block block,
                  @Nonnull
                  org.apache.hadoop.hdfs.protocol.ProvidedStorageLocation providedStorageLocation)
           throws IOException

Description copied from interface: org.apache.hadoop.hdfs.server.aliasmap.InMemoryAliasMapProtocol

Stores the block and it's associated ProvidedStorageLocation in the alias map.

Specified by:

write in interface org.apache.hadoop.hdfs.server.aliasmap.InMemoryAliasMapProtocol

Throws:

IOException

getBlockPoolId

public String getBlockPoolId()

Description copied from interface: org.apache.hadoop.hdfs.server.aliasmap.InMemoryAliasMapProtocol

Get the associated block pool id.

Specified by:

getBlockPoolId in interface org.apache.hadoop.hdfs.server.aliasmap.InMemoryAliasMapProtocol

Returns:

the block pool id associated with the Namenode running the in-memory alias map.

close

public void close()
           throws IOException

Throws:

IOException

fromProvidedStorageLocationBytes

@Nonnull
public static org.apache.hadoop.hdfs.protocol.ProvidedStorageLocation fromProvidedStorageLocationBytes(@Nonnull
                                                                                                                byte[] providedStorageLocationDbFormat)
                                                                                                         throws com.google.protobuf.InvalidProtocolBufferException

Throws:

com.google.protobuf.InvalidProtocolBufferException

fromBlockBytes

@Nonnull
public static org.apache.hadoop.hdfs.protocol.Block fromBlockBytes(@Nonnull
                                                                            byte[] blockDbFormat)
                                                                     throws com.google.protobuf.InvalidProtocolBufferException

Throws:

com.google.protobuf.InvalidProtocolBufferException

toProtoBufBytes

public static byte[] toProtoBufBytes(@Nonnull
                                     org.apache.hadoop.hdfs.protocol.ProvidedStorageLocation providedStorageLocation)
                              throws IOException

Throws:

IOException

toProtoBufBytes

public static byte[] toProtoBufBytes(@Nonnull
                                     org.apache.hadoop.hdfs.protocol.Block block)
                              throws IOException

Throws:

IOException