org.apache.hadoop.hdfs.server.datanode

Class LocalReplicaInPipeline

java.lang.Object

org.apache.hadoop.hdfs.protocol.Block

org.apache.hadoop.hdfs.server.datanode.ReplicaInfo

org.apache.hadoop.hdfs.server.datanode.LocalReplica

org.apache.hadoop.hdfs.server.datanode.LocalReplicaInPipeline

All Implemented Interfaces:

Comparable<org.apache.hadoop.hdfs.protocol.Block>, org.apache.hadoop.hdfs.server.datanode.Replica, ReplicaInPipeline, org.apache.hadoop.io.Writable, org.apache.hadoop.util.LightWeightGSet.LinkedElement

Direct Known Subclasses:

ReplicaBeingWritten

public class LocalReplicaInPipeline
extends LocalReplica
implements ReplicaInPipeline

This class defines a replica in a pipeline, which includes a persistent replica being written to by a dfs client or a temporary replica being replicated by a source datanode or being copied for the balancing purpose. The base class implements a temporary replica

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.hdfs.server.datanode.LocalReplica

LocalReplica.ReplicaDirInfo

Field Summary

Fields inherited from class org.apache.hadoop.hdfs.protocol.Block

BLOCK_FILE_PREFIX, blockFilePattern, METADATA_EXTENSION, metaFilePattern, metaOrBlockFilePattern

Constructor Summary

Constructors

Constructor and Description
LocalReplicaInPipeline(LocalReplicaInPipeline from) Copy constructor.
LocalReplicaInPipeline(long blockId, long genStamp, FsVolumeSpi vol, File dir, long bytesToReserve) Constructor for a zero length replica.

Method Summary

Modifier and Type	Method and Description
boolean	attemptToSetWriter(Thread prevWriter, Thread newWriter) Attempt to set the writer to a new value.
org.apache.hadoop.hdfs.server.protocol.ReplicaRecoveryInfo	createInfo()
OutputStream	createRestartMetaStream() Create an output stream to write restart metadata in case of datanode shutting down for quick restart.
ReplicaOutputStreams	createStreams(boolean isCreate, org.apache.hadoop.util.DataChecksum requestedChecksum) Create output streams for writing to this replica, one for block file and one for CRC file
boolean	equals(Object o)
long	getBytesAcked() Get the number of bytes acked
long	getBytesOnDisk() Get the number of bytes that have written to disk
long	getBytesReserved() Number of bytes reserved for this replica on disk.
ChunkChecksum	getLastChecksumAndDataLen() gets the last chunk checksum and the length of the block corresponding to that checksum
long	getOriginalBytesReserved() Number of bytes originally reserved for this replica.
org.apache.hadoop.hdfs.server.datanode.ReplicaInfo	getOriginalReplica()
long	getRecoveryID() Get the recovery id.
org.apache.hadoop.hdfs.server.datanode.ReplicaInfo	getReplicaInfo()
HdfsServerConstants.ReplicaState	getState() Get the replica state
long	getVisibleLength() Get the number of bytes that are visible to readers
int	hashCode()
void	interruptThread()
void	moveReplicaFrom(org.apache.hadoop.hdfs.server.datanode.ReplicaInfo oldReplicaInfo, File newBlkFile)
void	releaseAllBytesReserved() Release any disk space reserved for this replica.
void	setBytesAcked(long bytesAcked) Set the number bytes that have acked
void	setLastChecksumAndDataLen(long dataLength, byte[] checksum) store the checksum for the last chunk along with the data length
void	setRecoveryID(long recoveryId) Set the recovery id.
void	setWriter(Thread writer) Set the thread that is writing to this replica
void	stopWriter(long xceiverStopTimeout) Interrupt the writing thread and wait until it dies.
String	toString()

Methods inherited from class org.apache.hadoop.hdfs.server.datanode.LocalReplica

blockDataExists, breakHardLinksIfNeeded, bumpReplicaGS, compareWith, copyBlockdata, copyMetadata, deleteBlockData, deleteMetadata, fsyncDirectory, getBlockDataLength, getBlockFile, getBlockURI, getDataInputStream, getDataOutputStream, getDir, getMetadataInputStream, getMetadataLength, getMetadataOutputStream, getMetadataURI, getMetaFile, getPinning, getPinning, metadataExists, parseBaseDir, renameData, renameMeta, setPinning, setPinning, truncateBlock, truncateBlock, updateWithReplica

Methods inherited from class org.apache.hadoop.hdfs.server.datanode.ReplicaInfo

getFileIoProvider, getNext, getStorageUuid, getVolume, isOnTransientStorage, setNext

Methods inherited from class org.apache.hadoop.hdfs.protocol.Block

appendStringTo, compareTo, filename2id, getBlockId, getBlockId, getBlockName, getGenerationStamp, getGenerationStamp, getNumBytes, isBlockFilename, isMetaFilename, matchingIdAndGenStamp, metaToBlockFile, readFields, readId, set, setBlockId, setGenerationStamp, setNumBytes, toString, write, writeId

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Methods inherited from interface org.apache.hadoop.hdfs.server.datanode.ReplicaInPipeline

setNumBytes

Methods inherited from interface org.apache.hadoop.hdfs.server.datanode.Replica

getBlockId, getGenerationStamp, getNumBytes, getStorageUuid, isOnTransientStorage

Constructor Detail

LocalReplicaInPipeline

public LocalReplicaInPipeline(long blockId,
                              long genStamp,
                              FsVolumeSpi vol,
                              File dir,
                              long bytesToReserve)

Constructor for a zero length replica.

Parameters:

blockId - block id

genStamp - replica generation stamp

vol - volume where replica is located

dir - directory path where block and meta files are located

bytesToReserve - disk space to reserve for this replica, based on the estimated maximum block length.

LocalReplicaInPipeline

public LocalReplicaInPipeline(LocalReplicaInPipeline from)

Copy constructor.

Parameters:

from - where to copy from

Method Detail

getVisibleLength

public long getVisibleLength()

Description copied from interface: org.apache.hadoop.hdfs.server.datanode.Replica

Get the number of bytes that are visible to readers

Specified by:

getVisibleLength in interface org.apache.hadoop.hdfs.server.datanode.Replica

Returns:

the number of bytes that are visible to readers

getState

public HdfsServerConstants.ReplicaState getState()

Description copied from interface: org.apache.hadoop.hdfs.server.datanode.Replica

Get the replica state

Specified by:

getState in interface org.apache.hadoop.hdfs.server.datanode.Replica

Returns:

the replica state

getBytesAcked

public long getBytesAcked()

Description copied from interface: ReplicaInPipeline

Get the number of bytes acked

Specified by:

getBytesAcked in interface ReplicaInPipeline

Returns:

the number of bytes acked

setBytesAcked

public void setBytesAcked(long bytesAcked)

Description copied from interface: ReplicaInPipeline

Set the number bytes that have acked

Specified by:

setBytesAcked in interface ReplicaInPipeline

Parameters:

bytesAcked - number bytes acked

getBytesOnDisk

public long getBytesOnDisk()

Description copied from interface: org.apache.hadoop.hdfs.server.datanode.Replica

Get the number of bytes that have written to disk

Specified by:

getBytesOnDisk in interface org.apache.hadoop.hdfs.server.datanode.Replica

Returns:

the number of bytes that have written to disk

getBytesReserved

public long getBytesReserved()

Description copied from class: org.apache.hadoop.hdfs.server.datanode.ReplicaInfo

Number of bytes reserved for this replica on disk.

Overrides:

getBytesReserved in class org.apache.hadoop.hdfs.server.datanode.ReplicaInfo

getOriginalBytesReserved

public long getOriginalBytesReserved()

Description copied from class: org.apache.hadoop.hdfs.server.datanode.ReplicaInfo

Number of bytes originally reserved for this replica. The actual reservation is adjusted as data is written to disk.

Overrides:

getOriginalBytesReserved in class org.apache.hadoop.hdfs.server.datanode.ReplicaInfo

Returns:

the number of bytes originally reserved for this replica.

releaseAllBytesReserved

public void releaseAllBytesReserved()

Description copied from interface: ReplicaInPipeline

Release any disk space reserved for this replica.

Specified by:

releaseAllBytesReserved in interface ReplicaInPipeline

setLastChecksumAndDataLen

public void setLastChecksumAndDataLen(long dataLength,
                                      byte[] checksum)

Description copied from interface: ReplicaInPipeline

store the checksum for the last chunk along with the data length

Specified by:

setLastChecksumAndDataLen in interface ReplicaInPipeline

Parameters:

dataLength - number of bytes on disk

checksum - - checksum bytes for the last chunk

getLastChecksumAndDataLen

public ChunkChecksum getLastChecksumAndDataLen()

Description copied from interface: ReplicaInPipeline

gets the last chunk checksum and the length of the block corresponding to that checksum

Specified by:

getLastChecksumAndDataLen in interface ReplicaInPipeline

setWriter

public void setWriter(Thread writer)

Description copied from interface: ReplicaInPipeline

Set the thread that is writing to this replica

Specified by:

setWriter in interface ReplicaInPipeline

Parameters:

writer - a thread writing to this replica

interruptThread

public void interruptThread()

Specified by:

interruptThread in interface ReplicaInPipeline

equals

public boolean equals(Object o)

Overrides:

equals in class org.apache.hadoop.hdfs.protocol.Block

attemptToSetWriter

public boolean attemptToSetWriter(Thread prevWriter,
                                  Thread newWriter)

Attempt to set the writer to a new value.

Specified by:

attemptToSetWriter in interface ReplicaInPipeline

stopWriter

public void stopWriter(long xceiverStopTimeout)
                throws IOException

Interrupt the writing thread and wait until it dies.

Specified by:

stopWriter in interface ReplicaInPipeline

Throws:

IOException - the waiting is interrupted

hashCode

public int hashCode()

Overrides:

hashCode in class org.apache.hadoop.hdfs.protocol.Block

createStreams

public ReplicaOutputStreams createStreams(boolean isCreate,
                                          org.apache.hadoop.util.DataChecksum requestedChecksum)
                                   throws IOException

Description copied from interface: ReplicaInPipeline

Create output streams for writing to this replica, one for block file and one for CRC file

Specified by:

createStreams in interface ReplicaInPipeline

Parameters:

isCreate - if it is for creation

requestedChecksum - the checksum the writer would prefer to use

Returns:

output streams for writing

Throws:

IOException - if any error occurs

createRestartMetaStream

public OutputStream createRestartMetaStream()
                                     throws IOException

Description copied from interface: ReplicaInPipeline

Create an output stream to write restart metadata in case of datanode shutting down for quick restart.

Specified by:

createRestartMetaStream in interface ReplicaInPipeline

Returns:

output stream for writing.

Throws:

IOException - if any error occurs

toString

public String toString()

Overrides:

toString in class org.apache.hadoop.hdfs.server.datanode.ReplicaInfo

getOriginalReplica

public org.apache.hadoop.hdfs.server.datanode.ReplicaInfo getOriginalReplica()

Specified by:

getOriginalReplica in class org.apache.hadoop.hdfs.server.datanode.ReplicaInfo

getRecoveryID

public long getRecoveryID()

Description copied from class: org.apache.hadoop.hdfs.server.datanode.ReplicaInfo

Get the recovery id.

Specified by:

getRecoveryID in class org.apache.hadoop.hdfs.server.datanode.ReplicaInfo

Returns:

the generation stamp that the replica will be bumped to

setRecoveryID

public void setRecoveryID(long recoveryId)

Description copied from class: org.apache.hadoop.hdfs.server.datanode.ReplicaInfo

Set the recovery id.

Specified by:

setRecoveryID in class org.apache.hadoop.hdfs.server.datanode.ReplicaInfo

Parameters:

recoveryId - the new recoveryId

createInfo

public org.apache.hadoop.hdfs.server.protocol.ReplicaRecoveryInfo createInfo()

Specified by:

createInfo in class org.apache.hadoop.hdfs.server.datanode.ReplicaInfo

moveReplicaFrom

public void moveReplicaFrom(org.apache.hadoop.hdfs.server.datanode.ReplicaInfo oldReplicaInfo,
                            File newBlkFile)
                     throws IOException

Throws:

IOException

getReplicaInfo

public org.apache.hadoop.hdfs.server.datanode.ReplicaInfo getReplicaInfo()

Specified by:

getReplicaInfo in interface ReplicaInPipeline