Package | Description |
---|---|
tachyon.master | |
tachyon.thrift | |
tachyon.worker |
Worker process and utils for working with the worker remotely.
|
Modifier and Type | Method and Description |
---|---|
void |
InodeFile.addBlock(BlockInfo blockInfo)
Add a block to the file.It will check the legality.
|
boolean |
MasterServiceHandler.addCheckpoint(long workerId,
int fileId,
long fileSizeBytes,
String checkpointPath) |
boolean |
MasterInfo.addCheckpoint(long workerId,
int fileId,
long length,
TachyonURI checkpointPath)
Add a checkpoint to a file.
|
void |
InodeFile.addLocation(int blockIndex,
long workerId,
NetAddress workerAddress,
long storageDirId)
Add a location information of the file.
|
int |
MasterInfo.cacheBlock(long workerId,
long workerUsedBytes,
long storageDirId,
long blockId,
long length)
A worker cache a block in its memory.
|
int |
MasterInfo.createFile(boolean recursive,
TachyonURI path,
boolean directory,
long blockSizeByte)
Create a file.
|
int |
MasterInfo.createFile(TachyonURI path,
long blockSizeByte) |
int |
MasterInfo.createFile(TachyonURI path,
long blockSizeByte,
boolean recursive) |
List<NetAddress> |
InodeFile.getBlockLocations(int blockIndex)
Get the locations of the specified block.
|
ClientBlockInfo |
InodeFile.getClientBlockInfo(int blockIndex)
Get a ClientBlockInfo of the specified block.
|
ClientBlockInfo |
MasterInfo.getClientBlockInfo(long blockId)
Get the block info associated with the given id.
|
long |
MasterInfo.registerWorker(NetAddress workerNetAddress,
long totalBytes,
long usedBytes,
Map<Long,List<Long>> currentBlockIds)
Register a worker at the given address, setting it up and associating it with a given list of
blocks.
|
void |
InodeFile.removeLocation(int blockIndex,
long workerId)
Remove a location of a block.
|
void |
InodeFile.setLength(long length)
Set the length of the file.
|
int |
MasterServiceHandler.user_createDependency(List<String> parents,
List<String> children,
String commandPrefix,
List<ByteBuffer> data,
String comment,
String framework,
String frameworkVersion,
int dependencyType,
long childrenBlockSizeByte) |
int |
MasterServiceHandler.user_createFile(String path,
String ufsPath,
long blockSizeByte,
boolean recursive) |
ClientBlockInfo |
MasterServiceHandler.user_getClientBlockInfo(long blockId) |
void |
MasterServiceHandler.worker_cacheBlock(long workerId,
long workerUsedBytes,
long storageDirId,
long blockId,
long length) |
void |
MasterClient.worker_cacheBlock(long workerId,
long workerUsedBytes,
long storageDirId,
long blockId,
long length) |
Command |
MasterServiceHandler.worker_heartbeat(long workerId,
long usedBytes,
List<Long> removedBlockIds,
Map<Long,List<Long>> addedBlockIds) |
long |
MasterServiceHandler.worker_register(NetAddress workerNetAddress,
long totalBytes,
long usedBytes,
Map<Long,List<Long>> currentBlockIds) |
long |
MasterClient.worker_register(NetAddress workerNetAddress,
long totalBytes,
long usedBytes,
Map<Long,List<Long>> currentBlockList)
Register the worker to the master.
|
Command |
MasterInfo.workerHeartbeat(long workerId,
long usedBytes,
List<Long> removedBlockIds,
Map<Long,List<Long>> addedBlockIds)
The heartbeat of the worker.
|
Modifier and Type | Field and Description |
---|---|
BlockInfoException |
MasterService.worker_register_result.e |
BlockInfoException |
MasterService.worker_heartbeat_result.e |
BlockInfoException |
WorkerService.addCheckpoint_result.eB |
BlockInfoException |
WorkerService.cacheBlock_result.eB |
BlockInfoException |
MasterService.addCheckpoint_result.eB |
BlockInfoException |
MasterService.worker_cacheBlock_result.eB |
BlockInfoException |
MasterService.user_createDependency_result.eB |
BlockInfoException |
MasterService.user_createFile_result.eB |
BlockInfoException |
MasterService.user_getClientBlockInfo_result.eB |
Modifier and Type | Method and Description |
---|---|
BlockInfoException |
BlockInfoException.deepCopy() |
BlockInfoException |
MasterService.worker_register_result.getE() |
BlockInfoException |
MasterService.worker_heartbeat_result.getE() |
BlockInfoException |
WorkerService.addCheckpoint_result.getEB() |
BlockInfoException |
WorkerService.cacheBlock_result.getEB() |
BlockInfoException |
MasterService.addCheckpoint_result.getEB() |
BlockInfoException |
MasterService.worker_cacheBlock_result.getEB() |
BlockInfoException |
MasterService.user_createDependency_result.getEB() |
BlockInfoException |
MasterService.user_createFile_result.getEB() |
BlockInfoException |
MasterService.user_getClientBlockInfo_result.getEB() |
BlockInfoException |
BlockInfoException.setMessage(String message) |
Modifier and Type | Method and Description |
---|---|
void |
WorkerService.Iface.addCheckpoint(long userId,
int fileId) |
void |
WorkerService.Client.addCheckpoint(long userId,
int fileId) |
boolean |
MasterService.Iface.addCheckpoint(long workerId,
int fileId,
long length,
String checkpointPath) |
boolean |
MasterService.Client.addCheckpoint(long workerId,
int fileId,
long length,
String checkpointPath) |
void |
WorkerService.Iface.cacheBlock(long userId,
long blockId)
Used to cache a block into Tachyon space, worker will move the temporary block file from user
folder to data folder, and update the space usage information related.
|
void |
WorkerService.Client.cacheBlock(long userId,
long blockId) |
void |
WorkerService.AsyncClient.addCheckpoint_call.getResult() |
void |
WorkerService.AsyncClient.cacheBlock_call.getResult() |
boolean |
MasterService.AsyncClient.addCheckpoint_call.getResult() |
long |
MasterService.AsyncClient.worker_register_call.getResult() |
Command |
MasterService.AsyncClient.worker_heartbeat_call.getResult() |
void |
MasterService.AsyncClient.worker_cacheBlock_call.getResult() |
int |
MasterService.AsyncClient.user_createDependency_call.getResult() |
int |
MasterService.AsyncClient.user_createFile_call.getResult() |
ClientBlockInfo |
MasterService.AsyncClient.user_getClientBlockInfo_call.getResult() |
void |
WorkerService.Client.recv_addCheckpoint() |
boolean |
MasterService.Client.recv_addCheckpoint() |
void |
WorkerService.Client.recv_cacheBlock() |
int |
MasterService.Client.recv_user_createDependency() |
int |
MasterService.Client.recv_user_createFile() |
ClientBlockInfo |
MasterService.Client.recv_user_getClientBlockInfo() |
void |
MasterService.Client.recv_worker_cacheBlock() |
Command |
MasterService.Client.recv_worker_heartbeat() |
long |
MasterService.Client.recv_worker_register() |
int |
MasterService.Iface.user_createDependency(List<String> parents,
List<String> children,
String commandPrefix,
List<ByteBuffer> data,
String comment,
String framework,
String frameworkVersion,
int dependencyType,
long childrenBlockSizeByte) |
int |
MasterService.Client.user_createDependency(List<String> parents,
List<String> children,
String commandPrefix,
List<ByteBuffer> data,
String comment,
String framework,
String frameworkVersion,
int dependencyType,
long childrenBlockSizeByte) |
int |
MasterService.Iface.user_createFile(String path,
String ufsPath,
long blockSizeByte,
boolean recursive) |
int |
MasterService.Client.user_createFile(String path,
String ufsPath,
long blockSizeByte,
boolean recursive) |
ClientBlockInfo |
MasterService.Iface.user_getClientBlockInfo(long blockId)
Get block's ClientBlockInfo.
|
ClientBlockInfo |
MasterService.Client.user_getClientBlockInfo(long blockId) |
void |
MasterService.Iface.worker_cacheBlock(long workerId,
long workerUsedBytes,
long storageDirId,
long blockId,
long length)
Update information of the block newly cached to master, including used Tachyon space size in
bytes, the id of the storage directory in which the block is, the id of the block and the size
of the block in bytes.
|
void |
MasterService.Client.worker_cacheBlock(long workerId,
long workerUsedBytes,
long storageDirId,
long blockId,
long length) |
Command |
MasterService.Iface.worker_heartbeat(long workerId,
long usedBytes,
List<Long> removedBlockIds,
Map<Long,List<Long>> addedBlockIds)
Heart beat between worker and master, worker update used Tachyon space in bytes, removed
blocks and added blocks in each storage directory by eviction and promotion to master, and
return the command from master to worker.
|
Command |
MasterService.Client.worker_heartbeat(long workerId,
long usedBytes,
List<Long> removedBlockIds,
Map<Long,List<Long>> addedBlockIds) |
long |
MasterService.Iface.worker_register(NetAddress workerNetAddress,
long totalBytes,
long usedBytes,
Map<Long,List<Long>> currentBlocks)
Worker register and synch up capacity of Tachyon space, used space bytes and blocks in each
storage directory to master, the return value rv % 100,000 is really workerId, rv / 1000,000
is master started time.
|
long |
MasterService.Client.worker_register(NetAddress workerNetAddress,
long totalBytes,
long usedBytes,
Map<Long,List<Long>> currentBlocks) |
Modifier and Type | Method and Description |
---|---|
void |
WorkerStorage.addCheckpoint(long userId,
int fileId)
Add the checkpoint information of a file.
|
void |
WorkerServiceHandler.addCheckpoint(long userId,
int fileId) |
void |
WorkerStorage.cacheBlock(long userId,
long blockId)
Notify the worker the block is cached.
|
void |
WorkerServiceHandler.cacheBlock(long userId,
long blockId) |
Copyright © 2015. All Rights Reserved.