org.apache.iotdb.db.engine

类 StorageEngine

java.lang.Object

org.apache.iotdb.db.engine.StorageEngine

所有已实现的接口:

IService

public class StorageEngine
extends Object
implements IService

方法概要

限定符和类型	方法和说明
static void	blockInsertionIfReject(TsFileProcessor tsFileProcessor) block insertion if the insertion is rejected by memory control
VirtualStorageGroupProcessor	buildNewStorageGroupProcessor(PartialPath logicalStorageGroupName, IStorageGroupMNode storageGroupMNode, String virtualStorageGroupId) build a new storage group processor
void	closeStorageGroupProcessor(PartialPath storageGroupPath, boolean isSeq, boolean isSync)
void	closeStorageGroupProcessor(PartialPath storageGroupPath, long partitionId, boolean isSeq, boolean isSync)
static long	convertMilliWithPrecision(long milliTime)
int	countUpgradeFiles() count all Tsfiles which need to be upgraded
void	delete(PartialPath path, long startTime, long endTime, long planIndex, VirtualStorageGroupProcessor.TimePartitionFilter timePartitionFilter)
boolean	deleteAll() delete all data of storage groups' timeseries.
void	deleteAllDataFilesInOneStorageGroup(PartialPath storageGroupPath) delete all data files (both memory data and file on disk) in a storage group.
void	deleteStorageGroup(PartialPath storageGroupPath)
void	deleteTimeseries(PartialPath path, long planIndex, VirtualStorageGroupProcessor.TimePartitionFilter timePartitionFilter) delete data of timeseries "{deviceId}.
boolean	deleteTsfile(File deletedTsfile)
boolean	deleteTsfileForSync(File deletedTsfile)
void	forceCloseAllProcessor()
Map<PartialPath,Map<Long,List<TsFileResource>>>	getAllClosedStorageGroupTsFile()
static String	getDeviceNameByPlan(PhysicalPlan plan)
ServiceType	getID() Get the name of the the service.
static StorageEngine	getInstance()
List<String>	getLockInfo(List<PartialPath> pathList) get lock holder for each sg
VirtualStorageGroupProcessor	getProcessor(PartialPath path) This method is for insert and query or sth like them, this may get a virtual storage group
VirtualStorageGroupProcessor	getProcessorDirectly(PartialPath path) This method is for sync, delete tsfile or sth like them, just get storage group directly by sg name
VirtualStorageGroupProcessor	getProcessorDirectly(PartialPath path, int virtualStorageGroupId) This method is for sync, delete tsfile or sth like them, just get storage group directly by virtualStorageGroupId
Map<PartialPath,StorageGroupManager>	getProcessorMap()
void	getResourcesToBeSettled(PartialPath sgPath, List<TsFileResource> seqResourcesToBeSettled, List<TsFileResource> unseqResourcesToBeSettled, List<String> tsFilePaths)
protected void	getSeriesSchemas(InsertPlan insertPlan, VirtualStorageGroupProcessor processor)
String	getSgByEngineFile(File file, boolean needCheck) The internal file means that the file is in the engine, which is different from those external files which are not loaded.
String	getStorageGroupPath(PartialPath path)
static long	getTimePartition(long time)
static long	getTimePartitionInterval()
int	getVirtualSgIdByEngineFile(File file, boolean needCheck) The internal file means that the file is in the engine, which is different from those external files which are not loaded.
Map<String,List<Pair<Long,Boolean>>>	getWorkingStorageGroupPartitions() Get a map indicating which storage groups have working TsFileProcessors and its associated partitionId and whether it is sequence or not.
void	insert(InsertRowPlan insertRowPlan) insert an InsertRowPlan to a storage group.
void	insert(InsertRowsOfOneDevicePlan insertRowsOfOneDevicePlan)
void	insertTablet(InsertTabletPlan insertTabletPlan) insert a InsertTabletPlan to a storage group
boolean	isAllSgReady()
static boolean	isEnablePartition()
boolean	isFileAlreadyExist(TsFileResource tsFileResource, PartialPath storageGroup, long partitionNum)
static AtomicBoolean	isSecondaryAlive()
void	loadNewTsFile(TsFileResource newTsFileResource)
void	loadNewTsFileForSync(TsFileResource newTsFileResource)
void	mergeAll() merge all storage groups.
Pair<List<VirtualStorageGroupProcessor>,Map<VirtualStorageGroupProcessor,List<PartialPath>>>	mergeLock(List<PartialPath> pathList) get all merge lock of the storage group processor related to the query
void	mergeUnLock(List<VirtualStorageGroupProcessor> list) unlock all merge lock of the storage group processor related to the query
void	rebootTimedService() reboot timed flush sequence/unsequence memetable thread, timed close tsfile thread
void	recover()
void	registerCloseFileListener(CloseFileListener listener) Add a listener to listen file close events.
void	registerFlushListener(FlushListener listener) Add a listener to listen flush start/end events.
void	releaseWalDirectByteBufferPoolInOneStorageGroup(PartialPath storageGroupPath) release all the allocated non-heap
void	removePartitions(PartialPath storageGroupPath, VirtualStorageGroupProcessor.TimePartitionFilter filter)
void	reset() This function is just for unit test.
void	setAllSgReady(boolean allSgReady)
static void	setEnablePartition(boolean enablePartition)
void	setFileFlushPolicy(TsFileFlushPolicy fileFlushPolicy)
void	setPartitionVersionToMax(PartialPath storageGroup, long partitionId, long newMaxVersion) Set the version of given partition to newMaxVersion if it is larger than the current version.
void	setSettling(PartialPath sgPath, boolean isSettling)
static void	setTimePartitionInterval(long timePartitionInterval)
void	setTTL(PartialPath storageGroup, long dataTTL)
void	shutdown(long milliseconds)
void	start() Start current service.
void	stop() Stop current service.
void	syncCloseAllProcessor() flush command Sync asyncCloseOneProcessor all file node processors.
static void	transmitOperationSync(PhysicalPlan physicalPlan)
boolean	unloadTsfile(File tsfileToBeUnloaded, File targetDir)
void	upgradeAll() upgrade all storage groups.

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

从接口继承的方法 org.apache.iotdb.db.service.IService

waitAndStop

方法详细资料

getInstance

public static StorageEngine getInstance()

transmitOperationSync

public static void transmitOperationSync(PhysicalPlan physicalPlan)

convertMilliWithPrecision

public static long convertMilliWithPrecision(long milliTime)

getDeviceNameByPlan

public static String getDeviceNameByPlan(PhysicalPlan plan)

isSecondaryAlive

public static AtomicBoolean isSecondaryAlive()

getTimePartitionInterval

public static long getTimePartitionInterval()

setTimePartitionInterval

public static void setTimePartitionInterval(long timePartitionInterval)

getTimePartition

public static long getTimePartition(long time)

isEnablePartition

public static boolean isEnablePartition()

setEnablePartition

public static void setEnablePartition(boolean enablePartition)

blockInsertionIfReject

public static void blockInsertionIfReject(TsFileProcessor tsFileProcessor)
                                   throws WriteProcessRejectException

block insertion if the insertion is rejected by memory control

抛出:

WriteProcessRejectException

isAllSgReady

public boolean isAllSgReady()

setAllSgReady

public void setAllSgReady(boolean allSgReady)

recover

public void recover()

start

public void start()

从接口复制的说明: IService

Start current service.

指定者:

start 在接口中 IService

stop

public void stop()

从接口复制的说明: IService

Stop current service. If current service uses thread or thread pool, current service should guarantee to putBack thread or thread pool.

指定者:

stop 在接口中 IService

shutdown

public void shutdown(long milliseconds)
              throws ShutdownException

指定者:

shutdown 在接口中 IService

抛出:

ShutdownException

rebootTimedService

public void rebootTimedService()
                        throws ShutdownException

reboot timed flush sequence/unsequence memetable thread, timed close tsfile thread

抛出:

ShutdownException

getID

public ServiceType getID()

从接口复制的说明: IService

Get the name of the the service.

指定者:

getID 在接口中 IService

返回:

current service name

getProcessorDirectly

public VirtualStorageGroupProcessor getProcessorDirectly(PartialPath path)
                                                  throws StorageEngineException

This method is for sync, delete tsfile or sth like them, just get storage group directly by sg name

参数:

path - storage group path

返回:

storage group processor

抛出:

StorageEngineException

getProcessorDirectly

public VirtualStorageGroupProcessor getProcessorDirectly(PartialPath path,
                                                         int virtualStorageGroupId)
                                                  throws StorageEngineException

This method is for sync, delete tsfile or sth like them, just get storage group directly by virtualStorageGroupId

参数:

path - storage group path

virtualStorageGroupId - virtual storage group partition id

返回:

storage group processor

抛出:

StorageEngineException

getProcessor

public VirtualStorageGroupProcessor getProcessor(PartialPath path)
                                          throws StorageEngineException

This method is for insert and query or sth like them, this may get a virtual storage group

参数:

path - device path

返回:

storage group processor

抛出:

StorageEngineException

getLockInfo

public List<String> getLockInfo(List<PartialPath> pathList)
                         throws StorageEngineException

get lock holder for each sg

返回:

storage group processor

抛出:

StorageEngineException

buildNewStorageGroupProcessor

public VirtualStorageGroupProcessor buildNewStorageGroupProcessor(PartialPath logicalStorageGroupName,
                                                                  IStorageGroupMNode storageGroupMNode,
                                                                  String virtualStorageGroupId)
                                                           throws StorageGroupProcessorException

build a new storage group processor

参数:

virtualStorageGroupId - virtual storage group id e.g. 1

logicalStorageGroupName - logical storage group name e.g. root.sg1

抛出:

StorageGroupProcessorException

reset

public void reset()

This function is just for unit test.

insert

public void insert(InsertRowPlan insertRowPlan)
            throws StorageEngineException,
                   MetadataException

insert an InsertRowPlan to a storage group.

参数:

insertRowPlan - physical plan of insertion

抛出:

StorageEngineException

MetadataException

insert

public void insert(InsertRowsOfOneDevicePlan insertRowsOfOneDevicePlan)
            throws StorageEngineException,
                   MetadataException

抛出:

StorageEngineException

MetadataException

insertTablet

public void insertTablet(InsertTabletPlan insertTabletPlan)
                  throws StorageEngineException,
                         BatchProcessException,
                         MetadataException

insert a InsertTabletPlan to a storage group

抛出:

StorageEngineException

BatchProcessException

MetadataException

syncCloseAllProcessor

public void syncCloseAllProcessor()

flush command Sync asyncCloseOneProcessor all file node processors.

forceCloseAllProcessor

public void forceCloseAllProcessor()
                            throws TsFileProcessorException

抛出:

TsFileProcessorException

closeStorageGroupProcessor

public void closeStorageGroupProcessor(PartialPath storageGroupPath,
                                       boolean isSeq,
                                       boolean isSync)

closeStorageGroupProcessor

public void closeStorageGroupProcessor(PartialPath storageGroupPath,
                                       long partitionId,
                                       boolean isSeq,
                                       boolean isSync)
                                throws StorageGroupNotSetException

参数:

storageGroupPath - the storage group name

partitionId - the partition id

isSeq - is sequence tsfile or unsequence tsfile

isSync - close tsfile synchronously or asynchronously

抛出:

StorageGroupNotSetException

delete

public void delete(PartialPath path,
                   long startTime,
                   long endTime,
                   long planIndex,
                   VirtualStorageGroupProcessor.TimePartitionFilter timePartitionFilter)
            throws StorageEngineException

抛出:

StorageEngineException

deleteTimeseries

public void deleteTimeseries(PartialPath path,
                             long planIndex,
                             VirtualStorageGroupProcessor.TimePartitionFilter timePartitionFilter)
                      throws StorageEngineException

delete data of timeseries "{deviceId}.{measurementId}"

抛出:

StorageEngineException

countUpgradeFiles

public int countUpgradeFiles()

count all Tsfiles which need to be upgraded

返回:

total num of the tsfiles which need to be upgraded

upgradeAll

public void upgradeAll()
                throws StorageEngineException

upgrade all storage groups.

抛出:

StorageEngineException - StorageEngineException

getResourcesToBeSettled

public void getResourcesToBeSettled(PartialPath sgPath,
                                    List<TsFileResource> seqResourcesToBeSettled,
                                    List<TsFileResource> unseqResourcesToBeSettled,
                                    List<String> tsFilePaths)
                             throws StorageEngineException

抛出:

StorageEngineException

setSettling

public void setSettling(PartialPath sgPath,
                        boolean isSettling)

mergeAll

public void mergeAll()
              throws StorageEngineException

merge all storage groups.

抛出:

StorageEngineException - StorageEngineException

deleteAllDataFilesInOneStorageGroup

public void deleteAllDataFilesInOneStorageGroup(PartialPath storageGroupPath)

delete all data files (both memory data and file on disk) in a storage group. It is used when there is no timeseries (which are all deleted) in this storage group)

releaseWalDirectByteBufferPoolInOneStorageGroup

public void releaseWalDirectByteBufferPoolInOneStorageGroup(PartialPath storageGroupPath)

release all the allocated non-heap

deleteAll

public boolean deleteAll()

delete all data of storage groups' timeseries.

setTTL

public void setTTL(PartialPath storageGroup,
                   long dataTTL)

deleteStorageGroup

public void deleteStorageGroup(PartialPath storageGroupPath)

loadNewTsFileForSync

public void loadNewTsFileForSync(TsFileResource newTsFileResource)
                          throws StorageEngineException,
                                 LoadFileException,
                                 IllegalPathException

抛出:

StorageEngineException

LoadFileException

IllegalPathException

loadNewTsFile

public void loadNewTsFile(TsFileResource newTsFileResource)
                   throws LoadFileException,
                          StorageEngineException,
                          MetadataException

抛出:

LoadFileException

StorageEngineException

MetadataException

deleteTsfileForSync

public boolean deleteTsfileForSync(File deletedTsfile)
                            throws StorageEngineException,
                                   IllegalPathException

抛出:

StorageEngineException

IllegalPathException

deleteTsfile

public boolean deleteTsfile(File deletedTsfile)
                     throws StorageEngineException,
                            IllegalPathException

抛出:

StorageEngineException

IllegalPathException

unloadTsfile

public boolean unloadTsfile(File tsfileToBeUnloaded,
                            File targetDir)
                     throws StorageEngineException,
                            IllegalPathException

抛出:

StorageEngineException

IllegalPathException

getSgByEngineFile

public String getSgByEngineFile(File file,
                                boolean needCheck)
                         throws IllegalPathException

The internal file means that the file is in the engine, which is different from those external files which are not loaded.

参数:

file - internal file

needCheck - check if the tsfile is an internal TsFile. If you make sure it is inside, no need to check

返回:

sg name

抛出:

IllegalPathException - throw if tsfile is not an internal TsFile

getVirtualSgIdByEngineFile

public int getVirtualSgIdByEngineFile(File file,
                                      boolean needCheck)
                               throws IllegalPathException

The internal file means that the file is in the engine, which is different from those external files which are not loaded.

参数:

file - internal file

needCheck - check if the tsfile is an internal TsFile. If you make sure it is inside, no need to check

返回:

virtual storage group partition id

抛出:

IllegalPathException - throw if tsfile is not an internal TsFile

getAllClosedStorageGroupTsFile

public Map<PartialPath,Map<Long,List<TsFileResource>>> getAllClosedStorageGroupTsFile()

返回:

TsFiles (seq or unseq) grouped by their storage group and partition number.

setFileFlushPolicy

public void setFileFlushPolicy(TsFileFlushPolicy fileFlushPolicy)

isFileAlreadyExist

public boolean isFileAlreadyExist(TsFileResource tsFileResource,
                                  PartialPath storageGroup,
                                  long partitionNum)

setPartitionVersionToMax

public void setPartitionVersionToMax(PartialPath storageGroup,
                                     long partitionId,
                                     long newMaxVersion)

Set the version of given partition to newMaxVersion if it is larger than the current version.

removePartitions

public void removePartitions(PartialPath storageGroupPath,
                             VirtualStorageGroupProcessor.TimePartitionFilter filter)

getProcessorMap

public Map<PartialPath,StorageGroupManager> getProcessorMap()

getWorkingStorageGroupPartitions

public Map<String,List<Pair<Long,Boolean>>> getWorkingStorageGroupPartitions()

Get a map indicating which storage groups have working TsFileProcessors and its associated partitionId and whether it is sequence or not.

返回:

storage group -> a list of partitionId-isSequence pairs

registerFlushListener

public void registerFlushListener(FlushListener listener)

Add a listener to listen flush start/end events. Notice that this addition only applies to TsFileProcessors created afterwards.

参数:

listener -

registerCloseFileListener

public void registerCloseFileListener(CloseFileListener listener)

Add a listener to listen file close events. Notice that this addition only applies to TsFileProcessors created afterwards.

参数:

listener -

mergeLock

public Pair<List<VirtualStorageGroupProcessor>,Map<VirtualStorageGroupProcessor,List<PartialPath>>> mergeLock(List<PartialPath> pathList)
                                                                                                       throws StorageEngineException

get all merge lock of the storage group processor related to the query

抛出:

StorageEngineException

mergeUnLock

public void mergeUnLock(List<VirtualStorageGroupProcessor> list)

unlock all merge lock of the storage group processor related to the query

getStorageGroupPath

public String getStorageGroupPath(PartialPath path)
                           throws StorageEngineException

返回:

virtual storage group name, like root.sg1/0

抛出:

StorageEngineException

getSeriesSchemas

protected void getSeriesSchemas(InsertPlan insertPlan,
                                VirtualStorageGroupProcessor processor)
                         throws StorageEngineException,
                                MetadataException

抛出:

StorageEngineException

MetadataException