Package eu.clarin.weblicht.wlfxb.tc.api
Interface TokensLayer
-
- All Superinterfaces:
TextCorpusLayer
- All Known Implementing Classes:
TokensLayerStored
public interface TokensLayer extends TextCorpusLayer
The TokensLayer is composed of token elements, each having a unique identifier and token string value. Optionally, each token can reference its start and end character offset position in relation to the character string in the text layer. The TokensLayer is the main anchor layer among layers of theTextCorpus
, i.e. all other layers (with the exception of the text layer) directly or indirectly (via other layers) reference tokens.- Author:
- Yana Panchenko and Mohammad Fazleh Elahi
-
-
Method Summary
Modifier and Type Method Description Token
addToken(String tokenString)
Token
addToken(String tokenString, long start, long end)
Token
addToken(String tokenString, long start, long end, String tokenId)
Token
addToken(String tokenString, String tokenId)
Token
addTokenWithSurfaceForm(String tokenString, String surfaceForm)
Token
addTokenWithSurfaceForm(String tokenString, String surfaceForm, Long start, Long end)
Token
addTokenWithSurfaceForm(String tokenString, String surfaceForm, Long start, Long end, String tokenId)
Token
addTokenWithSurfaceForm(String tokenString, String surfaceForm, String tokenId)
Token
addTokenWithSurfaceFormParts(String tokenString, String surfaceForm, String[] parts)
Token
addTokenWithSurfaceFormParts(String tokenString, String surfaceForm, String[] parts, Long start, Long end)
Token
addTokenWithSurfaceFormParts(String tokenString, String surfaceForm, String[] parts, Long start, Long end, String tokenId)
Token
addTokenWithSurfaceFormParts(String tokenString, String surfaceForm, String[] parts, String tokenId)
Token
getToken(int index)
Token
getToken(String tokenId)
boolean
hasCharOffsets()
-
Methods inherited from interface eu.clarin.weblicht.wlfxb.tc.api.TextCorpusLayer
isEmpty, size
-
-
-
-
Method Detail
-
getToken
Token getToken(int index)
-
hasCharOffsets
boolean hasCharOffsets()
-
addTokenWithSurfaceForm
Token addTokenWithSurfaceForm(String tokenString, String surfaceForm, String tokenId)
-
addTokenWithSurfaceForm
Token addTokenWithSurfaceForm(String tokenString, String surfaceForm, Long start, Long end)
-
addTokenWithSurfaceForm
Token addTokenWithSurfaceForm(String tokenString, String surfaceForm, Long start, Long end, String tokenId)
-
addTokenWithSurfaceFormParts
Token addTokenWithSurfaceFormParts(String tokenString, String surfaceForm, String[] parts)
-
addTokenWithSurfaceFormParts
Token addTokenWithSurfaceFormParts(String tokenString, String surfaceForm, String[] parts, String tokenId)
-
addTokenWithSurfaceFormParts
Token addTokenWithSurfaceFormParts(String tokenString, String surfaceForm, String[] parts, Long start, Long end)
-
-