This method takes tokenized strings and the source sentence.
This method takes tokenized strings and the source sentence. It adds offset information to the strings by tracing through the source sentence and skipping whitespace.
Rebuild the original text from tokens.
Rebuild the original text from tokens. This will maintain the original spacing, although different forms of spacing such as tabs will become standard spaces. Optional argument startOffset specifies offset at which the original text began, which is useful for controlling whitespace at beginning of the rebuilt original text string.