|
||||||||||
| PREV PACKAGE NEXT PACKAGE | FRAMES NO FRAMES | |||||||||
| Class Summary | |
|---|---|
| DefaultTokeniser | A composed tokeniser containing a SimpleTokeniser and a
Transducer. |
| SimpleTokeniser | Implementation of a Unicode rule based tokeniser. |
| TestTokeniser | |
| Exception Summary | |
|---|---|
| InvalidRuleException | Fired when an invalid tokeniser rule is found |
| TokeniserException | The top level exception for all the exceptions fired by the tokeniser |
|
||||||||||
| PREV PACKAGE NEXT PACKAGE | FRAMES NO FRAMES | |||||||||