FTToken (BaseX Core 10.6 API)

java.lang.Object
- org.basex.util.FTToken

```
public final class FTToken
extends Object
```
This class provides mapping tables for converting full-text tokens.

Author:

BaseX Team 2005-23, BSD License, Christian Gruen

Method Summary

All Methods Static Methods Concrete Methods
Modifier and Type	Method	Description
`static boolean`	`lod(int cp)`	Returns true if the specified codepoint is a valid letter, digit, or a combining mark.
`static byte[]`	`noDiacritics(byte[] token)`	Returns a token without diacritics.
`static int`	`noDiacritics(int cp)`	Returns a codepoint without diacritics.
`static boolean`	`ws(int ch)`	Returns true if the specified codepoint is whitespace.

Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

- Method Detail
  - ws
```
public static boolean ws(int ch)
```
    Returns true if the specified codepoint is whitespace.
    
    Parameters:
    
    ch - codepoint to be tested
    
    Returns:
    
    result of check
  - lod
```
public static boolean lod(int cp)
```
    Returns true if the specified codepoint is a valid letter, digit, or a combining mark.
    
    Parameters:
    
    cp - codepoint to be tested
    
    Returns:
    
    result of check
  - noDiacritics
```
public static byte[] noDiacritics(byte[] token)
```
    Returns a token without diacritics.
    
    Parameters:
    
    token - token to be normalized
    
    Returns:
    
    resulting token
  - noDiacritics
```
public static int noDiacritics(int cp)
```
    Returns a codepoint without diacritics.
    
    Parameters:
    
    cp - codepoint to be normalized
    
    Returns:
    
    resulting character