com.yahoo.prelude.query.parser

Class SpecialTokens

java.lang.Object

com.yahoo.prelude.query.parser.SpecialTokens

public class SpecialTokens
extends Object

A list of special tokens - string that should be threated as word no matter what they contain. Special tokens are case insensitive.

Author:

bratseth

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	SpecialTokens.SpecialToken An immutable special token

Field Summary

Fields

Modifier and Type	Field and Description
private int	currentMaximumLength
private boolean	frozen
private static Logger	log
private String	name
private List<SpecialTokens.SpecialToken>	specialTokens

Constructor Summary

Constructors

Constructor and Description
SpecialTokens() Creates a null list of special tokens
SpecialTokens(String name)

Method Summary

Modifier and Type	Method and Description
void	addSpecialToken(String token, String replace) Adds a special token to this
private boolean	caseIndependentLength(String token)
private void	ensureNotFrozen()
void	freeze()
String	getName() Returns the name of this special tokens list
int	size() Returns the number of special tokens in this
private boolean	tokenEndsAt(int position, String string)
SpecialTokens.SpecialToken	tokenize(String string, boolean substring) Returns the special token starting at the start of the given string, or null if no special token starts at this string

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

log

private static final Logger log

name

private String name

specialTokens

private List<SpecialTokens.SpecialToken> specialTokens

frozen

private boolean frozen

currentMaximumLength

private int currentMaximumLength

Constructor Detail

SpecialTokens

public SpecialTokens()

Creates a null list of special tokens

SpecialTokens

public SpecialTokens(String name)

Method Detail

getName

public String getName()

Returns the name of this special tokens list

addSpecialToken

public void addSpecialToken(String token,
                            String replace)

Adds a special token to this

Parameters:

token - the special token string to add

replace - the token to replace instances of the special token with, or null to keep the token

caseIndependentLength

private boolean caseIndependentLength(String token)

tokenize

public SpecialTokens.SpecialToken tokenize(String string,
                                           boolean substring)

Returns the special token starting at the start of the given string, or null if no special token starts at this string

Parameters:

string - the string to search for a special token at the start position

substring - true to allow the special token to be followed by a character which does not mark the end of a token

tokenEndsAt

private boolean tokenEndsAt(int position,
                            String string)

size

public int size()

Returns the number of special tokens in this

ensureNotFrozen

private void ensureNotFrozen()

freeze

public void freeze()