Package com.yahoo.language.simple

Class SimpleLinguistics

java.lang.Object

com.yahoo.language.simple.SimpleLinguistics

All Implemented Interfaces:

Linguistics

public class SimpleLinguistics
extends Object
implements Linguistics

Factory of simple linguistic processor implementations. Useful for testing and english-only use cases.

Author:

bratseth, bjorncs

Nested Class Summary

Nested classes/interfaces inherited from interface com.yahoo.language.Linguistics

Linguistics.Component

Constructor Summary

Constructors

Constructor	Description
SimpleLinguistics()

Method Summary

Modifier and Type	Method	Description
boolean	equals(Linguistics other)	Check if another instance is equivalent to this one
CharacterClasses	getCharacterClasses()	Returns a thread-unsafe character classes instance.
Detector	getDetector()	Returns a thread-unsafe detector.
GramSplitter	getGramSplitter()	Returns a thread-unsafe gram splitter.
Normalizer	getNormalizer()	Returns a thread-unsafe normalizer.
Segmenter	getSegmenter()	Returns a thread-unsafe segmenter.
Stemmer	getStemmer()	Returns a thread-unsafe stemmer or lemmatizer.
Tokenizer	getTokenizer()	Returns a thread-unsafe tokenizer.
Transformer	getTransformer()	Returns a thread-unsafe transformer.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

SimpleLinguistics

@Inject
public SimpleLinguistics()

Method Details

getStemmer

public Stemmer getStemmer()

Description copied from interface: Linguistics

Returns a thread-unsafe stemmer or lemmatizer. This is used at query time to do stemming of search terms to indexes which contains text tokenized with stemming turned on

Specified by:

getStemmer in interface Linguistics

getTokenizer

public Tokenizer getTokenizer()

Description copied from interface: Linguistics

Returns a thread-unsafe tokenizer. This is used at indexing time to produce an optionally stemmed and transformed (accent normalized) stream of indexable tokens.

Specified by:

getTokenizer in interface Linguistics

getNormalizer

public Normalizer getNormalizer()

Description copied from interface: Linguistics

Returns a thread-unsafe normalizer. This is used at query time to cjk normalize query text.

Specified by:

getNormalizer in interface Linguistics

getTransformer

public Transformer getTransformer()

Description copied from interface: Linguistics

Returns a thread-unsafe transformer. This is used at query time to do stemming of search terms to indexes which contains text tokenized with accent normalization turned on

Specified by:

getTransformer in interface Linguistics

getSegmenter

public Segmenter getSegmenter()

Description copied from interface: Linguistics

Returns a thread-unsafe segmenter. This is used at query time to find the individual semantic components of search terms to indexes tokenized with segmentation.

Specified by:

getSegmenter in interface Linguistics

getDetector

public Detector getDetector()

Description copied from interface: Linguistics

Returns a thread-unsafe detector. The language of the text is a parameter to other linguistic operations. This is used to determine the language of a query or document field when not specified explicitly.

Specified by:

getDetector in interface Linguistics

getGramSplitter

public GramSplitter getGramSplitter()

Description copied from interface: Linguistics

Returns a thread-unsafe gram splitter. This is used to split query or document text into fixed-length grams which allows matching without needing or using segmented tokens.

Specified by:

getGramSplitter in interface Linguistics

getCharacterClasses

public CharacterClasses getCharacterClasses()

Description copied from interface: Linguistics

Returns a thread-unsafe character classes instance.

Specified by:

getCharacterClasses in interface Linguistics

equals

public boolean equals(Linguistics other)

Description copied from interface: Linguistics

Check if another instance is equivalent to this one

Specified by:

equals in interface Linguistics