eu.project.ttc.utils

Class TermUtils

java.lang.Object

eu.project.ttc.utils.TermUtils

public class TermUtils
extends java.lang.Object

Field Summary

Fields

Modifier and Type	Field and Description
static java.util.Comparator<Term>	frequencyComparator Most frequent first

Constructor Summary

Constructors

Constructor and Description
TermUtils()

Method Summary

Modifier and Type	Method and Description
static java.lang.String	collapseText(java.lang.String coveredText)
static Term	findBiggestPrefix(TermIndex termIndex, java.util.List<TermWord> words) Finds in a TermIndex the biggest prefix of a sequence of TermWords that exists as a term.
static Term	findBiggestSuffix(TermIndex termIndex, java.util.List<TermWord> words) Finds in a TermIndex the biggest suffix of a sequence of TermWords that exists as a term.
static TermFormGetter	formGetter(TermIndex termIndex, boolean downcaseForms)
static Term	getExtensionAffix(TermIndex termIndex, Term base, Term extension) Finds in a TermIndex the biggest extension affix term of a term depending on a base term.
static double	getExtensionGain(Term extension, Term extensionAffix)
static int	getGeneralFrequency(Lang l, Term t)
static int	getPosition(Term subTerm, Term term) Finds the index of appearance of a term's sub-term.
static java.util.List<Term>	getSingleWordTerms(TermIndex termIndex, Term term) Finds in an input term all single-word terms it is made off.
static double	getStrictness(Term t1, Term t2) Returns the strictness of t1 based on t2, i.e. the ratio of appearance in an occurrence that do not overlap with t2.
static boolean	isIncludedIn(Term term, Term inTerm)
static boolean	isPrefixOf(Term term, Term ofTerm)
static boolean	isSuffixOf(Term term, Term ofTerm)
static void	showCompounds(TermIndex index, java.io.PrintStream out, int threshhold)
static void	showContextVector(ContextVector contextVector, int topN)
static void	showIndex(TermIndex index, java.io.PrintStream stream)
static void	showIndex(TermIndex index, java.io.PrintStream stream, com.google.common.base.Optional<java.util.regex.Pattern> watchExpression)
static void	showTopNTermsBy(TermIndex index, TermMeasure measure, java.io.PrintStream out, int n)
static java.util.List<java.util.Set<Component>>	toComponentSets(java.lang.Iterable<Word> words) Transforms a term into a list of component sets.
static java.lang.String	toGroupingKey(TermWord termWord)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

frequencyComparator

public static java.util.Comparator<Term> frequencyComparator

Most frequent first

Constructor Detail

TermUtils

public TermUtils()

Method Detail

formGetter

public static TermFormGetter formGetter(TermIndex termIndex,
                                        boolean downcaseForms)

showIndex

public static void showIndex(TermIndex index,
                             java.io.PrintStream stream)

showIndex

public static void showIndex(TermIndex index,
                             java.io.PrintStream stream,
                             com.google.common.base.Optional<java.util.regex.Pattern> watchExpression)

showTopNTermsBy

public static void showTopNTermsBy(TermIndex index,
                                   TermMeasure measure,
                                   java.io.PrintStream out,
                                   int n)

showCompounds

public static void showCompounds(TermIndex index,
                                 java.io.PrintStream out,
                                 int threshhold)

getSingleWordTerms

public static java.util.List<Term> getSingleWordTerms(TermIndex termIndex,
                                                      Term term)

Finds in an input term all single-word terms it is made off. If the input term has compounds, this method will iterate over each compound and try to find a matching swt for each compound. This method creates an index on TermIndex based on key TermIndexes.SINGLE_WORD_LEMMA.

Parameters:

termIndex - The TermIndex in which single word terms must be found.

term - The input term.

Returns:

The list of single word terms.

See Also:

Term#asComponentIterator(boolean)

collapseText

public static java.lang.String collapseText(java.lang.String coveredText)

showContextVector

public static void showContextVector(ContextVector contextVector,
                                     int topN)

getStrictness

public static double getStrictness(Term t1,
                                   Term t2)

Returns the strictness of t1 based on t2, i.e. the ratio of appearance in an occurrence that do not overlap with t2.

Parameters:

t1 - the term to analyze

t2 - the base term

Returns:

fstrict(t1) / f(t1)

getExtensionAffix

public static Term getExtensionAffix(TermIndex termIndex,
                                     Term base,
                                     Term extension)

Finds in a TermIndex the biggest extension affix term of a term depending on a base term. For example, the term "offshore wind turbine" is an extension of "wind turbine". The extension affix is the term "offshore".

Parameters:

termIndex - The term index that both terms belong to.

base - The base term

extension - The extension term

Returns:

the extension affix found in termIndex, null if none has been found.

Throws:

java.lang.IllegalArgumentException - if extension id not an extension of the term base.

findBiggestPrefix

public static Term findBiggestPrefix(TermIndex termIndex,
                                     java.util.List<TermWord> words)

Finds in a TermIndex the biggest prefix of a sequence of TermWords that exists as a term.

Parameters:

termIndex - the term index

words - the initial sequence of TermWords

Returns:

A Term found in termIndex that makes the biggest possible prefix sequence for words.

findBiggestSuffix

public static Term findBiggestSuffix(TermIndex termIndex,
                                     java.util.List<TermWord> words)

Finds in a TermIndex the biggest suffix of a sequence of TermWords that exists as a term.

Parameters:

termIndex - the term index

words - the initial sequence of TermWords

Returns:

A Term found in termIndex that makes the biggest possible suffix sequence for words.

isIncludedIn

public static boolean isIncludedIn(Term term,
                                   Term inTerm)

isPrefixOf

public static boolean isPrefixOf(Term term,
                                 Term ofTerm)

isSuffixOf

public static boolean isSuffixOf(Term term,
                                 Term ofTerm)

getPosition

public static int getPosition(Term subTerm,
                              Term term)

Finds the index of appearance of a term's sub-term.

Parameters:

subTerm - the inner term, must be included in term

term - the container term.

Returns:

the starting index of subTerm in term. -1 otherwise.

getGeneralFrequency

public static int getGeneralFrequency(Lang l,
                                      Term t)

Parameters:

l -

t -

Returns:

getExtensionGain

public static double getExtensionGain(Term extension,
                                      Term extensionAffix)

toGroupingKey

public static java.lang.String toGroupingKey(TermWord termWord)

toComponentSets

public static java.util.List<java.util.Set<Component>> toComponentSets(java.lang.Iterable<Word> words)

Transforms a term into a list of component sets. This

Parameters:

term -

Returns: