Package opennlp.tools.util.featuregen
Class WindowFeatureGenerator
java.lang.Object
opennlp.tools.util.featuregen.WindowFeatureGenerator
- All Implemented Interfaces:
AdaptiveFeatureGenerator
Generates previous and next features for a given
AdaptiveFeatureGenerator
.
The window size can be specified.
Features:
Current token is always included unchanged
Previous tokens are prefixed with p distance
Next tokens are prefix with n distance-
Field Summary
Fields -
Constructor Summary
ConstructorsConstructorDescriptionWindowFeatureGenerator
(int prevWindowSize, int nextWindowSize, AdaptiveFeatureGenerator... generators) Initializes the current instance with the given parameters.WindowFeatureGenerator
(AdaptiveFeatureGenerator generator) Initializes the current instance.WindowFeatureGenerator
(AdaptiveFeatureGenerator... generators) Initializes the current instance with the given parameters.WindowFeatureGenerator
(AdaptiveFeatureGenerator generator, int prevWindowSize, int nextWindowSize) Initializes the current instance with the given parameters. -
Method Summary
Modifier and TypeMethodDescriptionvoid
Informs the feature generator that the context of the adaptive data (typically a document) is no longer valid.void
createFeatures
(List<String> features, String[] tokens, int index, String[] preds) Adds the appropriate features for the token at the specified index with the specified array of previous outcomes to the specified list of features.toString()
void
updateAdaptiveData
(String[] tokens, String[] outcomes) Informs the feature generator that the specified tokens have been classified with the corresponding set of specified outcomes.
-
Field Details
-
PREV_PREFIX
- See Also:
-
NEXT_PREFIX
- See Also:
-
-
Constructor Details
-
WindowFeatureGenerator
public WindowFeatureGenerator(AdaptiveFeatureGenerator generator, int prevWindowSize, int nextWindowSize) Initializes the current instance with the given parameters.- Parameters:
generator
- Feature generator to apply to the window.prevWindowSize
- Size of the window to the left of the current token.nextWindowSize
- Size of the window to the right of the current token.
-
WindowFeatureGenerator
public WindowFeatureGenerator(int prevWindowSize, int nextWindowSize, AdaptiveFeatureGenerator... generators) Initializes the current instance with the given parameters.- Parameters:
prevWindowSize
-nextWindowSize
-generators
-
-
WindowFeatureGenerator
Initializes the current instance. The previous and next window size is 5.- Parameters:
generator
- feature generator
-
WindowFeatureGenerator
Initializes the current instance with the given parameters.- Parameters:
generators
- array of feature generators
-
-
Method Details
-
createFeatures
Description copied from interface:AdaptiveFeatureGenerator
Adds the appropriate features for the token at the specified index with the specified array of previous outcomes to the specified list of features.- Specified by:
createFeatures
in interfaceAdaptiveFeatureGenerator
- Parameters:
features
- The list of features to be added to.tokens
- The tokens of the sentence or other text unit being processed.index
- The index of the token which is currently being processed.preds
- The outcomes for the tokens prior to the specified index.
-
updateAdaptiveData
Description copied from interface:AdaptiveFeatureGenerator
Informs the feature generator that the specified tokens have been classified with the corresponding set of specified outcomes.- Specified by:
updateAdaptiveData
in interfaceAdaptiveFeatureGenerator
- Parameters:
tokens
- The tokens of the sentence or other text unit which has been processed.outcomes
- The outcomes associated with the specified tokens.
-
clearAdaptiveData
public void clearAdaptiveData()Description copied from interface:AdaptiveFeatureGenerator
Informs the feature generator that the context of the adaptive data (typically a document) is no longer valid.- Specified by:
clearAdaptiveData
in interfaceAdaptiveFeatureGenerator
-
toString
-