public class SGDText extends RandomizableClassifier implements UpdateableClassifier, UpdateableBatchProcessor, WeightedInstancesHandler, Aggregateable<SGDText>
-F Set the loss function to minimize. 0 = hinge loss (SVM), 1 = log loss (logistic regression) (default = 0)
-outputProbs Output probabilities for SVMs (fits a logsitic model to the output of the SVM)
-L The learning rate (default = 0.01).
-R <double> The lambda regularization constant (default = 0.0001)
-E <integer> The number of epochs to perform (batch learning only, default = 500)
-W Use word frequencies instead of binary bag of words.
-P <# instances> How often to prune the dictionary of low frequency words (default = 0, i.e. don't prune)
-M <double> Minimum word frequency. Words with less than this frequence are ignored. If periodic pruning is turned on then this is also used to determine which words to remove from the dictionary (default = 3).
-min-coeff <double> Minimum absolute value of coefficients in the model. If periodic pruning is turned on then this is also used to prune words from the dictionary (default = 0.001
-normalize Normalize document length (use in conjunction with -norm and -lnorm)
-norm <num> Specify the norm that each instance must have (default 1.0)
-lnorm <num> Specify L-norm to use (default 2.0)
-lowercase Convert all tokens to lowercase before adding to the dictionary.
-stopwords-handler The stopwords handler to use (default Null).
-tokenizer <spec> The tokenizing algorihtm (classname plus parameters) to use. (default: weka.core.tokenizers.WordTokenizer)
-stemmer <spec> The stemmering algorihtm (classname plus parameters) to use.
-S <num> Random number seed. (default 1)
-output-debug-info If set, classifier is run in debug mode and may output additional info to the console
-do-not-check-capabilities If set, classifier capabilities are not checked before classifier is built (use with caution).
Modifier and Type | Class and Description |
---|---|
static class |
SGDText.Count |
Modifier and Type | Field and Description |
---|---|
static int |
HINGE
the hinge loss function.
|
static int |
LOGLOSS
the log loss function.
|
static Tag[] |
TAGS_SELECTION
Loss functions to choose from
|
BATCH_SIZE_DEFAULT, NUM_DECIMAL_PLACES_DEFAULT
Constructor and Description |
---|
SGDText() |
Modifier and Type | Method and Description |
---|---|
SGDText |
aggregate(SGDText toAggregate)
Aggregate an object with this one
|
void |
batchFinished()
Signal that the training data is finished (for now).
|
double |
bias() |
void |
buildClassifier(Instances data)
Method for building the classifier.
|
double[] |
distributionForInstance(Instance inst)
Predicts the class memberships for a given instance.
|
String |
epochsTipText()
Returns the tip text for this property
|
void |
finalizeAggregation()
Call to complete the aggregation process.
|
Capabilities |
getCapabilities()
Returns default capabilities of the classifier.
|
LinkedHashMap<String,SGDText.Count> |
getDictionary()
Get this model's dictionary (including term weights).
|
int |
getDictionarySize()
Return the size of the dictionary (minus any low frequency terms that are
below the threshold but haven't been pruned yet).
|
int |
getEpochs()
Get current number of epochs
|
double |
getLambda()
Get the current value of lambda
|
double |
getLearningRate()
Get the learning rate.
|
double |
getLNorm()
Get the L Norm used.
|
SelectedTag |
getLossFunction()
Get the current loss function.
|
boolean |
getLowercaseTokens()
Get whether to convert all tokens to lowercase
|
double |
getMinAbsoluteCoefficientValue()
Get the minimum absolute magnitude for model coefficients.
|
double |
getMinWordFrequency()
Get the minimum word frequency.
|
double |
getNorm()
Get the instance's Norm.
|
boolean |
getNormalizeDocLength()
Get whether to normalize the length of each document
|
String[] |
getOptions()
Gets the current settings of the classifier.
|
boolean |
getOutputProbsForSVM()
Get whether to fit a logistic regression (itself trained using SGD) to the
outputs of the SVM (if an SVM is being learned).
|
int |
getPeriodicPruning()
Get how often to prune the dictionary
|
String |
getRevision()
Returns the revision string.
|
Stemmer |
getStemmer()
Returns the current stemming algorithm, null if none is used.
|
StopwordsHandler |
getStopwordsHandler()
Gets the stopwords handler.
|
Tokenizer |
getTokenizer()
Returns the current tokenizer algorithm.
|
boolean |
getUseWordFrequencies()
Get whether to use word frequencies rather than binary bag of words
representation.
|
String |
globalInfo()
Returns a string describing classifier
|
String |
lambdaTipText()
Returns the tip text for this property
|
String |
learningRateTipText()
Returns the tip text for this property
|
Enumeration<Option> |
listOptions()
Returns an enumeration describing the available options.
|
String |
LNormTipText()
Returns the tip text for this property
|
String |
lossFunctionTipText()
Returns the tip text for this property
|
String |
lowercaseTokensTipText()
Returns the tip text for this property
|
static void |
main(String[] args)
Main method for testing this class.
|
String |
minAbsoluteCoefficientValueTipText()
Returns the tip text for this property
|
String |
minWordFrequencyTipText()
Returns the tip text for this property
|
String |
normalizeDocLengthTipText()
Returns the tip text for this property
|
String |
normTipText()
Returns the tip text for this property
|
String |
outputProbsForSVMTipText()
Returns the tip text for this property
|
String |
periodicPruningTipText()
Returns the tip text for this property
|
void |
reset()
Reset the classifier.
|
void |
setBias(double bias) |
void |
setEpochs(int e)
Set the number of epochs to use
|
void |
setLambda(double lambda)
Set the value of lambda to use
|
void |
setLearningRate(double lr)
Set the learning rate.
|
void |
setLNorm(double newLNorm)
Set the L-norm to used
|
void |
setLossFunction(SelectedTag function)
Set the loss function to use.
|
void |
setLowercaseTokens(boolean l)
Set whether to convert all tokens to lowercase
|
void |
setMinAbsoluteCoefficientValue(double minCoeff)
Set the minimum absolute magnitude for model coefficients.
|
void |
setMinWordFrequency(double minFreq)
Set the minimum word frequency.
|
void |
setNorm(double newNorm)
Set the norm of the instances
|
void |
setNormalizeDocLength(boolean norm)
Set whether to normalize the length of each document
|
void |
setOptions(String[] options)
Parses a given list of options.
|
void |
setOutputProbsForSVM(boolean o)
Set whether to fit a logistic regression (itself trained using SGD) to the
outputs of the SVM (if an SVM is being learned).
|
void |
setPeriodicPruning(int p)
Set how often to prune the dictionary
|
void |
setStemmer(Stemmer value)
the stemming algorithm to use, null means no stemming at all (i.e., the
NullStemmer is used).
|
void |
setStopwordsHandler(StopwordsHandler value)
Sets the stopwords handler to use.
|
void |
setTokenizer(Tokenizer value)
the tokenizer algorithm to use.
|
void |
setUseWordFrequencies(boolean u)
Set whether to use word frequencies rather than binary bag of words
representation.
|
String |
stemmerTipText()
Returns the tip text for this property.
|
String |
stopwordsHandlerTipText()
Returns the tip text for this property.
|
String |
tokenizerTipText()
Returns the tip text for this property.
|
String |
toString() |
void |
updateClassifier(Instance instance)
Updates the classifier with the given instance.
|
String |
useWordFrequenciesTipText()
Returns the tip text for this property
|
getSeed, seedTipText, setSeed
batchSizeTipText, classifyInstance, debugTipText, distributionsForInstances, doNotCheckCapabilitiesTipText, forName, getBatchSize, getDebug, getDoNotCheckCapabilities, getNumDecimalPlaces, implementsMoreEfficientBatchPrediction, makeCopies, makeCopy, numDecimalPlacesTipText, postExecution, preExecution, run, runClassifier, setBatchSize, setDebug, setDoNotCheckCapabilities, setNumDecimalPlaces
public static final int HINGE
public static final int LOGLOSS
public static final Tag[] TAGS_SELECTION
public Capabilities getCapabilities()
getCapabilities
in interface Classifier
getCapabilities
in interface CapabilitiesHandler
getCapabilities
in class AbstractClassifier
Capabilities
public void setStemmer(Stemmer value)
value
- the configured stemming algorithm, or nullNullStemmer
public Stemmer getStemmer()
public String stemmerTipText()
public void setTokenizer(Tokenizer value)
value
- the configured tokenizing algorithmpublic Tokenizer getTokenizer()
public String tokenizerTipText()
public String useWordFrequenciesTipText()
public void setUseWordFrequencies(boolean u)
u
- true if word frequencies are to be used.public boolean getUseWordFrequencies()
public String lowercaseTokensTipText()
public void setLowercaseTokens(boolean l)
l
- true if all tokens are to be converted to lowercasepublic boolean getLowercaseTokens()
public void setStopwordsHandler(StopwordsHandler value)
value
- the stopwords handler, if null, Null is usedpublic StopwordsHandler getStopwordsHandler()
public String stopwordsHandlerTipText()
public String periodicPruningTipText()
public void setPeriodicPruning(int p)
p
- how often to prunepublic int getPeriodicPruning()
public String minWordFrequencyTipText()
public void setMinWordFrequency(double minFreq)
minFreq
- the minimum word frequency to usepublic double getMinWordFrequency()
public String minAbsoluteCoefficientValueTipText()
public void setMinAbsoluteCoefficientValue(double minCoeff)
minCoeff
- the minimum absolute value of a model coefficientpublic double getMinAbsoluteCoefficientValue()
public String normalizeDocLengthTipText()
public void setNormalizeDocLength(boolean norm)
norm
- true if document lengths is to be normalizedpublic boolean getNormalizeDocLength()
public String normTipText()
public double getNorm()
public void setNorm(double newNorm)
newNorm
- the norm to wich the instances must be setpublic String LNormTipText()
public double getLNorm()
public void setLNorm(double newLNorm)
newLNorm
- the L-normpublic String lambdaTipText()
public void setLambda(double lambda)
lambda
- the value of lambda to usepublic double getLambda()
public void setLearningRate(double lr)
lr
- the learning rate to use.public double getLearningRate()
public String learningRateTipText()
public String epochsTipText()
public void setEpochs(int e)
e
- the number of epochs to usepublic int getEpochs()
public void setLossFunction(SelectedTag function)
function
- the loss function to use.public SelectedTag getLossFunction()
public String lossFunctionTipText()
public void setOutputProbsForSVM(boolean o)
o
- true if a logistic regression is to be fit to the output of the
SVM to produce probability estimates.public boolean getOutputProbsForSVM()
public String outputProbsForSVMTipText()
public Enumeration<Option> listOptions()
listOptions
in interface OptionHandler
listOptions
in class RandomizableClassifier
public void setOptions(String[] options) throws Exception
-F Set the loss function to minimize. 0 = hinge loss (SVM), 1 = log loss (logistic regression) (default = 0)
-outputProbs Output probabilities for SVMs (fits a logsitic model to the output of the SVM)
-L The learning rate (default = 0.01).
-R <double> The lambda regularization constant (default = 0.0001)
-E <integer> The number of epochs to perform (batch learning only, default = 500)
-W Use word frequencies instead of binary bag of words.
-P <# instances> How often to prune the dictionary of low frequency words (default = 0, i.e. don't prune)
-M <double> Minimum word frequency. Words with less than this frequence are ignored. If periodic pruning is turned on then this is also used to determine which words to remove from the dictionary (default = 3).
-min-coeff <double> Minimum absolute value of coefficients in the model. If periodic pruning is turned on then this is also used to prune words from the dictionary (default = 0.001
-normalize Normalize document length (use in conjunction with -norm and -lnorm)
-norm <num> Specify the norm that each instance must have (default 1.0)
-lnorm <num> Specify L-norm to use (default 2.0)
-lowercase Convert all tokens to lowercase before adding to the dictionary.
-stopwords-handler The stopwords handler to use (default Null).
-tokenizer <spec> The tokenizing algorihtm (classname plus parameters) to use. (default: weka.core.tokenizers.WordTokenizer)
-stemmer <spec> The stemmering algorihtm (classname plus parameters) to use.
-S <num> Random number seed. (default 1)
-output-debug-info If set, classifier is run in debug mode and may output additional info to the console
-do-not-check-capabilities If set, classifier capabilities are not checked before classifier is built (use with caution).
setOptions
in interface OptionHandler
setOptions
in class RandomizableClassifier
options
- the list of options as an array of stringsException
- if an option is not supportedpublic String[] getOptions()
getOptions
in interface OptionHandler
getOptions
in class RandomizableClassifier
public String globalInfo()
public void reset()
public void buildClassifier(Instances data) throws Exception
buildClassifier
in interface Classifier
data
- the set of training instances.Exception
- if the classifier can't be built successfully.public void updateClassifier(Instance instance) throws Exception
updateClassifier
in interface UpdateableClassifier
instance
- the new training instance to include in the modelException
- if the instance could not be incorporated in the
model.public double[] distributionForInstance(Instance inst) throws Exception
AbstractClassifier
distributionForInstance
in interface Classifier
distributionForInstance
in class AbstractClassifier
inst
- the instance to be classifiedException
- if distribution could not be computed successfullypublic LinkedHashMap<String,SGDText.Count> getDictionary()
public int getDictionarySize()
public double bias()
public void setBias(double bias)
public String getRevision()
getRevision
in interface RevisionHandler
getRevision
in class AbstractClassifier
public SGDText aggregate(SGDText toAggregate) throws Exception
aggregate
in interface Aggregateable<SGDText>
toAggregate
- the object to aggregateException
- if the supplied object can't be aggregated for some
reasonpublic void finalizeAggregation() throws Exception
finalizeAggregation
in interface Aggregateable<SGDText>
Exception
- if the aggregation can't be finalized for some reasonpublic void batchFinished() throws Exception
UpdateableBatchProcessor
batchFinished
in interface UpdateableBatchProcessor
Exception
- if a problem occurspublic static void main(String[] args)
Copyright © 2018 University of Waikato, Hamilton, NZ. All Rights Reserved.