ml - snappy-spark-examples_2.11 2.0.3-2 API - org.apache.spark.examples.ml

Type Members

case class Document(id: Long, text: String) extends Product with Serializable

Annotations
@BeanInfo()
class JavaAFTSurvivalRegressionExample extends AnyRef
class JavaALSExample extends AnyRef
class JavaBinarizerExample extends AnyRef
class JavaBisectingKMeansExample extends AnyRef
class JavaBucketizerExample extends AnyRef
class JavaChiSqSelectorExample extends AnyRef
class JavaCountVectorizerExample extends AnyRef
class JavaDCTExample extends AnyRef
class JavaDecisionTreeClassificationExample extends AnyRef
class JavaDecisionTreeRegressionExample extends AnyRef
class JavaDocument extends Serializable
class JavaElementwiseProductExample extends AnyRef
class JavaEstimatorTransformerParamExample extends AnyRef
class JavaGaussianMixtureExample extends AnyRef
class JavaGeneralizedLinearRegressionExample extends AnyRef
class JavaGradientBoostedTreeClassifierExample extends AnyRef
class JavaGradientBoostedTreeRegressorExample extends AnyRef
class JavaIndexToStringExample extends AnyRef
class JavaIsotonicRegressionExample extends AnyRef
class JavaKMeansExample extends AnyRef
class JavaLDAExample extends AnyRef
class JavaLabeledDocument extends JavaDocument with Serializable
class JavaLinearRegressionWithElasticNetExample extends AnyRef
class JavaLogisticRegressionSummaryExample extends AnyRef
class JavaLogisticRegressionWithElasticNetExample extends AnyRef
class JavaMaxAbsScalerExample extends AnyRef
class JavaMinMaxScalerExample extends AnyRef
class JavaModelSelectionViaCrossValidationExample extends AnyRef
class JavaModelSelectionViaTrainValidationSplitExample extends AnyRef
class JavaMultilayerPerceptronClassifierExample extends AnyRef
class JavaNGramExample extends AnyRef
class JavaNaiveBayesExample extends AnyRef
class JavaNormalizerExample extends AnyRef
class JavaOneHotEncoderExample extends AnyRef
class JavaOneVsRestExample extends AnyRef
class JavaPCAExample extends AnyRef
class JavaPipelineExample extends AnyRef
class JavaPolynomialExpansionExample extends AnyRef
class JavaQuantileDiscretizerExample extends AnyRef
class JavaRFormulaExample extends AnyRef
class JavaRandomForestClassifierExample extends AnyRef
class JavaRandomForestRegressorExample extends AnyRef
class JavaSQLTransformerExample extends AnyRef
class JavaSimpleParamsExample extends AnyRef
class JavaSimpleTextClassificationPipeline extends AnyRef
class JavaStandardScalerExample extends AnyRef
class JavaStopWordsRemoverExample extends AnyRef
class JavaStringIndexerExample extends AnyRef
class JavaTfIdfExample extends AnyRef
class JavaTokenizerExample extends AnyRef
class JavaVectorAssemblerExample extends AnyRef
class JavaVectorIndexerExample extends AnyRef
class JavaVectorSlicerExample extends AnyRef
class JavaWord2VecExample extends AnyRef
case class LabeledDocument(id: Long, text: String, label: Double) extends Product with Serializable

Annotations
@BeanInfo()

Value Members

object AFTSurvivalRegressionExample

An example demonstrating AFTSurvivalRegression.
An example demonstrating AFTSurvivalRegression. Run with
```
bin/run-example ml.AFTSurvivalRegressionExample
```
object ALSExample

An example demonstrating ALS.
An example demonstrating ALS. Run with
```
bin/run-example ml.ALSExample
```
object BinarizerExample
object BisectingKMeansExample

An example demonstrating bisecting k-means clustering.
An example demonstrating bisecting k-means clustering. Run with
```
bin/run-example ml.BisectingKMeansExample
```
object BucketizerExample
object ChiSqSelectorExample
object CountVectorizerExample
object DCTExample
object DataFrameExample

An example of how to use org.apache.spark.sql.DataFrame for ML.
An example of how to use org.apache.spark.sql.DataFrame for ML. Run with
```
./bin/run-example ml.DataFrameExample [options]
```
If you use it as a template to create your own app, please use spark-submit to submit your app.
object DecisionTreeClassificationExample
object DecisionTreeExample

An example runner for decision trees.
An example runner for decision trees. Run with
```
./bin/run-example ml.DecisionTreeExample [options]
```
Note that Decision Trees can take a large amount of memory. If the run-example command above fails, try running via spark-submit and specifying the amount of memory as at least 1g. For local mode, run
```
./bin/spark-submit --class org.apache.spark.examples.ml.DecisionTreeExample --driver-memory 1g
  [examples JAR path] [options]
```
If you use it as a template to create your own app, please use spark-submit to submit your app.
object DecisionTreeRegressionExample
object DeveloperApiExample

A simple example demonstrating how to write your own learning algorithm using Estimator, Transformer, and other abstractions.
A simple example demonstrating how to write your own learning algorithm using Estimator, Transformer, and other abstractions. This mimics org.apache.spark.ml.classification.LogisticRegression. Run with
```
bin/run-example ml.DeveloperApiExample
```
object ElementwiseProductExample
object EstimatorTransformerParamExample
object GBTExample

An example runner for decision trees.
An example runner for decision trees. Run with
```
./bin/run-example ml.GBTExample [options]
```
Decision Trees and ensembles can take a large amount of memory. If the run-example command above fails, try running via spark-submit and specifying the amount of memory as at least 1g. For local mode, run
```
./bin/spark-submit --class org.apache.spark.examples.ml.GBTExample --driver-memory 1g
  [examples JAR path] [options]
```
If you use it as a template to create your own app, please use spark-submit to submit your app.
object GaussianMixtureExample

An example demonstrating Gaussian Mixture Model (GMM).
An example demonstrating Gaussian Mixture Model (GMM). Run with
```
bin/run-example ml.GaussianMixtureExample
```
object GeneralizedLinearRegressionExample

An example demonstrating generalized linear regression.
An example demonstrating generalized linear regression. Run with
```
bin/run-example ml.GeneralizedLinearRegressionExample
```
object GradientBoostedTreeClassifierExample
object GradientBoostedTreeRegressorExample
object IndexToStringExample
object IsotonicRegressionExample

An example demonstrating Isotonic Regression.
An example demonstrating Isotonic Regression. Run with
```
bin/run-example ml.IsotonicRegressionExample
```
object KMeansExample

An example demonstrating k-means clustering.
An example demonstrating k-means clustering. Run with
```
bin/run-example ml.KMeansExample
```
object LDAExample

An example demonstrating LDA.
An example demonstrating LDA. Run with
```
bin/run-example ml.LDAExample
```
object LinearRegressionExample

An example runner for linear regression with elastic-net (mixing L1/L2) regularization.
An example runner for linear regression with elastic-net (mixing L1/L2) regularization. Run with
```
bin/run-example ml.LinearRegressionExample [options]
```
A synthetic dataset can be found at data/mllib/sample_linear_regression_data.txt which can be trained by
```
bin/run-example ml.LinearRegressionExample --regParam 0.15 --elasticNetParam 1.0 \
  data/mllib/sample_linear_regression_data.txt
```
If you use it as a template to create your own app, please use spark-submit to submit your app.
object LinearRegressionWithElasticNetExample
object LogisticRegressionExample

An example runner for logistic regression with elastic-net (mixing L1/L2) regularization.
An example runner for logistic regression with elastic-net (mixing L1/L2) regularization. Run with
```
bin/run-example ml.LogisticRegressionExample [options]
```
A synthetic dataset can be found at data/mllib/sample_libsvm_data.txt which can be trained by
```
bin/run-example ml.LogisticRegressionExample --regParam 0.3 --elasticNetParam 0.8 \
  data/mllib/sample_libsvm_data.txt
```
If you use it as a template to create your own app, please use spark-submit to submit your app.
object LogisticRegressionSummaryExample
object LogisticRegressionWithElasticNetExample
object MaxAbsScalerExample
object MinMaxScalerExample
object ModelSelectionViaCrossValidationExample

A simple example demonstrating model selection using CrossValidator.
A simple example demonstrating model selection using CrossValidator. This example also demonstrates how Pipelines are Estimators.
Run with
```
bin/run-example ml.ModelSelectionViaCrossValidationExample
```
object ModelSelectionViaTrainValidationSplitExample

A simple example demonstrating model selection using TrainValidationSplit.
A simple example demonstrating model selection using TrainValidationSplit.
Run with
```
bin/run-example ml.ModelSelectionViaTrainValidationSplitExample
```
object MultilayerPerceptronClassifierExample

An example for Multilayer Perceptron Classification.
object NGramExample
object NaiveBayesExample
object NormalizerExample
object OneHotEncoderExample
object OneVsRestExample

An example of Multiclass to Binary Reduction with One Vs Rest, using Logistic Regression as the base classifier.
An example of Multiclass to Binary Reduction with One Vs Rest, using Logistic Regression as the base classifier. Run with
```
./bin/run-example ml.OneVsRestExample
```
object PCAExample
object PipelineExample
object PolynomialExpansionExample
object QuantileDiscretizerExample
object RFormulaExample
object RandomForestClassifierExample
object RandomForestExample

An example runner for decision trees.
An example runner for decision trees. Run with
```
./bin/run-example ml.RandomForestExample [options]
```
Decision Trees and ensembles can take a large amount of memory. If the run-example command above fails, try running via spark-submit and specifying the amount of memory as at least 1g. For local mode, run
```
./bin/spark-submit --class org.apache.spark.examples.ml.RandomForestExample --driver-memory 1g
  [examples JAR path] [options]
```
If you use it as a template to create your own app, please use spark-submit to submit your app.
object RandomForestRegressorExample
object SQLTransformerExample
object SimpleParamsExample

A simple example demonstrating ways to specify parameters for Estimators and Transformers.
A simple example demonstrating ways to specify parameters for Estimators and Transformers. Run with
```
bin/run-example ml.SimpleParamsExample
```
object SimpleTextClassificationPipeline

A simple text classification pipeline that recognizes "spark" from input text.
A simple text classification pipeline that recognizes "spark" from input text. This is to show how to create and configure an ML pipeline. Run with
```
bin/run-example ml.SimpleTextClassificationPipeline
```
object StandardScalerExample
object StopWordsRemoverExample
object StringIndexerExample
object TfIdfExample
object TokenizerExample
object UnaryTransformerExample

An example demonstrating creating a custom org.apache.spark.ml.Transformer using the UnaryTransformer abstraction.
An example demonstrating creating a custom org.apache.spark.ml.Transformer using the UnaryTransformer abstraction.
Run with
```
bin/run-example ml.UnaryTransformerExample
```
object VectorAssemblerExample
object VectorIndexerExample
object VectorSlicerExample
object Word2VecExample

ml

package ml

Type Members

case class Document(id: Long, text: String) extends Product with Serializable

class JavaAFTSurvivalRegressionExample extends AnyRef

class JavaALSExample extends AnyRef

class JavaBinarizerExample extends AnyRef

class JavaBisectingKMeansExample extends AnyRef

class JavaBucketizerExample extends AnyRef

class JavaChiSqSelectorExample extends AnyRef

class JavaCountVectorizerExample extends AnyRef

class JavaDCTExample extends AnyRef

class JavaDecisionTreeClassificationExample extends AnyRef

class JavaDecisionTreeRegressionExample extends AnyRef

class JavaDocument extends Serializable

class JavaElementwiseProductExample extends AnyRef

class JavaEstimatorTransformerParamExample extends AnyRef

class JavaGaussianMixtureExample extends AnyRef

class JavaGeneralizedLinearRegressionExample extends AnyRef

class JavaGradientBoostedTreeClassifierExample extends AnyRef

class JavaGradientBoostedTreeRegressorExample extends AnyRef

class JavaIndexToStringExample extends AnyRef

class JavaIsotonicRegressionExample extends AnyRef

class JavaKMeansExample extends AnyRef

class JavaLDAExample extends AnyRef

class JavaLabeledDocument extends JavaDocument with Serializable

class JavaLinearRegressionWithElasticNetExample extends AnyRef

class JavaLogisticRegressionSummaryExample extends AnyRef

class JavaLogisticRegressionWithElasticNetExample extends AnyRef

class JavaMaxAbsScalerExample extends AnyRef

class JavaMinMaxScalerExample extends AnyRef

class JavaModelSelectionViaCrossValidationExample extends AnyRef

class JavaModelSelectionViaTrainValidationSplitExample extends AnyRef

class JavaMultilayerPerceptronClassifierExample extends AnyRef

class JavaNGramExample extends AnyRef

class JavaNaiveBayesExample extends AnyRef

class JavaNormalizerExample extends AnyRef

class JavaOneHotEncoderExample extends AnyRef

class JavaOneVsRestExample extends AnyRef

class JavaPCAExample extends AnyRef

class JavaPipelineExample extends AnyRef

class JavaPolynomialExpansionExample extends AnyRef

class JavaQuantileDiscretizerExample extends AnyRef

class JavaRFormulaExample extends AnyRef

class JavaRandomForestClassifierExample extends AnyRef

class JavaRandomForestRegressorExample extends AnyRef

class JavaSQLTransformerExample extends AnyRef

class JavaSimpleParamsExample extends AnyRef

class JavaSimpleTextClassificationPipeline extends AnyRef

class JavaStandardScalerExample extends AnyRef

class JavaStopWordsRemoverExample extends AnyRef

class JavaStringIndexerExample extends AnyRef

class JavaTfIdfExample extends AnyRef

class JavaTokenizerExample extends AnyRef

class JavaVectorAssemblerExample extends AnyRef

class JavaVectorIndexerExample extends AnyRef

class JavaVectorSlicerExample extends AnyRef

class JavaWord2VecExample extends AnyRef

case class LabeledDocument(id: Long, text: String, label: Double) extends Product with Serializable

Value Members

object AFTSurvivalRegressionExample

object ALSExample

object BinarizerExample

object BisectingKMeansExample

object BucketizerExample

object ChiSqSelectorExample

object CountVectorizerExample

object DCTExample

object DataFrameExample

object DecisionTreeClassificationExample

object DecisionTreeExample

object DecisionTreeRegressionExample

object DeveloperApiExample

object ElementwiseProductExample

object EstimatorTransformerParamExample

object GBTExample

object GaussianMixtureExample

object GeneralizedLinearRegressionExample

object GradientBoostedTreeClassifierExample

object GradientBoostedTreeRegressorExample