org.apache.spark

ml

package ml

Spark ML is an ALPHA component that adds a new set of machine learning APIs to let users quickly assemble and configure practical machine learning pipelines.

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. ml
  2. AnyRef
  3. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Type Members

  1. abstract class Estimator[M <: Model[M]] extends PipelineStage with Params

    :: AlphaComponent :: Abstract class for estimators that fit models to data.

    :: AlphaComponent :: Abstract class for estimators that fit models to data.

    Annotations
    @AlphaComponent()
  2. abstract class Evaluator extends Identifiable

    :: AlphaComponent :: Abstract class for evaluators that compute metrics from predictions.

    :: AlphaComponent :: Abstract class for evaluators that compute metrics from predictions.

    Annotations
    @AlphaComponent()
  3. abstract class Model[M <: Model[M]] extends Transformer

    :: AlphaComponent :: A fitted model, i.e., a Transformer produced by an Estimator.

    :: AlphaComponent :: A fitted model, i.e., a Transformer produced by an Estimator.

    M

    model type

    Annotations
    @AlphaComponent()
  4. class Pipeline extends Estimator[PipelineModel]

    :: AlphaComponent :: A simple pipeline, which acts as an estimator.

    :: AlphaComponent :: A simple pipeline, which acts as an estimator. A Pipeline consists of a sequence of stages, each of which is either an Estimator or a Transformer. When Pipeline.fit is called, the stages are executed in order. If a stage is an Estimator, its Estimator.fit method will be called on the input dataset to fit a model. Then the model, which is a transformer, will be used to transform the dataset as the input to the next stage. If a stage is a Transformer, its Transformer.transform method will be called to produce the dataset for the next stage. The fitted model from a Pipeline is an PipelineModel, which consists of fitted models and transformers, corresponding to the pipeline stages. If there are no stages, the pipeline acts as an identity transformer.

    Annotations
    @AlphaComponent()
  5. class PipelineModel extends Model[PipelineModel] with Logging

    :: AlphaComponent :: Represents a compiled pipeline.

    :: AlphaComponent :: Represents a compiled pipeline.

    Annotations
    @AlphaComponent()
  6. abstract class PipelineStage extends Serializable with Logging

    :: AlphaComponent :: A stage in a pipeline, either an Estimator or a Transformer.

    :: AlphaComponent :: A stage in a pipeline, either an Estimator or a Transformer.

    Annotations
    @AlphaComponent()
  7. abstract class Transformer extends PipelineStage with Params

    :: AlphaComponent :: Abstract class for transformers that transform one dataset into another.

    :: AlphaComponent :: Abstract class for transformers that transform one dataset into another.

    Annotations
    @AlphaComponent()

Value Members

  1. package classification

  2. package evaluation

  3. package feature

  4. package param

  5. package tuning

Inherited from AnyRef

Inherited from Any

Ungrouped