Transformer
Related Docs:
object Transformer
| package pipeline
Chains a Transformer with a Predictor to form a ChainedPredictor.
Chains a Transformer with a Predictor to form a ChainedPredictor.
Chains two Transformer to form a ChainedTransformer.
Chains two Transformer to form a ChainedTransformer.
Type of the Transformer
Right side transformer of the resulting pipeline
Fits the estimator to the given input data.
Fits the estimator to the given input data. The fitting logic is contained in the FitOperation. The computed state will be stored in the implementing class.
Type of the training data
Training data
Additional parameters for the FitOperation
FitOperation which encapsulates the algorithm logic
Transform operation which transforms an input DataSet of type I into an output DataSet of type O.
Transform operation which transforms an input DataSet of type I into an output DataSet of type O. The actual transform operation is implemented within the TransformDataSetOperation.
Input data type
Output data type
Input DataSet of type I
Additional parameters for the TransformDataSetOperation
TransformDataSetOperation which encapsulates the algorithm's logic
Transformer trait for Flink's pipeline operators.
A Transformer transforms a DataSet of an input type into a DataSet of an output type. Furthermore, a Transformer is also an Estimator, because some transformations depend on the training data. In order to do that the implementing class has to provide a TransformDataSetOperation and FitOperation implementation. The Scala compiler finds these implicit values if it is put in the scope of the companion object of the implementing class.
Transformer can be chained with other Transformer and Predictor to create pipelines. These pipelines can consist of an arbitrary number of Transformer and at most one trailing Predictor.
The pipeline mechanism has been inspired by scikit-learn