feature

Type Members

1. trait AbstractFeatureSet[D, DataSequence] extends AbstractDataSet[D, DataSequence]

   

   A set of data which is used in the model optimization process.

   A set of data which is used in the model optimization process. The FeatureSet can be access in a random data sample sequence. In the training process, the data sequence is a looped endless sequence. While in the validation process, the data sequence is a limited length sequence. User can use the data() method to get the data sequence.

   The sequence of the data is not fixed. It can be changed by the shuffle() method.

   D

   Data type

   DataSequence

   Represent a sequence of data

2. class CachedDistributedFeatureSet[T] extends DistributedFeatureSet[T]

   

   Wrap a RDD as a FeatureSet.

3. class DiskFeatureSet[T] extends DistributedFeatureSet[T]

   

   Wrap a RDD as a FeatureSet.

   Wrap a RDD as a FeatureSet. RDD will be persist on local disk, and will load one slice of the data to memory for the training.

4. trait DistributedFeatureSet[T] extends AbstractFeatureSet[T, RDD[T]]

   

   Represent a distributed data.

   Represent a distributed data. Use RDD to go through all data.

5. type FeatureSet[D] = AbstractFeatureSet[D, _]