Trait

com.intel.analytics.zoo.feature

DistributedFeatureSet

Related Doc: package feature

Permalink

trait DistributedFeatureSet[T] extends AbstractFeatureSet[T, RDD[T]]

Represent a distributed data. Use RDD to go through all data.

Linear Supertypes
AbstractFeatureSet[T, RDD[T]], AbstractDataSet[T, RDD[T]], AnyRef, Any
Known Subclasses
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. DistributedFeatureSet
  2. AbstractFeatureSet
  3. AbstractDataSet
  4. AnyRef
  5. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Abstract Value Members

  1. abstract def data(train: Boolean): RDD[T]

    Permalink

    Get a sequence of data

    Get a sequence of data

    train

    if the data is used in train. If yes, the data sequence is a looped endless sequence, or it has a limited length.

    returns

    data sequence

    Definition Classes
    AbstractFeatureSet → AbstractDataSet
  2. abstract def originRDD(): RDD[_]

    Permalink

    Get the 'origin' RDD of the dataset.

  3. abstract def shuffle(): Unit

    Permalink

    Change the order of the data sequence from the data set

    Change the order of the data sequence from the data set

    Definition Classes
    AbstractFeatureSet → AbstractDataSet
  4. abstract def size(): Long

    Permalink

    Total size of the data set

    Total size of the data set

    Definition Classes
    AbstractFeatureSet → AbstractDataSet

Concrete Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  3. def ->[C](transformer: Transformer[T, C])(implicit arg0: ClassTag[C]): FeatureSet[C]

    Permalink

    Helper function to transform the data type in the data set.

    Helper function to transform the data type in the data set.

    Definition Classes
    AbstractFeatureSet → AbstractDataSet
  4. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  5. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  6. def cache(): Unit

    Permalink

    Trigger the computation of this dataset and cache it in memory.

  7. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  8. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  9. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  10. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  11. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
  12. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  13. var isCached: Boolean

    Permalink

    Check if rdd is cached.

  14. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  15. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  16. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
  17. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
  18. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  19. def toDataSet(): DataSet[T]

    Permalink

    Convert FeatureSet to com.intel.analytics.bigdl.DataSet

    Convert FeatureSet to com.intel.analytics.bigdl.DataSet

    returns

    DataSet[D]

    Definition Classes
    DistributedFeatureSetAbstractFeatureSet
  20. def toDistributed(): DistributedDataSet[T]

    Permalink
    Definition Classes
    AbstractDataSet
  21. def toLocal(): LocalDataSet[T]

    Permalink
    Definition Classes
    AbstractDataSet
  22. def toString(): String

    Permalink
    Definition Classes
    AnyRef → Any
  23. def transform[C](transformer: Transformer[T, C])(implicit arg0: ClassTag[C]): DistributedFeatureSet[C]

    Permalink

    Helper function to transform the data type in the data set.

    Helper function to transform the data type in the data set.

    Definition Classes
    DistributedFeatureSetAbstractFeatureSet → AbstractDataSet
  24. def unpersist(): Unit

    Permalink

    Unpersist rdd.

  25. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  26. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  27. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from AbstractFeatureSet[T, RDD[T]]

Inherited from AbstractDataSet[T, RDD[T]]

Inherited from AnyRef

Inherited from Any

Ungrouped