public class MultiDataSet extends Object implements MultiDataSet
MultiDataSet
Constructor and Description |
---|
MultiDataSet()
Create a new (empty) MultiDataSet object (all fields are null)
|
MultiDataSet(INDArray[] features,
INDArray[] labels)
MultiDataSet constructor with no mask arrays
|
MultiDataSet(INDArray[] features,
INDArray[] labels,
INDArray[] featuresMaskArrays,
INDArray[] labelsMaskArrays) |
MultiDataSet(INDArray features,
INDArray labels)
MultiDataSet constructor with single features/labels input, no mask arrays
|
MultiDataSet(INDArray features,
INDArray labels,
INDArray featuresMask,
INDArray labelsMask)
MultiDataSet constructor with single features/labels input, single mask arrays
|
Modifier and Type | Method and Description |
---|---|
List<MultiDataSet> |
asList()
Split the MultiDataSet into a list of individual examples.
|
MultiDataSet |
copy()
Clone the dataset
|
void |
detach()
This method migrates this DataSet into current Workspace (if any)
|
boolean |
equals(Object o) |
List<Serializable> |
getExampleMetaData()
Get the example metadata, or null if no metadata has been set
|
<T extends Serializable> |
getExampleMetaData(Class<T> metaDataType)
Get the example metadata, or null if no metadata has been set
Note: this method results in an unchecked cast - care should be taken when using this! |
INDArray[] |
getFeatures()
Get all of the input features, as an array of INDArrays
|
INDArray |
getFeatures(int index)
Get a single feature/input array
|
INDArray |
getFeaturesMaskArray(int index)
Get the specified feature mask array.
|
INDArray[] |
getFeaturesMaskArrays()
Get the feature mask arrays.
|
INDArray[] |
getLabels()
Get all of the labels, as an array of INDArrays
|
INDArray |
getLabels(int index)
Get a single label/output array
|
INDArray |
getLabelsMaskArray(int index)
Get the specified label mask array.
|
INDArray[] |
getLabelsMaskArrays()
Get the labels mask arrays.
|
long |
getMemoryFootprint()
This method returns memory used by this DataSet
|
int |
hashCode() |
boolean |
hasMaskArrays()
Whether there are any mask arrays (features or labels) present for this MultiDataSet
|
void |
load(File from)
Load the contents of this MultiDataSet from the specified file
|
void |
load(InputStream from)
Load the contents of this MultiDataSet from the specified stream.
|
static MultiDataSet |
merge(Collection<? extends MultiDataSet> toMerge)
Merge a collection of MultiDataSet objects into a single MultiDataSet.
|
void |
migrate()
This method migrates this MultiDataSet into current Workspace (if any)
|
int |
numFeatureArrays()
Number of arrays of features/input data in the MultiDataSet
|
int |
numLabelsArrays()
Number of arrays of label/output data in the MultiDataSet
|
void |
save(File to)
Save this MultiDataSet to the specified file
|
void |
save(OutputStream to)
Save this MultiDataSet to the specified stream.
|
void |
setExampleMetaData(List<? extends Serializable> exampleMetaData)
Set the metadata for this MultiDataSet
By convention: the metadata can be any serializable object, one per example in the MultiDataSet |
void |
setFeatures(INDArray[] features)
Set all of the features arrays for the MultiDataSet
|
void |
setFeatures(int idx,
INDArray features)
Set a single features array (by index) for the MultiDataSet
|
void |
setFeaturesMaskArray(int idx,
INDArray maskArray)
Set a single feature mask array by index
|
void |
setFeaturesMaskArrays(INDArray[] maskArrays)
Set the feature mask arrays
|
void |
setLabels(INDArray[] labels)
Set all of the labels arrays for the MultiDataSet
|
void |
setLabels(int idx,
INDArray labels)
Set a single labels array (by index) for the MultiDataSet
|
void |
setLabelsMaskArray(INDArray[] labelsMaskArrays)
Set the labels mask arrays
|
void |
setLabelsMaskArray(int idx,
INDArray labelsMaskArray)
Set a single labels mask array by index
|
String |
toString() |
public MultiDataSet()
public MultiDataSet(INDArray features, INDArray labels)
public MultiDataSet(INDArray features, INDArray labels, INDArray featuresMask, INDArray labelsMask)
public MultiDataSet(INDArray[] features, INDArray[] labels)
public MultiDataSet(INDArray[] features, INDArray[] labels, INDArray[] featuresMaskArrays, INDArray[] labelsMaskArrays)
features
- The features (inputs) to the algorithm/neural networklabels
- The labels (outputs) to the algorithm/neural networkfeaturesMaskArrays
- The mask arrays for the features. May be null. Typically used with variable-length time series models, etclabelsMaskArrays
- The mask arrays for the labels. May be null. Typically used with variable-length time series models, etcpublic List<Serializable> getExampleMetaData()
MultiDataSet
getExampleMetaData
in interface MultiDataSet
#getExampleMetaData(Class)} for convenience method for types
public <T extends Serializable> List<T> getExampleMetaData(Class<T> metaDataType)
MultiDataSet
getExampleMetaData
in interface MultiDataSet
T
- Type of metadatametaDataType
- Class of the metadata (used for type information)public void setExampleMetaData(List<? extends Serializable> exampleMetaData)
MultiDataSet
setExampleMetaData
in interface MultiDataSet
exampleMetaData
- Example metadata to setpublic int numFeatureArrays()
MultiDataSet
numFeatureArrays
in interface MultiDataSet
public int numLabelsArrays()
MultiDataSet
numLabelsArrays
in interface MultiDataSet
public INDArray[] getFeatures()
MultiDataSet
getFeatures
in interface MultiDataSet
public INDArray getFeatures(int index)
MultiDataSet
getFeatures
in interface MultiDataSet
public void setFeatures(INDArray[] features)
MultiDataSet
setFeatures
in interface MultiDataSet
public void setFeatures(int idx, INDArray features)
MultiDataSet
setFeatures
in interface MultiDataSet
public INDArray[] getLabels()
MultiDataSet
getLabels
in interface MultiDataSet
public INDArray getLabels(int index)
MultiDataSet
getLabels
in interface MultiDataSet
public void setLabels(INDArray[] labels)
MultiDataSet
setLabels
in interface MultiDataSet
public void setLabels(int idx, INDArray labels)
MultiDataSet
setLabels
in interface MultiDataSet
public boolean hasMaskArrays()
MultiDataSet
hasMaskArrays
in interface MultiDataSet
public INDArray[] getFeaturesMaskArrays()
MultiDataSet
getFeaturesMaskArrays
in interface MultiDataSet
public INDArray getFeaturesMaskArray(int index)
MultiDataSet
getFeaturesMaskArray
in interface MultiDataSet
public void setFeaturesMaskArrays(INDArray[] maskArrays)
MultiDataSet
setFeaturesMaskArrays
in interface MultiDataSet
public void setFeaturesMaskArray(int idx, INDArray maskArray)
MultiDataSet
setFeaturesMaskArray
in interface MultiDataSet
public INDArray[] getLabelsMaskArrays()
MultiDataSet
getLabelsMaskArrays
in interface MultiDataSet
public INDArray getLabelsMaskArray(int index)
MultiDataSet
getLabelsMaskArray
in interface MultiDataSet
public void setLabelsMaskArray(INDArray[] labelsMaskArrays)
MultiDataSet
setLabelsMaskArray
in interface MultiDataSet
public void setLabelsMaskArray(int idx, INDArray labelsMaskArray)
MultiDataSet
setLabelsMaskArray
in interface MultiDataSet
public void save(OutputStream to) throws IOException
MultiDataSet
save
in interface MultiDataSet
IOException
public void save(File to) throws IOException
MultiDataSet
save
in interface MultiDataSet
IOException
public void load(InputStream from) throws IOException
MultiDataSet
load
in interface MultiDataSet
IOException
public void load(File from) throws IOException
MultiDataSet
load
in interface MultiDataSet
IOException
public List<MultiDataSet> asList()
MultiDataSet
asList
in interface MultiDataSet
public MultiDataSet copy()
copy
in interface MultiDataSet
public static MultiDataSet merge(Collection<? extends MultiDataSet> toMerge)
toMerge
- Collection of MultiDataSet objects to mergepublic long getMemoryFootprint()
getMemoryFootprint
in interface MultiDataSet
public void migrate()
MultiDataSet
migrate
in interface MultiDataSet
public void detach()
detach
in interface MultiDataSet
Copyright © 2017. All rights reserved.