@Generated(value="software.amazon.awssdk:codegen") public final class Channel extends Object implements SdkPojo, Serializable, ToCopyableBuilder<Channel.Builder,Channel>
A channel is a named input source that training algorithms can consume.
Modifier and Type | Class and Description |
---|---|
static interface |
Channel.Builder |
Modifier and Type | Method and Description |
---|---|
static Channel.Builder |
builder() |
String |
channelName()
The name of the channel.
|
CompressionType |
compressionType()
If training data is compressed, the compression type.
|
String |
compressionTypeAsString()
If training data is compressed, the compression type.
|
String |
contentType()
The MIME type of the data.
|
DataSource |
dataSource()
The location of the channel data.
|
boolean |
equals(Object obj) |
boolean |
equalsBySdkFields(Object obj) |
<T> Optional<T> |
getValueForField(String fieldName,
Class<T> clazz) |
int |
hashCode() |
TrainingInputMode |
inputMode()
(Optional) The input mode to use for the data channel in a training job.
|
String |
inputModeAsString()
(Optional) The input mode to use for the data channel in a training job.
|
RecordWrapper |
recordWrapperType()
|
String |
recordWrapperTypeAsString()
|
List<SdkField<?>> |
sdkFields() |
static Class<? extends Channel.Builder> |
serializableBuilderClass() |
ShuffleConfig |
shuffleConfig()
A configuration for a shuffle option for input data in a channel.
|
Channel.Builder |
toBuilder() |
String |
toString()
Returns a string representation of this object.
|
clone, finalize, getClass, notify, notifyAll, wait, wait, wait
copy
public String channelName()
The name of the channel.
public DataSource dataSource()
The location of the channel data.
public String contentType()
The MIME type of the data.
public CompressionType compressionType()
If training data is compressed, the compression type. The default value is None
.
CompressionType
is used only in Pipe input mode. In File mode, leave this field unset or set it to
None.
If the service returns an enum value that is not available in the current SDK version, compressionType
will return CompressionType.UNKNOWN_TO_SDK_VERSION
. The raw value returned by the service is available
from compressionTypeAsString()
.
None
.
CompressionType
is used only in Pipe input mode. In File mode, leave this field unset or set
it to None.CompressionType
public String compressionTypeAsString()
If training data is compressed, the compression type. The default value is None
.
CompressionType
is used only in Pipe input mode. In File mode, leave this field unset or set it to
None.
If the service returns an enum value that is not available in the current SDK version, compressionType
will return CompressionType.UNKNOWN_TO_SDK_VERSION
. The raw value returned by the service is available
from compressionTypeAsString()
.
None
.
CompressionType
is used only in Pipe input mode. In File mode, leave this field unset or set
it to None.CompressionType
public RecordWrapper recordWrapperType()
Specify RecordIO as the value when input data is in raw format but the training algorithm requires the RecordIO format. In this case, Amazon SageMaker wraps each individual S3 object in a RecordIO record. If the input data is already in RecordIO format, you don't need to set this attribute. For more information, see Create a Dataset Using RecordIO.
In File mode, leave this field unset or set it to None.
If the service returns an enum value that is not available in the current SDK version, recordWrapperType
will return RecordWrapper.UNKNOWN_TO_SDK_VERSION
. The raw value returned by the service is available from
recordWrapperTypeAsString()
.
Specify RecordIO as the value when input data is in raw format but the training algorithm requires the RecordIO format. In this case, Amazon SageMaker wraps each individual S3 object in a RecordIO record. If the input data is already in RecordIO format, you don't need to set this attribute. For more information, see Create a Dataset Using RecordIO.
In File mode, leave this field unset or set it to None.
RecordWrapper
public String recordWrapperTypeAsString()
Specify RecordIO as the value when input data is in raw format but the training algorithm requires the RecordIO format. In this case, Amazon SageMaker wraps each individual S3 object in a RecordIO record. If the input data is already in RecordIO format, you don't need to set this attribute. For more information, see Create a Dataset Using RecordIO.
In File mode, leave this field unset or set it to None.
If the service returns an enum value that is not available in the current SDK version, recordWrapperType
will return RecordWrapper.UNKNOWN_TO_SDK_VERSION
. The raw value returned by the service is available from
recordWrapperTypeAsString()
.
Specify RecordIO as the value when input data is in raw format but the training algorithm requires the RecordIO format. In this case, Amazon SageMaker wraps each individual S3 object in a RecordIO record. If the input data is already in RecordIO format, you don't need to set this attribute. For more information, see Create a Dataset Using RecordIO.
In File mode, leave this field unset or set it to None.
RecordWrapper
public TrainingInputMode inputMode()
(Optional) The input mode to use for the data channel in a training job. If you don't set a value for
InputMode
, Amazon SageMaker uses the value set for TrainingInputMode
. Use this
parameter to override the TrainingInputMode
setting in a AlgorithmSpecification request when
you have a channel that needs a different input mode from the training job's general setting. To download the
data from Amazon Simple Storage Service (Amazon S3) to the provisioned ML storage volume, and mount the directory
to a Docker volume, use File
input mode. To stream data directly from Amazon S3 to the container,
choose Pipe
input mode.
To use a model for incremental training, choose File
input model.
If the service returns an enum value that is not available in the current SDK version, inputMode
will
return TrainingInputMode.UNKNOWN_TO_SDK_VERSION
. The raw value returned by the service is available from
inputModeAsString()
.
InputMode
, Amazon SageMaker uses the value set for TrainingInputMode
. Use this
parameter to override the TrainingInputMode
setting in a AlgorithmSpecification
request when you have a channel that needs a different input mode from the training job's general
setting. To download the data from Amazon Simple Storage Service (Amazon S3) to the provisioned ML
storage volume, and mount the directory to a Docker volume, use File
input mode. To stream
data directly from Amazon S3 to the container, choose Pipe
input mode.
To use a model for incremental training, choose File
input model.
TrainingInputMode
public String inputModeAsString()
(Optional) The input mode to use for the data channel in a training job. If you don't set a value for
InputMode
, Amazon SageMaker uses the value set for TrainingInputMode
. Use this
parameter to override the TrainingInputMode
setting in a AlgorithmSpecification request when
you have a channel that needs a different input mode from the training job's general setting. To download the
data from Amazon Simple Storage Service (Amazon S3) to the provisioned ML storage volume, and mount the directory
to a Docker volume, use File
input mode. To stream data directly from Amazon S3 to the container,
choose Pipe
input mode.
To use a model for incremental training, choose File
input model.
If the service returns an enum value that is not available in the current SDK version, inputMode
will
return TrainingInputMode.UNKNOWN_TO_SDK_VERSION
. The raw value returned by the service is available from
inputModeAsString()
.
InputMode
, Amazon SageMaker uses the value set for TrainingInputMode
. Use this
parameter to override the TrainingInputMode
setting in a AlgorithmSpecification
request when you have a channel that needs a different input mode from the training job's general
setting. To download the data from Amazon Simple Storage Service (Amazon S3) to the provisioned ML
storage volume, and mount the directory to a Docker volume, use File
input mode. To stream
data directly from Amazon S3 to the container, choose Pipe
input mode.
To use a model for incremental training, choose File
input model.
TrainingInputMode
public ShuffleConfig shuffleConfig()
A configuration for a shuffle option for input data in a channel. If you use S3Prefix
for
S3DataType
, this shuffles the results of the S3 key prefix matches. If you use
ManifestFile
, the order of the S3 object references in the ManifestFile
is shuffled. If
you use AugmentedManifestFile
, the order of the JSON lines in the AugmentedManifestFile
is shuffled. The shuffling order is determined using the Seed
value.
For Pipe input mode, shuffling is done at the start of every epoch. With large datasets this ensures that the
order of the training data is different for each epoch, it helps reduce bias and possible overfitting. In a
multi-node training job when ShuffleConfig is combined with S3DataDistributionType
of
ShardedByS3Key
, the data is shuffled across nodes so that the content sent to a particular node on
the first epoch might be sent to a different node on the second epoch.
S3Prefix
for
S3DataType
, this shuffles the results of the S3 key prefix matches. If you use
ManifestFile
, the order of the S3 object references in the ManifestFile
is
shuffled. If you use AugmentedManifestFile
, the order of the JSON lines in the
AugmentedManifestFile
is shuffled. The shuffling order is determined using the
Seed
value.
For Pipe input mode, shuffling is done at the start of every epoch. With large datasets this ensures that
the order of the training data is different for each epoch, it helps reduce bias and possible
overfitting. In a multi-node training job when ShuffleConfig is combined with
S3DataDistributionType
of ShardedByS3Key
, the data is shuffled across nodes so
that the content sent to a particular node on the first epoch might be sent to a different node on the
second epoch.
public Channel.Builder toBuilder()
toBuilder
in interface ToCopyableBuilder<Channel.Builder,Channel>
public static Channel.Builder builder()
public static Class<? extends Channel.Builder> serializableBuilderClass()
public boolean equalsBySdkFields(Object obj)
equalsBySdkFields
in interface SdkPojo
public String toString()
Copyright © 2020. All rights reserved.