Class MultiModelConfig
- java.lang.Object
-
- software.amazon.awssdk.services.sagemaker.model.MultiModelConfig
-
- All Implemented Interfaces:
Serializable
,SdkPojo
,ToCopyableBuilder<MultiModelConfig.Builder,MultiModelConfig>
@Generated("software.amazon.awssdk:codegen") public final class MultiModelConfig extends Object implements SdkPojo, Serializable, ToCopyableBuilder<MultiModelConfig.Builder,MultiModelConfig>
Specifies additional configuration for hosting multi-model endpoints.
- See Also:
- Serialized Form
-
-
Nested Class Summary
Nested Classes Modifier and Type Class Description static interface
MultiModelConfig.Builder
-
Method Summary
All Methods Static Methods Instance Methods Concrete Methods Modifier and Type Method Description static MultiModelConfig.Builder
builder()
boolean
equals(Object obj)
boolean
equalsBySdkFields(Object obj)
<T> Optional<T>
getValueForField(String fieldName, Class<T> clazz)
int
hashCode()
ModelCacheSetting
modelCacheSetting()
Whether to cache models for a multi-model endpoint.String
modelCacheSettingAsString()
Whether to cache models for a multi-model endpoint.Map<String,SdkField<?>>
sdkFieldNameToField()
List<SdkField<?>>
sdkFields()
static Class<? extends MultiModelConfig.Builder>
serializableBuilderClass()
MultiModelConfig.Builder
toBuilder()
String
toString()
Returns a string representation of this object.-
Methods inherited from class java.lang.Object
clone, finalize, getClass, notify, notifyAll, wait, wait, wait
-
Methods inherited from interface software.amazon.awssdk.utils.builder.ToCopyableBuilder
copy
-
-
-
-
Method Detail
-
modelCacheSetting
public final ModelCacheSetting modelCacheSetting()
Whether to cache models for a multi-model endpoint. By default, multi-model endpoints cache models so that a model does not have to be loaded into memory each time it is invoked. Some use cases do not benefit from model caching. For example, if an endpoint hosts a large number of models that are each invoked infrequently, the endpoint might perform better if you disable model caching. To disable model caching, set the value of this parameter to
Disabled
.If the service returns an enum value that is not available in the current SDK version,
modelCacheSetting
will returnModelCacheSetting.UNKNOWN_TO_SDK_VERSION
. The raw value returned by the service is available frommodelCacheSettingAsString()
.- Returns:
- Whether to cache models for a multi-model endpoint. By default, multi-model endpoints cache models so
that a model does not have to be loaded into memory each time it is invoked. Some use cases do not
benefit from model caching. For example, if an endpoint hosts a large number of models that are each
invoked infrequently, the endpoint might perform better if you disable model caching. To disable model
caching, set the value of this parameter to
Disabled
. - See Also:
ModelCacheSetting
-
modelCacheSettingAsString
public final String modelCacheSettingAsString()
Whether to cache models for a multi-model endpoint. By default, multi-model endpoints cache models so that a model does not have to be loaded into memory each time it is invoked. Some use cases do not benefit from model caching. For example, if an endpoint hosts a large number of models that are each invoked infrequently, the endpoint might perform better if you disable model caching. To disable model caching, set the value of this parameter to
Disabled
.If the service returns an enum value that is not available in the current SDK version,
modelCacheSetting
will returnModelCacheSetting.UNKNOWN_TO_SDK_VERSION
. The raw value returned by the service is available frommodelCacheSettingAsString()
.- Returns:
- Whether to cache models for a multi-model endpoint. By default, multi-model endpoints cache models so
that a model does not have to be loaded into memory each time it is invoked. Some use cases do not
benefit from model caching. For example, if an endpoint hosts a large number of models that are each
invoked infrequently, the endpoint might perform better if you disable model caching. To disable model
caching, set the value of this parameter to
Disabled
. - See Also:
ModelCacheSetting
-
toBuilder
public MultiModelConfig.Builder toBuilder()
- Specified by:
toBuilder
in interfaceToCopyableBuilder<MultiModelConfig.Builder,MultiModelConfig>
-
builder
public static MultiModelConfig.Builder builder()
-
serializableBuilderClass
public static Class<? extends MultiModelConfig.Builder> serializableBuilderClass()
-
equalsBySdkFields
public final boolean equalsBySdkFields(Object obj)
- Specified by:
equalsBySdkFields
in interfaceSdkPojo
-
toString
public final String toString()
Returns a string representation of this object. This is useful for testing and debugging. Sensitive data will be redacted from this string using a placeholder value.
-
sdkFieldNameToField
public final Map<String,SdkField<?>> sdkFieldNameToField()
- Specified by:
sdkFieldNameToField
in interfaceSdkPojo
-
-