public interface InferenceServicePlugin
InferenceServicePlugins implement an inference service
-
Nested Class Summary
Modifier and TypeInterfaceDescriptionstatic interface
static final record
-
Method Summary
Modifier and TypeMethodDescriptionThe named writables defined and used by each of the implemented InferenceServices.
-
Method Details
-
getInferenceServiceFactories
List<InferenceServicePlugin.Factory> getInferenceServiceFactories() -
getInferenceServiceNamedWriteables
List<NamedWriteableRegistry.Entry> getInferenceServiceNamedWriteables()The named writables defined and used by each of the implemented InferenceServices. Each service should define named writables for -TaskSettings
-ServiceSettings
And optionally forInferenceResults
if the service uses a new type of result.- Returns:
- All named writables defined by the services
-