Package co.elastic.clients.elasticsearch.inference

Class PutCohereRequest

java.lang.Object
co.elastic.clients.elasticsearch._types.RequestBase
co.elastic.clients.elasticsearch.inference.PutCohereRequest
All Implemented Interfaces:
JsonpSerializable
@JsonpDeserializable public class PutCohereRequest extends RequestBase implements JsonpSerializable
Create a Cohere inference endpoint.

Create an inference endpoint to perform an inference task with the cohere service.

When you create an inference endpoint, the associated machine learning model is automatically deployed if it is not already running. After creating the endpoint, wait for the model deployment to complete before using it. To verify the deployment status, use the get trained model statistics API. Look for "state": "fully_allocated" in the response and ensure that the "allocation_count" matches the "target_allocation_count". Avoid creating multiple endpoints for the same model unless required, as each endpoint consumes significant resources.

See Also:

  • Field Details

  • Method Details

    • of

      public static PutCohereRequest of(Function<PutCohereRequest.Builder,ObjectBuilder<PutCohereRequest>> fn)

    • chunkingSettings

      @Nullable public final InferenceChunkingSettings chunkingSettings()
      The chunking configuration object.

      API name: chunking_settings

    • cohereInferenceId

      public final String cohereInferenceId()
      Required - The unique identifier of the inference endpoint.

      API name: cohere_inference_id

    • service

      public final CohereServiceType service()
      Required - The type of service supported for the specified task type. In this case, cohere.

      API name: service

    • serviceSettings

      public final CohereServiceSettings serviceSettings()
      Required - Settings used to install the inference model. These settings are specific to the cohere service.

      API name: service_settings

    • taskSettings

      @Nullable public final CohereTaskSettings taskSettings()
      Settings to configure the inference task. These settings are specific to the task type you specified.

      API name: task_settings

    • taskType

      public final CohereTaskType taskType()
      Required - The type of the inference task that the model will perform.

      API name: task_type

    • serialize

      public void serialize(jakarta.json.stream.JsonGenerator generator, JsonpMapper mapper)
      Serialize this object to JSON.
      Specified by:
      serialize in interface JsonpSerializable

    • serializeInternal

      protected void serializeInternal(jakarta.json.stream.JsonGenerator generator, JsonpMapper mapper)

    • setupPutCohereRequestDeserializer

      protected static void setupPutCohereRequestDeserializer(ObjectDeserializer<PutCohereRequest.Builder> op)