Package co.elastic.clients.elasticsearch.inference

Class RateLimitSetting

java.lang.Object

co.elastic.clients.elasticsearch.inference.RateLimitSetting

All Implemented Interfaces:

JsonpSerializable

@JsonpDeserializable
public class RateLimitSetting
extends Object
implements JsonpSerializable

This setting helps to minimize the number of rate limit errors returned from the service.

See Also:

• API specification

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	RateLimitSetting.Builder	Builder for RateLimitSetting.

Field Summary

Fields

Modifier and Type	Field	Description
static final JsonpDeserializer<RateLimitSetting>	_DESERIALIZER	Json deserializer for RateLimitSetting

Method Summary

Modifier and Type	Method	Description
static RateLimitSetting	of(Function<RateLimitSetting.Builder,ObjectBuilder<RateLimitSetting>> fn)
final Integer	requestsPerMinute()	The number of requests allowed per minute.
void	serialize(jakarta.json.stream.JsonGenerator generator, JsonpMapper mapper)	Serialize this object to JSON.
protected void	serializeInternal(jakarta.json.stream.JsonGenerator generator, JsonpMapper mapper)
protected static void	setupRateLimitSettingDeserializer(ObjectDeserializer<RateLimitSetting.Builder> op)
String	toString()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Details

_DESERIALIZER

public static final JsonpDeserializer<RateLimitSetting> _DESERIALIZER

Json deserializer for RateLimitSetting

Method Details

of

public static RateLimitSetting of(Function<RateLimitSetting.Builder,ObjectBuilder<RateLimitSetting>> fn)

requestsPerMinute

@Nullable
public final Integer requestsPerMinute()

The number of requests allowed per minute. By default, the number of requests allowed per minute is set by each service as follows:

• alibabacloud-ai-search service: 1000
• anthropic service: 50
• azureaistudio service: 240
• azureopenai service and task type text_embedding: 1440
• azureopenai service and task type completion: 120
• cohere service: 10000
• contextualai service: 1000
• elastic service and task type chat_completion: 240
• googleaistudio service: 360
• googlevertexai service: 30000
• hugging_face service: 3000
• jinaai service: 2000
• llama service: 3000
• mistral service: 240
• openai service and task type text_embedding: 3000
• openai service and task type completion: 500
• voyageai service: 2000
• watsonxai service: 120

API name: requests_per_minute

serialize

public void serialize(jakarta.json.stream.JsonGenerator generator,
 JsonpMapper mapper)

Serialize this object to JSON.

Specified by:

serialize in interface JsonpSerializable

serializeInternal

protected void serializeInternal(jakarta.json.stream.JsonGenerator generator,
 JsonpMapper mapper)

toString

public String toString()

Overrides:

toString in class Object

setupRateLimitSettingDeserializer

protected static void setupRateLimitSettingDeserializer(ObjectDeserializer<RateLimitSetting.Builder> op)