Class NlpRobertaTokenizationConfig
java.lang.Object
co.elastic.clients.elasticsearch.ml.NlpRobertaTokenizationConfig
- All Implemented Interfaces:
TokenizationConfigVariant
,JsonpSerializable
@JsonpDeserializable
public class NlpRobertaTokenizationConfig
extends Object
implements TokenizationConfigVariant, JsonpSerializable
RoBERTa tokenization configuration options
- See Also:
-
Nested Class Summary
-
Field Summary
Modifier and TypeFieldDescriptionstatic final JsonpDeserializer<NlpRobertaTokenizationConfig>
Json deserializer forNlpRobertaTokenizationConfig
-
Method Summary
Modifier and TypeMethodDescriptionTokenizationConfig variant kind.final Boolean
Should the tokenizer prefix input with a space characterfinal Integer
Maximum input sequence length for the modelstatic NlpRobertaTokenizationConfig
void
serialize
(jakarta.json.stream.JsonGenerator generator, JsonpMapper mapper) Serialize this object to JSON.protected void
serializeInternal
(jakarta.json.stream.JsonGenerator generator, JsonpMapper mapper) protected static void
setupNlpRobertaTokenizationConfigDeserializer
(ObjectDeserializer<NlpRobertaTokenizationConfig.Builder> op) final Integer
span()
Tokenization spanning options.toString()
final TokenizationTruncate
truncate()
Should tokenization input be automatically truncated before sending to the model for inferencefinal Boolean
Is tokenization completed with special tokensMethods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait
Methods inherited from interface co.elastic.clients.elasticsearch.ml.TokenizationConfigVariant
_toTokenizationConfig
-
Field Details
-
_DESERIALIZER
Json deserializer forNlpRobertaTokenizationConfig
-
-
Method Details
-
of
-
_tokenizationConfigKind
TokenizationConfig variant kind.- Specified by:
_tokenizationConfigKind
in interfaceTokenizationConfigVariant
-
addPrefixSpace
Should the tokenizer prefix input with a space characterAPI name:
add_prefix_space
-
withSpecialTokens
Is tokenization completed with special tokensAPI name:
with_special_tokens
-
maxSequenceLength
Maximum input sequence length for the modelAPI name:
max_sequence_length
-
truncate
Should tokenization input be automatically truncated before sending to the model for inferenceAPI name:
truncate
-
span
Tokenization spanning options. Special value of -1 indicates no spanning takes placeAPI name:
span
-
serialize
Serialize this object to JSON.- Specified by:
serialize
in interfaceJsonpSerializable
-
serializeInternal
-
toString
-
setupNlpRobertaTokenizationConfigDeserializer
protected static void setupNlpRobertaTokenizationConfigDeserializer(ObjectDeserializer<NlpRobertaTokenizationConfig.Builder> op)
-