Package co.elastic.clients.elasticsearch.ml

Class NlpRobertaTokenizationConfig

java.lang.Object

co.elastic.clients.elasticsearch.ml.CommonTokenizationConfig

co.elastic.clients.elasticsearch.ml.NlpRobertaTokenizationConfig

All Implemented Interfaces:

TokenizationConfigVariant, JsonpSerializable

@JsonpDeserializable
public class NlpRobertaTokenizationConfig
extends CommonTokenizationConfig
implements TokenizationConfigVariant

RoBERTa tokenization configuration options

See Also:

• API specification

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	NlpRobertaTokenizationConfig.Builder	Builder for NlpRobertaTokenizationConfig.

Nested classes/interfaces inherited from class co.elastic.clients.elasticsearch.ml.CommonTokenizationConfig

CommonTokenizationConfig.AbstractBuilder<BuilderT extends CommonTokenizationConfig.AbstractBuilder<BuilderT>>

Field Summary

Fields

Modifier and Type	Field	Description
static final JsonpDeserializer<NlpRobertaTokenizationConfig>	_DESERIALIZER	Json deserializer for NlpRobertaTokenizationConfig

Method Summary

Modifier and Type	Method	Description
TokenizationConfig.Kind	_tokenizationConfigKind()	TokenizationConfig variant kind.
final Boolean	addPrefixSpace()	Should the tokenizer prefix input with a space character
static NlpRobertaTokenizationConfig	of(Function<NlpRobertaTokenizationConfig.Builder,ObjectBuilder<NlpRobertaTokenizationConfig>> fn)
protected void	serializeInternal(jakarta.json.stream.JsonGenerator generator, JsonpMapper mapper)
protected static void	setupNlpRobertaTokenizationConfigDeserializer(ObjectDeserializer<NlpRobertaTokenizationConfig.Builder> op)

Methods inherited from class co.elastic.clients.elasticsearch.ml.CommonTokenizationConfig

doLowerCase, maxSequenceLength, serialize, setupCommonTokenizationConfigDeserializer, span, toString, truncate, withSpecialTokens

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface co.elastic.clients.elasticsearch.ml.TokenizationConfigVariant

_toTokenizationConfig

Field Details

_DESERIALIZER

public static final JsonpDeserializer<NlpRobertaTokenizationConfig> _DESERIALIZER

Json deserializer for NlpRobertaTokenizationConfig

Method Details

of

public static NlpRobertaTokenizationConfig of(Function<NlpRobertaTokenizationConfig.Builder,ObjectBuilder<NlpRobertaTokenizationConfig>> fn)

_tokenizationConfigKind

public TokenizationConfig.Kind _tokenizationConfigKind()

TokenizationConfig variant kind.

Specified by:

_tokenizationConfigKind in interface TokenizationConfigVariant

addPrefixSpace

@Nullable
public final Boolean addPrefixSpace()

Should the tokenizer prefix input with a space character

API name: add_prefix_space

serializeInternal

protected void serializeInternal(jakarta.json.stream.JsonGenerator generator,
 JsonpMapper mapper)

Overrides:

serializeInternal in class CommonTokenizationConfig

setupNlpRobertaTokenizationConfigDeserializer

protected static void setupNlpRobertaTokenizationConfigDeserializer(ObjectDeserializer<NlpRobertaTokenizationConfig.Builder> op)