All Implemented Interfaces:
```
public interface Tokenizer

                    
```
Represents an interface for estimating the count of tokens in various text types such as a text, prompt, text segment, etc. This can be useful when it's necessary to know in advance the cost of processing a specified text by the LLM.

Nested Class Summary

Nested Classes
Modifier and Type	Class	Description

Field Summary

Fields
Modifier and Type	Field	Description

Constructor Summary

Constructors
Constructor	Description

Enum Constant Summary

Enum Constants
Enum Constant	Description

Method Summary

Modifier and Type	Method	Description
`abstract int`	`estimateTokenCountInText(String text)`	Estimates the count of tokens in the given text.
`abstract int`	`estimateTokenCountInMessage(ChatMessage message)`	Estimates the count of tokens in the given message.
`abstract int`	`estimateTokenCountInMessages(Iterable<ChatMessage> messages)`	Estimates the count of tokens in the given messages.
`int`	`estimateTokenCountInTools(Object objectWithTools)`	Estimates the count of tokens in `Tool` annotations of the given object.
`int`	`estimateTokenCountInTools(Iterable<Object> objectsWithTools)`	Estimates the count of tokens in `Tool` annotations of the given objects.
`abstract int`	`estimateTokenCountInToolSpecifications(Iterable<ToolSpecification> toolSpecifications)`	Estimates the count of tokens in the given tool specifications.
`int`	`estimateTokenCountInForcefulToolSpecification(ToolSpecification toolSpecification)`	Estimates the count of tokens in the given tool specification.
`abstract int`	`estimateTokenCountInToolExecutionRequests(Iterable<ToolExecutionRequest> toolExecutionRequests)`	Estimates the count of tokens in the given tool execution requests.
`int`	`estimateTokenCountInForcefulToolExecutionRequest(ToolExecutionRequest toolExecutionRequest)`	Estimates the count of tokens in the given tool execution request.

Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

- Constructor Detail
- Method Detail
  - estimateTokenCountInText
```
 abstract int estimateTokenCountInText(String text)
```
    Estimates the count of tokens in the given text.
    
    Parameters:
    
    text - the text.
    
    Returns:
    
    the estimated count of tokens.
  - estimateTokenCountInMessage
```
 abstract int estimateTokenCountInMessage(ChatMessage message)
```
    Estimates the count of tokens in the given message.
    
    Parameters:
    
    message - the message.
    
    Returns:
    
    the estimated count of tokens.
  - estimateTokenCountInMessages
```
 abstract int estimateTokenCountInMessages(Iterable<ChatMessage> messages)
```
    Estimates the count of tokens in the given messages.
    
    Parameters:
    
    messages - the messages.
    
    Returns:
    
    the estimated count of tokens.
  - estimateTokenCountInTools
```
 int estimateTokenCountInTools(Object objectWithTools)
```
    Estimates the count of tokens in Tool annotations of the given object.
    
    Parameters:
    
    objectWithTools - the object.
    
    Returns:
    
    the estimated count of tokens.
  - estimateTokenCountInTools
```
 int estimateTokenCountInTools(Iterable<Object> objectsWithTools)
```
    Estimates the count of tokens in Tool annotations of the given objects.
    
    Parameters:
    
    objectsWithTools - the objects.
    
    Returns:
    
    the estimated count of tokens.
  - estimateTokenCountInToolSpecifications
```
 abstract int estimateTokenCountInToolSpecifications(Iterable<ToolSpecification> toolSpecifications)
```
    Estimates the count of tokens in the given tool specifications.
    
    Parameters:
    
    toolSpecifications - the tool specifications.
    
    Returns:
    
    the estimated count of tokens.
  - estimateTokenCountInForcefulToolSpecification
```
 int estimateTokenCountInForcefulToolSpecification(ToolSpecification toolSpecification)
```
    Estimates the count of tokens in the given tool specification.
    
    Parameters:
    
    toolSpecification - the tool specification.
    
    Returns:
    
    the estimated count of tokens.
  - estimateTokenCountInToolExecutionRequests
```
 abstract int estimateTokenCountInToolExecutionRequests(Iterable<ToolExecutionRequest> toolExecutionRequests)
```
    Estimates the count of tokens in the given tool execution requests.
    
    Parameters:
    
    toolExecutionRequests - the tool execution request.
    
    Returns:
    
    the estimated count of tokens.
  - estimateTokenCountInForcefulToolExecutionRequest
```
 int estimateTokenCountInForcefulToolExecutionRequest(ToolExecutionRequest toolExecutionRequest)
```
    Estimates the count of tokens in the given tool execution request.
    
    Parameters:
    
    toolExecutionRequest - the tool execution request.
    
    Returns:
    
    the estimated count of tokens.

Interface Tokenizer

Nested Class Summary

Field Summary

Constructor Summary

Enum Constant Summary

Method Summary

Methods inherited from class java.lang.Object

Constructor Detail

Method Detail

estimateTokenCountInText

estimateTokenCountInMessage

estimateTokenCountInMessages

estimateTokenCountInTools

estimateTokenCountInTools

estimateTokenCountInToolSpecifications

estimateTokenCountInForcefulToolSpecification

estimateTokenCountInToolExecutionRequests

estimateTokenCountInForcefulToolExecutionRequest