Tokenizer (langchain4j-core 0.4.0 API)

public interface Tokenizer

Method Summary

Modifier and Type

Method

Description

int

countTokens(ChatMessage message)

int

countTokens(Iterable<ChatMessage> messages)

int

countTokens(String text)

Method Details
- countTokens
  
  int countTokens(String text)
- countTokens
  
  int countTokens(ChatMessage message)
- countTokens
  
  int countTokens(Iterable<ChatMessage> messages)