Interface | Description |
---|---|
ChatLanguageModel |
Represents a LLM that has a chat interface.
|
StreamingChatLanguageModel |
Represents a LLM that has a chat interface and can stream responses one token at a time.
|
TokenCountEstimator |
Represents an interface for estimating the count of tokens in various text types such as a text, message, prompt, text segment, etc.
|
Copyright © 2023. All rights reserved.