Package dev.langchain4j.model.openai

Class OpenAiStreamingChatModel

java.lang.Object

dev.langchain4j.model.openai.OpenAiStreamingChatModel

All Implemented Interfaces:

StreamingChatLanguageModel, TokenCountEstimator

public class OpenAiStreamingChatModel
extends Object
implements StreamingChatLanguageModel, TokenCountEstimator

Constructor Summary

Constructors

Constructor	Description
OpenAiStreamingChatModel(String apiKey, String modelName, Double temperature, Duration timeout, Boolean logRequests, Boolean logResponses)

Method Summary

Modifier and Type	Method	Description
int	estimateTokenCount(DocumentSegment documentSegment)
int	estimateTokenCount(UserMessage userMessage)
int	estimateTokenCount(Prompt prompt)
int	estimateTokenCount(Object structuredPrompt)
int	estimateTokenCount(String text)
int	estimateTokenCount(List<ChatMessage> messages)
void	sendMessages(List<ChatMessage> messages, StreamingResultHandler handler)
void	sendUserMessage(UserMessage userMessage, StreamingResultHandler handler)
void	sendUserMessage(Prompt prompt, StreamingResultHandler handler)
void	sendUserMessage(Object structuredPrompt, StreamingResultHandler handler)
void	sendUserMessage(String text, StreamingResultHandler handler)
static OpenAiStreamingChatModel	withApiKey(String apiKey)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

OpenAiStreamingChatModel

public OpenAiStreamingChatModel(String apiKey,
 String modelName,
 Double temperature,
 Duration timeout,
 Boolean logRequests,
 Boolean logResponses)

Method Details

sendUserMessage

public void sendUserMessage(String text,
 StreamingResultHandler handler)

Specified by:

sendUserMessage in interface StreamingChatLanguageModel

sendUserMessage

public void sendUserMessage(UserMessage userMessage,
 StreamingResultHandler handler)

Specified by:

sendUserMessage in interface StreamingChatLanguageModel

sendUserMessage

public void sendUserMessage(Prompt prompt,
 StreamingResultHandler handler)

Specified by:

sendUserMessage in interface StreamingChatLanguageModel

sendUserMessage

public void sendUserMessage(Object structuredPrompt,
 StreamingResultHandler handler)

Specified by:

sendUserMessage in interface StreamingChatLanguageModel

sendMessages

public void sendMessages(List<ChatMessage> messages,
 StreamingResultHandler handler)

Specified by:

sendMessages in interface StreamingChatLanguageModel

estimateTokenCount

public int estimateTokenCount(String text)

Specified by:

estimateTokenCount in interface TokenCountEstimator

estimateTokenCount

public int estimateTokenCount(UserMessage userMessage)

Specified by:

estimateTokenCount in interface TokenCountEstimator

estimateTokenCount

public int estimateTokenCount(Prompt prompt)

Specified by:

estimateTokenCount in interface TokenCountEstimator

estimateTokenCount

public int estimateTokenCount(Object structuredPrompt)

Specified by:

estimateTokenCount in interface TokenCountEstimator

estimateTokenCount

public int estimateTokenCount(List<ChatMessage> messages)

Specified by:

estimateTokenCount in interface TokenCountEstimator

estimateTokenCount

public int estimateTokenCount(DocumentSegment documentSegment)

Specified by:

estimateTokenCount in interface TokenCountEstimator

withApiKey

public static OpenAiStreamingChatModel withApiKey(String apiKey)