dev.langchain4j.model.openai

Class OpenAiStreamingLanguageModel

java.lang.Object

dev.langchain4j.model.openai.OpenAiStreamingLanguageModel

All Implemented Interfaces:

StreamingLanguageModel, TokenCountEstimator

public class OpenAiStreamingLanguageModel
extends Object
implements StreamingLanguageModel, TokenCountEstimator

Represents an OpenAI language model with a completion interface, such as gpt-3.5-turbo-instruct. The model's response is streamed token by token and should be handled with StreamingResponseHandler. However, it's recommended to use OpenAiStreamingChatModel instead, as it offers more advanced features like function calling, multi-turn conversations, etc.

Constructor Summary

Constructors

Constructor and Description
OpenAiStreamingLanguageModel(String baseUrl, String apiKey, String organizationId, String modelName, Double temperature, Duration timeout, Proxy proxy, Boolean logRequests, Boolean logResponses, Tokenizer tokenizer)

Method Summary

Modifier and Type	Method and Description
int	estimateTokenCount(String prompt)
void	generate(String prompt, StreamingResponseHandler<String> handler)
static OpenAiStreamingLanguageModel	withApiKey(String apiKey)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface dev.langchain4j.model.language.StreamingLanguageModel

generate

Methods inherited from interface dev.langchain4j.model.language.TokenCountEstimator

estimateTokenCount, estimateTokenCount

Constructor Detail

OpenAiStreamingLanguageModel

public OpenAiStreamingLanguageModel(String baseUrl,
                                    String apiKey,
                                    String organizationId,
                                    String modelName,
                                    Double temperature,
                                    Duration timeout,
                                    Proxy proxy,
                                    Boolean logRequests,
                                    Boolean logResponses,
                                    Tokenizer tokenizer)

Method Detail

generate

public void generate(String prompt,
                     StreamingResponseHandler<String> handler)

Specified by:

generate in interface StreamingLanguageModel

estimateTokenCount

public int estimateTokenCount(String prompt)

Specified by:

estimateTokenCount in interface TokenCountEstimator

withApiKey

public static OpenAiStreamingLanguageModel withApiKey(String apiKey)