Package io.quarkiverse.langchain4j.ollama

Class OllamaStreamingChatLanguageModel

java.lang.Object

io.quarkiverse.langchain4j.ollama.OllamaStreamingChatLanguageModel

All Implemented Interfaces:

dev.langchain4j.model.chat.StreamingChatLanguageModel

public class OllamaStreamingChatLanguageModel
extends Object
implements dev.langchain4j.model.chat.StreamingChatLanguageModel

Use to have streaming feature on models used trough Ollama.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static final class	OllamaStreamingChatLanguageModel.Builder	Builder for Ollama configuration.

Method Summary

Modifier and Type	Method	Description
static OllamaStreamingChatLanguageModel.Builder	builder()
void	generate(List<dev.langchain4j.data.message.ChatMessage> messages, dev.langchain4j.model.StreamingResponseHandler<dev.langchain4j.data.message.AiMessage> handler)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface dev.langchain4j.model.chat.StreamingChatLanguageModel

generate, generate, generate, generate

Method Details

builder

public static OllamaStreamingChatLanguageModel.Builder builder()

generate

public void generate(List<dev.langchain4j.data.message.ChatMessage> messages,
 dev.langchain4j.model.StreamingResponseHandler<dev.langchain4j.data.message.AiMessage> handler)

Specified by:

generate in interface dev.langchain4j.model.chat.StreamingChatLanguageModel