Package ai.vespa.llm.clients

Class ConfigurableLanguageModel

java.lang.Object

ai.vespa.llm.clients.ConfigurableLanguageModel

All Implemented Interfaces:

ai.vespa.llm.LanguageModel

Direct Known Subclasses:

OpenAI

public abstract class ConfigurableLanguageModel
extends Object
implements ai.vespa.llm.LanguageModel

Base class for language models that can be configured with config definitions.

Author:

lesters

Constructor Summary

Constructors

Constructor	Description
ConfigurableLanguageModel()
ConfigurableLanguageModel(LlmClientConfig config, com.yahoo.container.jdisc.secretstore.SecretStore secretStore)

Method Summary

Modifier and Type	Method	Description
protected String	getApiKey(ai.vespa.llm.InferenceParameters params)
protected String	getEndpoint()
protected void	setApiKey(ai.vespa.llm.InferenceParameters params)	Set the API key as retrieved from secret store if it is not already set
protected void	setEndpoint(ai.vespa.llm.InferenceParameters params)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface ai.vespa.llm.LanguageModel

complete, completeAsync

Constructor Details

ConfigurableLanguageModel

public ConfigurableLanguageModel()

ConfigurableLanguageModel

@Inject
public ConfigurableLanguageModel(LlmClientConfig config,
 com.yahoo.container.jdisc.secretstore.SecretStore secretStore)

Method Details

getApiKey

protected String getApiKey(ai.vespa.llm.InferenceParameters params)

setApiKey

protected void setApiKey(ai.vespa.llm.InferenceParameters params)

Set the API key as retrieved from secret store if it is not already set

getEndpoint

protected String getEndpoint()

setEndpoint

protected void setEndpoint(ai.vespa.llm.InferenceParameters params)