Class EvalCreateResponse.DataSourceConfig
-
- All Implemented Interfaces:
public final class EvalCreateResponse.DataSourceConfig
Configuration of data sources used in runs of the evaluation.
-
-
Nested Class Summary
Nested Classes Modifier and Type Class Description public interface
EvalCreateResponse.DataSourceConfig.Visitor
An interface that defines how to map each variant of DataSourceConfig to a value of type T.
-
Method Summary
Modifier and Type Method Description final Optional<EvalCustomDataSourceConfig>
custom()
A CustomDataSourceConfig which specifies the schema of your item
and optionallysample
namespaces.final Optional<EvalStoredCompletionsDataSourceConfig>
storedCompletions()
A StoredCompletionsDataSourceConfig which specifies the metadata property of your stored completions query. final Boolean
isCustom()
final Boolean
isStoredCompletions()
final EvalCustomDataSourceConfig
asCustom()
A CustomDataSourceConfig which specifies the schema of your item
and optionallysample
namespaces.final EvalStoredCompletionsDataSourceConfig
asStoredCompletions()
A StoredCompletionsDataSourceConfig which specifies the metadata property of your stored completions query. final Optional<JsonValue>
_json()
final <T extends Any> T
accept(EvalCreateResponse.DataSourceConfig.Visitor<T> visitor)
final EvalCreateResponse.DataSourceConfig
validate()
final Boolean
isValid()
Boolean
equals(Object other)
Integer
hashCode()
String
toString()
final static EvalCreateResponse.DataSourceConfig
ofCustom(EvalCustomDataSourceConfig custom)
A CustomDataSourceConfig which specifies the schema of your item
and optionallysample
namespaces.final static EvalCreateResponse.DataSourceConfig
ofStoredCompletions(EvalStoredCompletionsDataSourceConfig storedCompletions)
A StoredCompletionsDataSourceConfig which specifies the metadata property of your stored completions query. -
-
Method Detail
-
custom
final Optional<EvalCustomDataSourceConfig> custom()
A CustomDataSourceConfig which specifies the schema of your
item
and optionallysample
namespaces. The response schema defines the shape of the data that will be:Used to define your testing criteria and
What data is required when creating a run
-
storedCompletions
final Optional<EvalStoredCompletionsDataSourceConfig> storedCompletions()
A StoredCompletionsDataSourceConfig which specifies the metadata property of your stored completions query. This is usually metadata like
usecase=chatbot
orprompt-version=v2
, etc. The schema returned by this data source config is used to defined what variables are available in your evals.item
andsample
are both defined when using this data source config.
-
isStoredCompletions
final Boolean isStoredCompletions()
-
asCustom
final EvalCustomDataSourceConfig asCustom()
A CustomDataSourceConfig which specifies the schema of your
item
and optionallysample
namespaces. The response schema defines the shape of the data that will be:Used to define your testing criteria and
What data is required when creating a run
-
asStoredCompletions
final EvalStoredCompletionsDataSourceConfig asStoredCompletions()
A StoredCompletionsDataSourceConfig which specifies the metadata property of your stored completions query. This is usually metadata like
usecase=chatbot
orprompt-version=v2
, etc. The schema returned by this data source config is used to defined what variables are available in your evals.item
andsample
are both defined when using this data source config.
-
accept
final <T extends Any> T accept(EvalCreateResponse.DataSourceConfig.Visitor<T> visitor)
-
validate
final EvalCreateResponse.DataSourceConfig validate()
-
ofCustom
final static EvalCreateResponse.DataSourceConfig ofCustom(EvalCustomDataSourceConfig custom)
A CustomDataSourceConfig which specifies the schema of your
item
and optionallysample
namespaces. The response schema defines the shape of the data that will be:Used to define your testing criteria and
What data is required when creating a run
-
ofStoredCompletions
final static EvalCreateResponse.DataSourceConfig ofStoredCompletions(EvalStoredCompletionsDataSourceConfig storedCompletions)
A StoredCompletionsDataSourceConfig which specifies the metadata property of your stored completions query. This is usually metadata like
usecase=chatbot
orprompt-version=v2
, etc. The schema returned by this data source config is used to defined what variables are available in your evals.item
andsample
are both defined when using this data source config.
-
-
-
-