Class EvalUpdateResponse.DataSourceConfig
-
- All Implemented Interfaces:
public final class EvalUpdateResponse.DataSourceConfigConfiguration of data sources used in runs of the evaluation.
-
-
Nested Class Summary
Nested Classes Modifier and Type Class Description public interfaceEvalUpdateResponse.DataSourceConfig.VisitorAn interface that defines how to map each variant of DataSourceConfig to a value of type T.
-
Method Summary
Modifier and Type Method Description final Optional<EvalCustomDataSourceConfig>custom()A CustomDataSourceConfig which specifies the schema of your itemand optionallysamplenamespaces.final Optional<EvalStoredCompletionsDataSourceConfig>storedCompletions()A StoredCompletionsDataSourceConfig which specifies the metadata property of your stored completions query. final BooleanisCustom()final BooleanisStoredCompletions()final EvalCustomDataSourceConfigasCustom()A CustomDataSourceConfig which specifies the schema of your itemand optionallysamplenamespaces.final EvalStoredCompletionsDataSourceConfigasStoredCompletions()A StoredCompletionsDataSourceConfig which specifies the metadata property of your stored completions query. final Optional<JsonValue>_json()final <T extends Any> Taccept(EvalUpdateResponse.DataSourceConfig.Visitor<T> visitor)final EvalUpdateResponse.DataSourceConfigvalidate()final BooleanisValid()Booleanequals(Object other)IntegerhashCode()StringtoString()final static EvalUpdateResponse.DataSourceConfigofCustom(EvalCustomDataSourceConfig custom)A CustomDataSourceConfig which specifies the schema of your itemand optionallysamplenamespaces.final static EvalUpdateResponse.DataSourceConfigofStoredCompletions(EvalStoredCompletionsDataSourceConfig storedCompletions)A StoredCompletionsDataSourceConfig which specifies the metadata property of your stored completions query. -
-
Method Detail
-
custom
final Optional<EvalCustomDataSourceConfig> custom()
A CustomDataSourceConfig which specifies the schema of your
itemand optionallysamplenamespaces. The response schema defines the shape of the data that will be:Used to define your testing criteria and
What data is required when creating a run
-
storedCompletions
final Optional<EvalStoredCompletionsDataSourceConfig> storedCompletions()
A StoredCompletionsDataSourceConfig which specifies the metadata property of your stored completions query. This is usually metadata like
usecase=chatbotorprompt-version=v2, etc. The schema returned by this data source config is used to defined what variables are available in your evals.itemandsampleare both defined when using this data source config.
-
isStoredCompletions
final Boolean isStoredCompletions()
-
asCustom
final EvalCustomDataSourceConfig asCustom()
A CustomDataSourceConfig which specifies the schema of your
itemand optionallysamplenamespaces. The response schema defines the shape of the data that will be:Used to define your testing criteria and
What data is required when creating a run
-
asStoredCompletions
final EvalStoredCompletionsDataSourceConfig asStoredCompletions()
A StoredCompletionsDataSourceConfig which specifies the metadata property of your stored completions query. This is usually metadata like
usecase=chatbotorprompt-version=v2, etc. The schema returned by this data source config is used to defined what variables are available in your evals.itemandsampleare both defined when using this data source config.
-
accept
final <T extends Any> T accept(EvalUpdateResponse.DataSourceConfig.Visitor<T> visitor)
-
validate
final EvalUpdateResponse.DataSourceConfig validate()
-
ofCustom
final static EvalUpdateResponse.DataSourceConfig ofCustom(EvalCustomDataSourceConfig custom)
A CustomDataSourceConfig which specifies the schema of your
itemand optionallysamplenamespaces. The response schema defines the shape of the data that will be:Used to define your testing criteria and
What data is required when creating a run
-
ofStoredCompletions
final static EvalUpdateResponse.DataSourceConfig ofStoredCompletions(EvalStoredCompletionsDataSourceConfig storedCompletions)
A StoredCompletionsDataSourceConfig which specifies the metadata property of your stored completions query. This is usually metadata like
usecase=chatbotorprompt-version=v2, etc. The schema returned by this data source config is used to defined what variables are available in your evals.itemandsampleare both defined when using this data source config.
-
-
-
-