Package com.openai.models.evals

Class Summary
Class	Description
Builder	A builder for EvalCreateParams.
Builder	A builder for Body.
Body
Builder	A builder for Custom.
Builder	A builder for ItemSchema.
ItemSchema	The json schema for each row in the data source.
Custom	A CustomDataSourceConfig object that defines the schema for the data source used for the evaluation runs.
Builder	A builder for Logs.
Builder	A builder for Metadata.
Metadata	Metadata filters for the logs data source.
Logs	A data source config which specifies the metadata property of your logs query.
Builder	A builder for StoredCompletions.
Builder	A builder for Metadata.
Metadata	Metadata filters for the stored completions data source.
StoredCompletions	Deprecated in favor of LogsDataSourceConfig.
DataSourceConfig	The configuration for the data source used for the evaluation runs.
Builder	A builder for LabelModel.
Builder	A builder for SimpleInputMessage.
SimpleInputMessage
Builder	A builder for EvalItem.
Builder	A builder for OutputText.
OutputText	A text output from the model.
Content	Text inputs to the model - can contain template strings.
Role	The role of the message input.
Type	The type of the message input.
EvalItem	A message input to the model with a role indicating instruction following hierarchy.
Input	A chat message that makes up the prompt or context.
LabelModel	A LabelModelGrader object which uses a model to assign labels to each item in the evaluation.
Builder	A builder for TextSimilarity.
TextSimilarity	A TextSimilarityGrader object which grades text based on similarity metrics.
Builder	A builder for Python.
Python	A PythonGrader object that runs a python script on the input.
Builder	A builder for ScoreModel.
ScoreModel	A ScoreModelGrader object that uses a model to assign a score to the input.
TestingCriterion	A LabelModelGrader object which uses a model to assign labels to each item in the evaluation.
Builder	A builder for Metadata.
Metadata	Set of 16 key-value pairs that can be attached to an object.
EvalCreateParams	Create the structure of an evaluation that can be used to test a model's performance.
Builder	A builder for EvalCreateResponse.
Builder	A builder for Logs.
Builder	A builder for Schema.
Schema	The json schema for the run data source items.
Builder	A builder for Metadata.
Metadata	Set of 16 key-value pairs that can be attached to an object.
Logs	A LogsDataSourceConfig which specifies the metadata property of your logs query.
DataSourceConfig	Configuration of data sources used in runs of the evaluation.
Builder	A builder for Metadata.
Metadata	Set of 16 key-value pairs that can be attached to an object.
Builder	A builder for EvalGraderTextSimilarity.
EvalGraderTextSimilarity	A TextSimilarityGrader object which grades text based on similarity metrics.
Builder	A builder for EvalGraderPython.
EvalGraderPython	A PythonGrader object that runs a python script on the input.
Builder	A builder for EvalGraderScoreModel.
EvalGraderScoreModel	A ScoreModelGrader object that uses a model to assign a score to the input.
TestingCriterion	A LabelModelGrader object which uses a model to assign labels to each item in the evaluation.
EvalCreateResponse	An Eval object with a data source config and testing criteria.
Builder	A builder for EvalCustomDataSourceConfig.
Builder	A builder for Schema.
Schema	The json schema for the run data source items.
EvalCustomDataSourceConfig	A CustomDataSourceConfig which specifies the schema of your `item` and optionally `sample` namespaces.
Builder	A builder for EvalDeleteParams.
EvalDeleteParams	Delete an evaluation.
Builder	A builder for EvalDeleteResponse.
EvalDeleteResponse
Builder	A builder for EvalListPage.
EvalListPage
Builder	A builder for EvalListPageAsync.
EvalListPageAsync
Builder	A builder for EvalListPageResponse.
EvalListPageResponse	An object representing a list of evals.
Builder	A builder for EvalListParams.
Order	Sort order for evals by timestamp.
OrderBy	Evals can be ordered by creation time or last updated time.
EvalListParams	List evaluations for a project.
Builder	A builder for EvalListResponse.
Builder	A builder for Logs.
Builder	A builder for Schema.
Schema	The json schema for the run data source items.
Builder	A builder for Metadata.
Metadata	Set of 16 key-value pairs that can be attached to an object.
Logs	A LogsDataSourceConfig which specifies the metadata property of your logs query.
DataSourceConfig	Configuration of data sources used in runs of the evaluation.
Builder	A builder for Metadata.
Metadata	Set of 16 key-value pairs that can be attached to an object.
Builder	A builder for EvalGraderTextSimilarity.
EvalGraderTextSimilarity	A TextSimilarityGrader object which grades text based on similarity metrics.
Builder	A builder for EvalGraderPython.
EvalGraderPython	A PythonGrader object that runs a python script on the input.
Builder	A builder for EvalGraderScoreModel.
EvalGraderScoreModel	A ScoreModelGrader object that uses a model to assign a score to the input.
TestingCriterion	A LabelModelGrader object which uses a model to assign labels to each item in the evaluation.
EvalListResponse	An Eval object with a data source config and testing criteria.
Builder	A builder for EvalRetrieveParams.
EvalRetrieveParams	Get an evaluation by ID.
Builder	A builder for EvalRetrieveResponse.
Builder	A builder for Logs.
Builder	A builder for Schema.
Schema	The json schema for the run data source items.
Builder	A builder for Metadata.
Metadata	Set of 16 key-value pairs that can be attached to an object.
Logs	A LogsDataSourceConfig which specifies the metadata property of your logs query.
DataSourceConfig	Configuration of data sources used in runs of the evaluation.
Builder	A builder for Metadata.
Metadata	Set of 16 key-value pairs that can be attached to an object.
Builder	A builder for EvalGraderTextSimilarity.
EvalGraderTextSimilarity	A TextSimilarityGrader object which grades text based on similarity metrics.
Builder	A builder for EvalGraderPython.
EvalGraderPython	A PythonGrader object that runs a python script on the input.
Builder	A builder for EvalGraderScoreModel.
EvalGraderScoreModel	A ScoreModelGrader object that uses a model to assign a score to the input.
TestingCriterion	A LabelModelGrader object which uses a model to assign labels to each item in the evaluation.
EvalRetrieveResponse	An Eval object with a data source config and testing criteria.
Builder	A builder for EvalStoredCompletionsDataSourceConfig.
Builder	A builder for Schema.
Schema	The json schema for the run data source items.
Builder	A builder for Metadata.
Metadata	Set of 16 key-value pairs that can be attached to an object.
EvalStoredCompletionsDataSourceConfig	Deprecated in favor of LogsDataSourceConfig.
Builder	A builder for EvalUpdateParams.
Builder	A builder for Body.
Body
Builder	A builder for Metadata.
Metadata	Set of 16 key-value pairs that can be attached to an object.
EvalUpdateParams	Update certain properties of an evaluation.
Builder	A builder for EvalUpdateResponse.
Builder	A builder for Logs.
Builder	A builder for Schema.
Schema	The json schema for the run data source items.
Builder	A builder for Metadata.
Metadata	Set of 16 key-value pairs that can be attached to an object.
Logs	A LogsDataSourceConfig which specifies the metadata property of your logs query.
DataSourceConfig	Configuration of data sources used in runs of the evaluation.
Builder	A builder for Metadata.
Metadata	Set of 16 key-value pairs that can be attached to an object.
Builder	A builder for EvalGraderTextSimilarity.
EvalGraderTextSimilarity	A TextSimilarityGrader object which grades text based on similarity metrics.
Builder	A builder for EvalGraderPython.
EvalGraderPython	A PythonGrader object that runs a python script on the input.
Builder	A builder for EvalGraderScoreModel.
EvalGraderScoreModel	A ScoreModelGrader object that uses a model to assign a score to the input.
TestingCriterion	A LabelModelGrader object which uses a model to assign labels to each item in the evaluation.
EvalUpdateResponse	An Eval object with a data source config and testing criteria.

Interface Summary
Interface	Description
Visitor	An interface that defines how to map each variant of DataSourceConfig to a value of type T.
Visitor	An interface that defines how to map each variant of TestingCriterion to a value of type T.
Visitor	An interface that defines how to map each variant of Input to a value of type T.
Visitor	An interface that defines how to map each variant of Content to a value of type T.
Visitor	An interface that defines how to map each variant of DataSourceConfig to a value of type T.
Visitor	An interface that defines how to map each variant of TestingCriterion to a value of type T.
Visitor	An interface that defines how to map each variant of DataSourceConfig to a value of type T.
Visitor	An interface that defines how to map each variant of TestingCriterion to a value of type T.
Visitor	An interface that defines how to map each variant of DataSourceConfig to a value of type T.
Visitor	An interface that defines how to map each variant of TestingCriterion to a value of type T.
Visitor	An interface that defines how to map each variant of DataSourceConfig to a value of type T.
Visitor	An interface that defines how to map each variant of TestingCriterion to a value of type T.

Enum Summary
Enum	Description
Known	An enum containing Role's known values.
Value	An enum containing Role's known values, as well as an _UNKNOWN member.
Known	An enum containing Type's known values.
Value	An enum containing Type's known values, as well as an _UNKNOWN member.
Known	An enum containing Order's known values.
Value	An enum containing Order's known values, as well as an _UNKNOWN member.
Known	An enum containing OrderBy's known values.
Value	An enum containing OrderBy's known values, as well as an _UNKNOWN member.