Package com.openai.models.evals
See: Description
-
Class Summary Class Description Builder A builder for EvalCreateParams. Builder A builder for Body. Body Builder A builder for Custom. Builder A builder for ItemSchema. ItemSchema The json schema for each row in the data source. Custom A CustomDataSourceConfig object that defines the schema for the data source used for the evaluation runs. Builder A builder for Logs. Builder A builder for Metadata. Metadata Metadata filters for the logs data source. Logs A data source config which specifies the metadata property of your stored completions query. DataSourceConfig The configuration for the data source used for the evaluation runs. Builder A builder for LabelModel. Builder A builder for SimpleInputMessage. SimpleInputMessage Builder A builder for EvalItem. Builder A builder for OutputText. OutputText A text output from the model. Content Text inputs to the model - can contain template strings. Role The role of the message input. Type The type of the message input. EvalItem A message input to the model with a role indicating instruction following hierarchy. Input A chat message that makes up the prompt or context. LabelModel A LabelModelGrader object which uses a model to assign labels to each item in the evaluation. Builder A builder for Python. Python A PythonGrader object that runs a python script on the input. Builder A builder for ScoreModel. Builder A builder for Input. Builder A builder for OutputText. OutputText A text output from the model. Content Text inputs to the model - can contain template strings. Role The role of the message input. Type The type of the message input. Input A message input to the model with a role indicating instruction following hierarchy. ScoreModel A ScoreModelGrader object that uses a model to assign a score to the input. TestingCriterion A LabelModelGrader object which uses a model to assign labels to each item in the evaluation. Builder A builder for Metadata. Metadata Set of 16 key-value pairs that can be attached to an object. EvalCreateParams Create the structure of an evaluation that can be used to test a model's performance. Builder A builder for EvalCreateResponse. DataSourceConfig Configuration of data sources used in runs of the evaluation. Builder A builder for Metadata. Metadata Set of 16 key-value pairs that can be attached to an object. Builder A builder for Python. Python A PythonGrader object that runs a python script on the input. Builder A builder for ScoreModel. Builder A builder for Input. Builder A builder for OutputText. OutputText A text output from the model. Content Text inputs to the model - can contain template strings. Role The role of the message input. Type The type of the message input. Input A message input to the model with a role indicating instruction following hierarchy. ScoreModel A ScoreModelGrader object that uses a model to assign a score to the input. TestingCriterion A LabelModelGrader object which uses a model to assign labels to each item in the evaluation. EvalCreateResponse An Eval object with a data source config and testing criteria. Builder A builder for EvalCustomDataSourceConfig. Builder A builder for Schema. Schema The json schema for the run data source items. EvalCustomDataSourceConfig A CustomDataSourceConfig which specifies the schema of your itemand optionallysamplenamespaces.Builder A builder for EvalDeleteParams. EvalDeleteParams Delete an evaluation. Builder A builder for EvalDeleteResponse. EvalDeleteResponse Builder A builder for EvalLabelModelGrader. Builder A builder for Input. Builder A builder for OutputText. OutputText A text output from the model. Content Text inputs to the model - can contain template strings. Role The role of the message input. Type The type of the message input. Input A message input to the model with a role indicating instruction following hierarchy. EvalLabelModelGrader A LabelModelGrader object which uses a model to assign labels to each item in the evaluation. Builder A builder for EvalListPage. AutoPager EvalListPage Builder A builder for EvalListPageAsync. AutoPager EvalListPageAsync Builder A builder for EvalListPageResponse. EvalListPageResponse An object representing a list of evals. Builder A builder for EvalListParams. Order Sort order for evals by timestamp. OrderBy Evals can be ordered by creation time or last updated time. EvalListParams List evaluations for a project. Builder A builder for EvalListResponse. DataSourceConfig Configuration of data sources used in runs of the evaluation. Builder A builder for Metadata. Metadata Set of 16 key-value pairs that can be attached to an object. Builder A builder for Python. Python A PythonGrader object that runs a python script on the input. Builder A builder for ScoreModel. Builder A builder for Input. Builder A builder for OutputText. OutputText A text output from the model. Content Text inputs to the model - can contain template strings. Role The role of the message input. Type The type of the message input. Input A message input to the model with a role indicating instruction following hierarchy. ScoreModel A ScoreModelGrader object that uses a model to assign a score to the input. TestingCriterion A LabelModelGrader object which uses a model to assign labels to each item in the evaluation. EvalListResponse An Eval object with a data source config and testing criteria. Builder A builder for EvalRetrieveParams. EvalRetrieveParams Get an evaluation by ID. Builder A builder for EvalRetrieveResponse. DataSourceConfig Configuration of data sources used in runs of the evaluation. Builder A builder for Metadata. Metadata Set of 16 key-value pairs that can be attached to an object. Builder A builder for Python. Python A PythonGrader object that runs a python script on the input. Builder A builder for ScoreModel. Builder A builder for Input. Builder A builder for OutputText. OutputText A text output from the model. Content Text inputs to the model - can contain template strings. Role The role of the message input. Type The type of the message input. Input A message input to the model with a role indicating instruction following hierarchy. ScoreModel A ScoreModelGrader object that uses a model to assign a score to the input. TestingCriterion A LabelModelGrader object which uses a model to assign labels to each item in the evaluation. EvalRetrieveResponse An Eval object with a data source config and testing criteria. Builder A builder for EvalStoredCompletionsDataSourceConfig. Builder A builder for Schema. Schema The json schema for the run data source items. Builder A builder for Metadata. Metadata Set of 16 key-value pairs that can be attached to an object. EvalStoredCompletionsDataSourceConfig A StoredCompletionsDataSourceConfig which specifies the metadata property of your stored completions query. Builder A builder for EvalStringCheckGrader. Operation The string check operation to perform. EvalStringCheckGrader A StringCheckGrader object that performs a string comparison between input and reference using a specified operation. Builder A builder for EvalTextSimilarityGrader. EvaluationMetric The evaluation metric to use. EvalTextSimilarityGrader A TextSimilarityGrader object which grades text based on similarity metrics. Builder A builder for EvalUpdateParams. Builder A builder for Body. Body Builder A builder for Metadata. Metadata Set of 16 key-value pairs that can be attached to an object. EvalUpdateParams Update certain properties of an evaluation. Builder A builder for EvalUpdateResponse. DataSourceConfig Configuration of data sources used in runs of the evaluation. Builder A builder for Metadata. Metadata Set of 16 key-value pairs that can be attached to an object. Builder A builder for Python. Python A PythonGrader object that runs a python script on the input. Builder A builder for ScoreModel. Builder A builder for Input. Builder A builder for OutputText. OutputText A text output from the model. Content Text inputs to the model - can contain template strings. Role The role of the message input. Type The type of the message input. Input A message input to the model with a role indicating instruction following hierarchy. ScoreModel A ScoreModelGrader object that uses a model to assign a score to the input. TestingCriterion A LabelModelGrader object which uses a model to assign labels to each item in the evaluation. EvalUpdateResponse An Eval object with a data source config and testing criteria. -
Interface Summary Interface Description Visitor An interface that defines how to map each variant of DataSourceConfig to a value of type T. Visitor An interface that defines how to map each variant of TestingCriterion to a value of type T. Visitor An interface that defines how to map each variant of Input to a value of type T. Visitor An interface that defines how to map each variant of Content to a value of type T. Visitor An interface that defines how to map each variant of Content to a value of type T. Visitor An interface that defines how to map each variant of DataSourceConfig to a value of type T. Visitor An interface that defines how to map each variant of TestingCriterion to a value of type T. Visitor An interface that defines how to map each variant of Content to a value of type T. Visitor An interface that defines how to map each variant of Content to a value of type T. Visitor An interface that defines how to map each variant of DataSourceConfig to a value of type T. Visitor An interface that defines how to map each variant of TestingCriterion to a value of type T. Visitor An interface that defines how to map each variant of Content to a value of type T. Visitor An interface that defines how to map each variant of DataSourceConfig to a value of type T. Visitor An interface that defines how to map each variant of TestingCriterion to a value of type T. Visitor An interface that defines how to map each variant of Content to a value of type T. Visitor An interface that defines how to map each variant of DataSourceConfig to a value of type T. Visitor An interface that defines how to map each variant of TestingCriterion to a value of type T. Visitor An interface that defines how to map each variant of Content to a value of type T. -
Enum Summary Enum Description Known An enum containing Role's known values. Value An enum containing Role's known values, as well as an _UNKNOWN member. Known An enum containing Type's known values. Value An enum containing Type's known values, as well as an _UNKNOWN member. Known An enum containing Role's known values. Value An enum containing Role's known values, as well as an _UNKNOWN member. Known An enum containing Type's known values. Value An enum containing Type's known values, as well as an _UNKNOWN member. Known An enum containing Role's known values. Value An enum containing Role's known values, as well as an _UNKNOWN member. Known An enum containing Type's known values. Value An enum containing Type's known values, as well as an _UNKNOWN member. Known An enum containing Role's known values. Value An enum containing Role's known values, as well as an _UNKNOWN member. Known An enum containing Type's known values. Value An enum containing Type's known values, as well as an _UNKNOWN member. Known An enum containing Order's known values. Value An enum containing Order's known values, as well as an _UNKNOWN member. Known An enum containing OrderBy's known values. Value An enum containing OrderBy's known values, as well as an _UNKNOWN member. Known An enum containing Role's known values. Value An enum containing Role's known values, as well as an _UNKNOWN member. Known An enum containing Type's known values. Value An enum containing Type's known values, as well as an _UNKNOWN member. Known An enum containing Role's known values. Value An enum containing Role's known values, as well as an _UNKNOWN member. Known An enum containing Type's known values. Value An enum containing Type's known values, as well as an _UNKNOWN member. Known An enum containing Operation's known values. Value An enum containing Operation's known values, as well as an _UNKNOWN member. Known An enum containing EvaluationMetric's known values. Value An enum containing EvaluationMetric's known values, as well as an _UNKNOWN member. Known An enum containing Role's known values. Value An enum containing Role's known values, as well as an _UNKNOWN member. Known An enum containing Type's known values. Value An enum containing Type's known values, as well as an _UNKNOWN member.