Package com.openai.models.evals
See: Description
-
Class Summary Class Description Builder A builder for EvalCreateParams. Builder A builder for Body. Body Builder A builder for Custom. Builder A builder for ItemSchema. ItemSchema The json schema for the run data source items. Custom A CustomDataSourceConfig object that defines the schema for the data source used for the evaluation runs. Builder A builder for StoredCompletions. Builder A builder for Metadata. Metadata Set of 16 key-value pairs that can be attached to an object. StoredCompletions A data source config which specifies the metadata property of your stored completions query. DataSourceConfig The configuration for the data source used for the evaluation runs. Builder A builder for LabelModel. Builder A builder for SimpleInputMessage. SimpleInputMessage Builder A builder for InputMessage. Builder A builder for Content. Type The type of content, which is always input_text.Content Role The role of the message. Type The type of item, which is always message.InputMessage Builder A builder for OutputMessage. Builder A builder for Content. Type The type of content, which is always output_text.Content Role The role of the message. Type The type of item, which is always message.OutputMessage Input LabelModel A LabelModelGrader object which uses a model to assign labels to each item in the evaluation. TestingCriterion A LabelModelGrader object which uses a model to assign labels to each item in the evaluation. Builder A builder for Metadata. Metadata Set of 16 key-value pairs that can be attached to an object. EvalCreateParams Create the structure of an evaluation that can be used to test a model's performance. Builder A builder for EvalCreateResponse. DataSourceConfig Configuration of data sources used in runs of the evaluation. Builder A builder for Metadata. Metadata Set of 16 key-value pairs that can be attached to an object. TestingCriterion A LabelModelGrader object which uses a model to assign labels to each item in the evaluation. EvalCreateResponse An Eval object with a data source config and testing criteria. Builder A builder for EvalCustomDataSourceConfig. Builder A builder for Schema. Schema The json schema for the run data source items. EvalCustomDataSourceConfig A CustomDataSourceConfig which specifies the schema of your itemand optionallysamplenamespaces.Builder A builder for EvalDeleteParams. EvalDeleteParams Delete an evaluation. Builder A builder for EvalDeleteResponse. EvalDeleteResponse Builder A builder for EvalLabelModelGrader. Builder A builder for InputMessage. Builder A builder for Content. Type The type of content, which is always input_text.Content Role The role of the message. Type The type of item, which is always message.InputMessage Builder A builder for Assistant. Builder A builder for Content. Type The type of content, which is always output_text.Content Type The type of item, which is always message.Assistant Input An item can either be an input message or an output message. EvalLabelModelGrader A LabelModelGrader object which uses a model to assign labels to each item in the evaluation. Builder Response AutoPager EvalListPage List evaluations for a project. Builder Response AutoPager EvalListPageAsync List evaluations for a project. Builder A builder for EvalListParams. Order Sort order for evals by timestamp. OrderBy Evals can be ordered by creation time or last updated time. EvalListParams List evaluations for a project. Builder A builder for EvalListResponse. DataSourceConfig Configuration of data sources used in runs of the evaluation. Builder A builder for Metadata. Metadata Set of 16 key-value pairs that can be attached to an object. TestingCriterion A LabelModelGrader object which uses a model to assign labels to each item in the evaluation. EvalListResponse An Eval object with a data source config and testing criteria. Builder A builder for EvalRetrieveParams. EvalRetrieveParams Get an evaluation by ID. Builder A builder for EvalRetrieveResponse. DataSourceConfig Configuration of data sources used in runs of the evaluation. Builder A builder for Metadata. Metadata Set of 16 key-value pairs that can be attached to an object. TestingCriterion A LabelModelGrader object which uses a model to assign labels to each item in the evaluation. EvalRetrieveResponse An Eval object with a data source config and testing criteria. Builder A builder for EvalStoredCompletionsDataSourceConfig. Builder A builder for Schema. Schema The json schema for the run data source items. Builder A builder for Metadata. Metadata Set of 16 key-value pairs that can be attached to an object. EvalStoredCompletionsDataSourceConfig A StoredCompletionsDataSourceConfig which specifies the metadata property of your stored completions query. Builder A builder for EvalStringCheckGrader. Operation The string check operation to perform. EvalStringCheckGrader A StringCheckGrader object that performs a string comparison between input and reference using a specified operation. Builder A builder for EvalTextSimilarityGrader. EvaluationMetric The evaluation metric to use. EvalTextSimilarityGrader A TextSimilarityGrader object which grades text based on similarity metrics. Builder A builder for EvalUpdateParams. Builder A builder for Body. Body Builder A builder for Metadata. Metadata Set of 16 key-value pairs that can be attached to an object. EvalUpdateParams Update certain properties of an evaluation. Builder A builder for EvalUpdateResponse. DataSourceConfig Configuration of data sources used in runs of the evaluation. Builder A builder for Metadata. Metadata Set of 16 key-value pairs that can be attached to an object. TestingCriterion A LabelModelGrader object which uses a model to assign labels to each item in the evaluation. EvalUpdateResponse An Eval object with a data source config and testing criteria. -
Interface Summary Interface Description Visitor An interface that defines how to map each variant of DataSourceConfig to a value of type T. Visitor An interface that defines how to map each variant of TestingCriterion to a value of type T. Visitor An interface that defines how to map each variant of Input to a value of type T. Visitor An interface that defines how to map each variant of DataSourceConfig to a value of type T. Visitor An interface that defines how to map each variant of TestingCriterion to a value of type T. Visitor An interface that defines how to map each variant of Input to a value of type T. Visitor An interface that defines how to map each variant of DataSourceConfig to a value of type T. Visitor An interface that defines how to map each variant of TestingCriterion to a value of type T. Visitor An interface that defines how to map each variant of DataSourceConfig to a value of type T. Visitor An interface that defines how to map each variant of TestingCriterion to a value of type T. Visitor An interface that defines how to map each variant of DataSourceConfig to a value of type T. Visitor An interface that defines how to map each variant of TestingCriterion to a value of type T. -
Enum Summary Enum Description Known An enum containing Type's known values. Value An enum containing Type's known values, as well as an _UNKNOWN member. Known An enum containing Role's known values. Value An enum containing Role's known values, as well as an _UNKNOWN member. Known An enum containing Type's known values. Value An enum containing Type's known values, as well as an _UNKNOWN member. Known An enum containing Type's known values. Value An enum containing Type's known values, as well as an _UNKNOWN member. Known An enum containing Role's known values. Value An enum containing Role's known values, as well as an _UNKNOWN member. Known An enum containing Type's known values. Value An enum containing Type's known values, as well as an _UNKNOWN member. Known An enum containing Type's known values. Value An enum containing Type's known values, as well as an _UNKNOWN member. Known An enum containing Role's known values. Value An enum containing Role's known values, as well as an _UNKNOWN member. Known An enum containing Type's known values. Value An enum containing Type's known values, as well as an _UNKNOWN member. Known An enum containing Type's known values. Value An enum containing Type's known values, as well as an _UNKNOWN member. Known An enum containing Type's known values. Value An enum containing Type's known values, as well as an _UNKNOWN member. Known An enum containing Order's known values. Value An enum containing Order's known values, as well as an _UNKNOWN member. Known An enum containing OrderBy's known values. Value An enum containing OrderBy's known values, as well as an _UNKNOWN member. Known An enum containing Operation's known values. Value An enum containing Operation's known values, as well as an _UNKNOWN member. Known An enum containing EvaluationMetric's known values. Value An enum containing EvaluationMetric's known values, as well as an _UNKNOWN member.