Constructor Detail

Method Detail

• withRawResponse

   abstract EvalService.WithRawResponse withRawResponse()

  Returns a view of this service that provides access to raw HTTP responses for each method.

• runs

   abstract RunService runs()

• create

   EvalCreateResponse create(EvalCreateParams params)

  Create the structure of an evaluation that can be used to test a model's performance. An evaluation is a set of testing criteria and a datasource. After creating an evaluation, you can run it on different models and model parameters. We support several types of graders and datasources. For more information, see the Evals guide.

• create

   abstract EvalCreateResponse create(EvalCreateParams params, RequestOptions requestOptions)

• retrieve

   EvalRetrieveResponse retrieve(EvalRetrieveParams params)

  Get an evaluation by ID.

• retrieve

   abstract EvalRetrieveResponse retrieve(EvalRetrieveParams params, RequestOptions requestOptions)

• update

   EvalUpdateResponse update(EvalUpdateParams params)

  Update certain properties of an evaluation.

• update

   abstract EvalUpdateResponse update(EvalUpdateParams params, RequestOptions requestOptions)

• list

   EvalListPage list()

  List evaluations for a project.

• list

   abstract EvalListPage list(EvalListParams params, RequestOptions requestOptions)

• list

   EvalListPage list(EvalListParams params)

• list

   EvalListPage list(RequestOptions requestOptions)

• delete

   EvalDeleteResponse delete(EvalDeleteParams params)

  Delete an evaluation.

• delete

   abstract EvalDeleteResponse delete(EvalDeleteParams params, RequestOptions requestOptions)