Constructor Detail

Method Detail

• withRawResponse

   abstract EvalService.WithRawResponse withRawResponse()

  Returns a view of this service that provides access to raw HTTP responses for each method.

• withOptions

   abstract EvalService withOptions(Consumer<ClientOptions.Builder> modifier)

  Returns a view of this service with the given option modifications applied.

  The original service is not modified.

• runs

   abstract RunService runs()

• create

   EvalCreateResponse create(EvalCreateParams params)

  Create the structure of an evaluation that can be used to test a model's performance. An evaluation is a set of testing criteria and the config for a data source, which dictates the schema of the data used in the evaluation. After creating an evaluation, you can run it on different models and model parameters. We support several types of graders and datasources. For more information, see the Evals guide.

• create

   abstract EvalCreateResponse create(EvalCreateParams params, RequestOptions requestOptions)

• retrieve

   EvalRetrieveResponse retrieve(String evalId)

  Get an evaluation by ID.

• retrieve

   EvalRetrieveResponse retrieve(String evalId, EvalRetrieveParams params, RequestOptions requestOptions)

• retrieve

   EvalRetrieveResponse retrieve(String evalId, EvalRetrieveParams params)

• retrieve

   abstract EvalRetrieveResponse retrieve(EvalRetrieveParams params, RequestOptions requestOptions)

• retrieve

   EvalRetrieveResponse retrieve(EvalRetrieveParams params)

• retrieve

   EvalRetrieveResponse retrieve(String evalId, RequestOptions requestOptions)

• update

   EvalUpdateResponse update(String evalId)

  Update certain properties of an evaluation.

• update

   EvalUpdateResponse update(String evalId, EvalUpdateParams params, RequestOptions requestOptions)

• update

   EvalUpdateResponse update(String evalId, EvalUpdateParams params)

• update

   abstract EvalUpdateResponse update(EvalUpdateParams params, RequestOptions requestOptions)

• update

   EvalUpdateResponse update(EvalUpdateParams params)

• update

   EvalUpdateResponse update(String evalId, RequestOptions requestOptions)

• list

   EvalListPage list()

  List evaluations for a project.

• list

   abstract EvalListPage list(EvalListParams params, RequestOptions requestOptions)

• list

   EvalListPage list(EvalListParams params)

• list

   EvalListPage list(RequestOptions requestOptions)

• delete

   EvalDeleteResponse delete(String evalId)

  Delete an evaluation.

• delete

   EvalDeleteResponse delete(String evalId, EvalDeleteParams params, RequestOptions requestOptions)

• delete

   EvalDeleteResponse delete(String evalId, EvalDeleteParams params)

• delete

   abstract EvalDeleteResponse delete(EvalDeleteParams params, RequestOptions requestOptions)

• delete

   EvalDeleteResponse delete(EvalDeleteParams params)

• delete

   EvalDeleteResponse delete(String evalId, RequestOptions requestOptions)