Interface RunService
-
- All Implemented Interfaces:
public interface RunService
-
-
Nested Class Summary
Nested Classes Modifier and Type Class Description public interface
RunService.WithRawResponse
A view of RunService that provides access to raw HTTP responses for each method.
-
Method Summary
-
-
Method Detail
-
withRawResponse
abstract RunService.WithRawResponse withRawResponse()
Returns a view of this service that provides access to raw HTTP responses for each method.
-
outputItems
abstract OutputItemService outputItems()
-
create
RunCreateResponse create(String evalId, RunCreateParams params)
Kicks off a new run for a given evaluation, specifying the data source, and what model configuration to use to test. The datasource will be validated against the schema specified in the config of the evaluation.
-
create
RunCreateResponse create(String evalId, RunCreateParams params, RequestOptions requestOptions)
-
create
RunCreateResponse create(RunCreateParams params)
-
create
abstract RunCreateResponse create(RunCreateParams params, RequestOptions requestOptions)
-
retrieve
RunRetrieveResponse retrieve(String runId, RunRetrieveParams params)
Get an evaluation run by ID.
-
retrieve
RunRetrieveResponse retrieve(String runId, RunRetrieveParams params, RequestOptions requestOptions)
-
retrieve
RunRetrieveResponse retrieve(RunRetrieveParams params)
-
retrieve
abstract RunRetrieveResponse retrieve(RunRetrieveParams params, RequestOptions requestOptions)
-
list
RunListPage list(String evalId)
Get a list of runs for an evaluation.
-
list
RunListPage list(String evalId, RunListParams params, RequestOptions requestOptions)
-
list
RunListPage list(String evalId, RunListParams params)
-
list
abstract RunListPage list(RunListParams params, RequestOptions requestOptions)
-
list
RunListPage list(RunListParams params)
-
list
RunListPage list(String evalId, RequestOptions requestOptions)
-
delete
RunDeleteResponse delete(String runId, RunDeleteParams params)
Delete an eval run.
-
delete
RunDeleteResponse delete(String runId, RunDeleteParams params, RequestOptions requestOptions)
-
delete
RunDeleteResponse delete(RunDeleteParams params)
-
delete
abstract RunDeleteResponse delete(RunDeleteParams params, RequestOptions requestOptions)
-
cancel
RunCancelResponse cancel(String runId, RunCancelParams params)
Cancel an ongoing evaluation run.
-
cancel
RunCancelResponse cancel(String runId, RunCancelParams params, RequestOptions requestOptions)
-
cancel
RunCancelResponse cancel(RunCancelParams params)
-
cancel
abstract RunCancelResponse cancel(RunCancelParams params, RequestOptions requestOptions)
-
-
-
-