Package dev.braintrust.eval

Class DatasetBrainstoreImpl<INPUT,OUTPUT>

java.lang.Object

dev.braintrust.eval.DatasetBrainstoreImpl<INPUT,OUTPUT>

All Implemented Interfaces:

Dataset<INPUT,OUTPUT>

public class DatasetBrainstoreImpl<INPUT,OUTPUT>
extends Object
implements Dataset<INPUT,OUTPUT>

A dataset loaded externally from Braintrust using paginated API fetches

Nested Class Summary

Nested classes/interfaces inherited from interface dev.braintrust.eval.Dataset

Dataset.Cursor<CASE>

Constructor Summary

Constructors

Constructor	Description
DatasetBrainstoreImpl(BraintrustApiClient apiClient, String datasetId, String datasetVersion)	Deprecated.
DatasetBrainstoreImpl(BraintrustOpenApiClient apiClient, String datasetId, String datasetVersion)	Deprecated. the INPUT and OUTPUT type parameters are not applied at runtime: case values are returned as raw JSON-decoded objects.
DatasetBrainstoreImpl(BraintrustOpenApiClient apiClient, String datasetId, String datasetVersion, Class<INPUT> inputClass, Class<OUTPUT> outputClass)	Create a dataset whose case input and expected values are deserialized into the given types using the SDK's shared Jackson mapper (see BraintrustJsonMapper).
DatasetBrainstoreImpl(BraintrustOpenApiClient apiClient, String datasetId, String datasetVersion, Function<Object,INPUT> inputConverter, Function<Object,OUTPUT> outputConverter)	Create a dataset whose case input and expected values are converted with the supplied functions.

Method Summary

Modifier and Type	Method	Description
String	id()
Dataset.Cursor<DatasetCase<INPUT,OUTPUT>>	openCursor()
Optional<String>	version()	Dataset version.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface dev.braintrust.eval.Dataset

forEach

Constructor Details

DatasetBrainstoreImpl

@Deprecated
public DatasetBrainstoreImpl(BraintrustApiClient apiClient,
 String datasetId,
 @Nullable
 String datasetVersion)

Deprecated.

DatasetBrainstoreImpl

@Deprecated
public DatasetBrainstoreImpl(BraintrustOpenApiClient apiClient,
 String datasetId,
 @Nullable
 String datasetVersion)

Deprecated.

the INPUT and OUTPUT type parameters are not applied at runtime: case values are returned as raw JSON-decoded objects. Use DatasetBrainstoreImpl(BraintrustOpenApiClient, String, String, Class, Class) instead.

DatasetBrainstoreImpl

public DatasetBrainstoreImpl(BraintrustOpenApiClient apiClient,
 String datasetId,
 @Nullable
 String datasetVersion,
 Class<INPUT> inputClass,
 Class<OUTPUT> outputClass)

Create a dataset whose case input and expected values are deserialized into the given types using the SDK's shared Jackson mapper (see BraintrustJsonMapper).

Parameters:

apiClient - the Braintrust API client

datasetId - the Braintrust dataset id

datasetVersion - the dataset version to pin, or null to fetch the latest version upon every cursor open

inputClass - the type to deserialize each case's input into

outputClass - the type to deserialize each case's expected into

DatasetBrainstoreImpl

public DatasetBrainstoreImpl(BraintrustOpenApiClient apiClient,
 String datasetId,
 @Nullable
 String datasetVersion,
 Function<Object,INPUT> inputConverter,
 Function<Object,OUTPUT> outputConverter)

Create a dataset whose case input and expected values are converted with the supplied functions. Converters receive the raw JSON-decoded value (typically a Map<String, Object>, List, String, Number, Boolean, or null).

Parameters:

apiClient - the Braintrust API client

datasetId - the Braintrust dataset id

datasetVersion - the dataset version to pin, or null to fetch the latest version upon every cursor open

inputConverter - converts each case's raw input value; must tolerate null

outputConverter - converts each case's raw expected value; must tolerate null

Method Details

id

public String id()

Specified by:

id in interface Dataset<INPUT,OUTPUT>

version

public Optional<String> version()

Description copied from interface: Dataset

Dataset version. Empty means the dataset will fetch latest upon every cursor open

Specified by:

version in interface Dataset<INPUT,OUTPUT>

openCursor

public Dataset.Cursor<DatasetCase<INPUT,OUTPUT>> openCursor()

Specified by:

openCursor in interface Dataset<INPUT,OUTPUT>