Package dev.braintrust.eval

Interface Scorer<INPUT,OUTPUT>

Type Parameters:

INPUT - type of the input data

OUTPUT - type of the output data

public interface Scorer<INPUT,OUTPUT>

A scorer evaluates the result of a test case with a score between 0 (inclusive) and 1 (inclusive).

Method Summary

Modifier and Type	Method	Description
String	getName()
static <INPUT, OUTPUT> Scorer<INPUT,OUTPUT>	of(String scorerName, BiFunction<EvalCase<INPUT,OUTPUT>,OUTPUT,Double> scorerFn)	Deprecated.
static <INPUT, OUTPUT> Scorer<INPUT,OUTPUT>	of(String scorerName, Function<OUTPUT,Double> scorerFn)
List<Score>	score(TaskResult<INPUT,OUTPUT> taskResult)

Method Details

getName

String getName()

score

List<Score> score(TaskResult<INPUT,OUTPUT> taskResult)

of

static <INPUT,
OUTPUT> Scorer<INPUT,OUTPUT> of(String scorerName,
 Function<OUTPUT,Double> scorerFn)

of

@Deprecated
static <INPUT,
OUTPUT> Scorer<INPUT,OUTPUT> of(String scorerName,
 BiFunction<EvalCase<INPUT,OUTPUT>,OUTPUT,Double> scorerFn)

Deprecated.

Deprecated. Use of(String, Function) or implement the Scorer interface instead.