Class EvalLabelModelGrader
-
- All Implemented Interfaces:
public final class EvalLabelModelGrader
A LabelModelGrader object which uses a model to assign labels to each item in the evaluation.
-
-
Nested Class Summary
Nested Classes Modifier and Type Class Description public final class
EvalLabelModelGrader.Builder
A builder for EvalLabelModelGrader.
public final class
EvalLabelModelGrader.Input
A message input to the model with a role indicating instruction following hierarchy. Instructions given with the
developer
orsystem
role take precedence over instructions given with theuser
role. Messages with theassistant
role are presumed to have been generated by the model in previous interactions.
-
Method Summary
Modifier and Type Method Description final List<EvalLabelModelGrader.Input>
input()
final List<String>
labels()
The labels to assign to each item in the evaluation. final String
model()
The model to use for the evaluation. final String
name()
The name of the grader. final List<String>
passingLabels()
The labels that indicate a passing result. final JsonValue
_type()
The object type, which is always label_model
.final JsonField<List<EvalLabelModelGrader.Input>>
_input()
Returns the raw JSON value of input. final JsonField<List<String>>
_labels()
Returns the raw JSON value of labels. final JsonField<String>
_model()
Returns the raw JSON value of model. final JsonField<String>
_name()
Returns the raw JSON value of name. final JsonField<List<String>>
_passingLabels()
Returns the raw JSON value of passingLabels. final Map<String, JsonValue>
_additionalProperties()
final EvalLabelModelGrader.Builder
toBuilder()
final EvalLabelModelGrader
validate()
final Boolean
isValid()
Boolean
equals(Object other)
Integer
hashCode()
String
toString()
final static EvalLabelModelGrader.Builder
builder()
Returns a mutable builder for constructing an instance of EvalLabelModelGrader. -
-
Method Detail
-
input
final List<EvalLabelModelGrader.Input> input()
-
passingLabels
final List<String> passingLabels()
The labels that indicate a passing result. Must be a subset of labels.
-
_type
final JsonValue _type()
The object type, which is always
label_model
.Expected to always return the following:
JsonValue.from("label_model")
However, this method can be useful for debugging and logging (e.g. if the server responded with an unexpected value).
-
_input
final JsonField<List<EvalLabelModelGrader.Input>> _input()
Returns the raw JSON value of input.
Unlike input, this method doesn't throw if the JSON field has an unexpected type.
-
_labels
final JsonField<List<String>> _labels()
Returns the raw JSON value of labels.
Unlike labels, this method doesn't throw if the JSON field has an unexpected type.
-
_model
final JsonField<String> _model()
Returns the raw JSON value of model.
Unlike model, this method doesn't throw if the JSON field has an unexpected type.
-
_name
final JsonField<String> _name()
Returns the raw JSON value of name.
Unlike name, this method doesn't throw if the JSON field has an unexpected type.
-
_passingLabels
final JsonField<List<String>> _passingLabels()
Returns the raw JSON value of passingLabels.
Unlike passingLabels, this method doesn't throw if the JSON field has an unexpected type.
-
_additionalProperties
final Map<String, JsonValue> _additionalProperties()
-
toBuilder
final EvalLabelModelGrader.Builder toBuilder()
-
validate
final EvalLabelModelGrader validate()
-
builder
final static EvalLabelModelGrader.Builder builder()
Returns a mutable builder for constructing an instance of EvalLabelModelGrader.
The following fields are required:
.input() .labels() .model() .name() .passingLabels()
-
-
-
-