Class EvalUpdateResponse.TestingCriterion.ScoreModel
-
- All Implemented Interfaces:
public final class EvalUpdateResponse.TestingCriterion.ScoreModel
A ScoreModelGrader object that uses a model to assign a score to the input.
-
-
Nested Class Summary
Nested Classes Modifier and Type Class Description public final class
EvalUpdateResponse.TestingCriterion.ScoreModel.Builder
A builder for ScoreModel.
public final class
EvalUpdateResponse.TestingCriterion.ScoreModel.Input
A message input to the model with a role indicating instruction following hierarchy. Instructions given with the
developer
orsystem
role take precedence over instructions given with theuser
role. Messages with theassistant
role are presumed to have been generated by the model in previous interactions.
-
Method Summary
Modifier and Type Method Description final List<EvalUpdateResponse.TestingCriterion.ScoreModel.Input>
input()
The input text. final String
model()
The model to use for the evaluation. final String
name()
The name of the grader. final JsonValue
_type()
The object type, which is always score_model
.final Optional<Double>
passThreshold()
The threshold for the score. final Optional<List<Double>>
range()
The range of the score. final JsonValue
_samplingParams()
The sampling parameters for the model. final JsonField<List<EvalUpdateResponse.TestingCriterion.ScoreModel.Input>>
_input()
Returns the raw JSON value of input. final JsonField<String>
_model()
Returns the raw JSON value of model. final JsonField<String>
_name()
Returns the raw JSON value of name. final JsonField<Double>
_passThreshold()
Returns the raw JSON value of passThreshold. final JsonField<List<Double>>
_range()
Returns the raw JSON value of range. final Map<String, JsonValue>
_additionalProperties()
final EvalUpdateResponse.TestingCriterion.ScoreModel.Builder
toBuilder()
final EvalUpdateResponse.TestingCriterion.ScoreModel
validate()
final Boolean
isValid()
Boolean
equals(Object other)
Integer
hashCode()
String
toString()
final static EvalUpdateResponse.TestingCriterion.ScoreModel.Builder
builder()
Returns a mutable builder for constructing an instance of ScoreModel. -
-
Method Detail
-
input
final List<EvalUpdateResponse.TestingCriterion.ScoreModel.Input> input()
The input text. This may include template strings.
-
_type
final JsonValue _type()
The object type, which is always
score_model
.Expected to always return the following:
JsonValue.from("score_model")
However, this method can be useful for debugging and logging (e.g. if the server responded with an unexpected value).
-
passThreshold
final Optional<Double> passThreshold()
The threshold for the score.
-
_samplingParams
final JsonValue _samplingParams()
The sampling parameters for the model.
-
_input
final JsonField<List<EvalUpdateResponse.TestingCriterion.ScoreModel.Input>> _input()
Returns the raw JSON value of input.
Unlike input, this method doesn't throw if the JSON field has an unexpected type.
-
_model
final JsonField<String> _model()
Returns the raw JSON value of model.
Unlike model, this method doesn't throw if the JSON field has an unexpected type.
-
_name
final JsonField<String> _name()
Returns the raw JSON value of name.
Unlike name, this method doesn't throw if the JSON field has an unexpected type.
-
_passThreshold
final JsonField<Double> _passThreshold()
Returns the raw JSON value of passThreshold.
Unlike passThreshold, this method doesn't throw if the JSON field has an unexpected type.
-
_range
final JsonField<List<Double>> _range()
Returns the raw JSON value of range.
Unlike range, this method doesn't throw if the JSON field has an unexpected type.
-
_additionalProperties
final Map<String, JsonValue> _additionalProperties()
-
toBuilder
final EvalUpdateResponse.TestingCriterion.ScoreModel.Builder toBuilder()
-
validate
final EvalUpdateResponse.TestingCriterion.ScoreModel validate()
-
builder
final static EvalUpdateResponse.TestingCriterion.ScoreModel.Builder builder()
Returns a mutable builder for constructing an instance of ScoreModel.
The following fields are required:
.input() .model() .name()
-
-
-
-