Class EvalUpdateResponse.TestingCriterion
-
- All Implemented Interfaces:
public final class EvalUpdateResponse.TestingCriterion
A LabelModelGrader object which uses a model to assign labels to each item in the evaluation.
-
-
Nested Class Summary
Nested Classes Modifier and Type Class Description public interface
EvalUpdateResponse.TestingCriterion.Visitor
An interface that defines how to map each variant of TestingCriterion to a value of type T.
public final class
EvalUpdateResponse.TestingCriterion.EvalGraderTextSimilarity
A TextSimilarityGrader object which grades text based on similarity metrics.
public final class
EvalUpdateResponse.TestingCriterion.EvalGraderPython
A PythonGrader object that runs a python script on the input.
public final class
EvalUpdateResponse.TestingCriterion.EvalGraderScoreModel
A ScoreModelGrader object that uses a model to assign a score to the input.
-
Method Summary
Modifier and Type Method Description final Optional<LabelModelGrader>
labelModelGrader()
A LabelModelGrader object which uses a model to assign labels to each item in the evaluation. final Optional<StringCheckGrader>
stringCheckGrader()
A StringCheckGrader object that performs a string comparison between input and reference using a specified operation. final Optional<EvalUpdateResponse.TestingCriterion.EvalGraderTextSimilarity>
evalGraderTextSimilarity()
A TextSimilarityGrader object which grades text based on similarity metrics. final Optional<EvalUpdateResponse.TestingCriterion.EvalGraderPython>
evalGraderPython()
A PythonGrader object that runs a python script on the input. final Optional<EvalUpdateResponse.TestingCriterion.EvalGraderScoreModel>
evalGraderScoreModel()
A ScoreModelGrader object that uses a model to assign a score to the input. final Boolean
isLabelModelGrader()
final Boolean
isStringCheckGrader()
final Boolean
isEvalGraderTextSimilarity()
final Boolean
isEvalGraderPython()
final Boolean
isEvalGraderScoreModel()
final LabelModelGrader
asLabelModelGrader()
A LabelModelGrader object which uses a model to assign labels to each item in the evaluation. final StringCheckGrader
asStringCheckGrader()
A StringCheckGrader object that performs a string comparison between input and reference using a specified operation. final EvalUpdateResponse.TestingCriterion.EvalGraderTextSimilarity
asEvalGraderTextSimilarity()
A TextSimilarityGrader object which grades text based on similarity metrics. final EvalUpdateResponse.TestingCriterion.EvalGraderPython
asEvalGraderPython()
A PythonGrader object that runs a python script on the input. final EvalUpdateResponse.TestingCriterion.EvalGraderScoreModel
asEvalGraderScoreModel()
A ScoreModelGrader object that uses a model to assign a score to the input. final Optional<JsonValue>
_json()
final <T extends Any> T
accept(EvalUpdateResponse.TestingCriterion.Visitor<T> visitor)
final EvalUpdateResponse.TestingCriterion
validate()
final Boolean
isValid()
Boolean
equals(Object other)
Integer
hashCode()
String
toString()
final static EvalUpdateResponse.TestingCriterion
ofLabelModelGrader(LabelModelGrader labelModelGrader)
A LabelModelGrader object which uses a model to assign labels to each item in the evaluation. final static EvalUpdateResponse.TestingCriterion
ofStringCheckGrader(StringCheckGrader stringCheckGrader)
A StringCheckGrader object that performs a string comparison between input and reference using a specified operation. final static EvalUpdateResponse.TestingCriterion
ofEvalGraderTextSimilarity(EvalUpdateResponse.TestingCriterion.EvalGraderTextSimilarity evalGraderTextSimilarity)
A TextSimilarityGrader object which grades text based on similarity metrics. final static EvalUpdateResponse.TestingCriterion
ofEvalGraderPython(EvalUpdateResponse.TestingCriterion.EvalGraderPython evalGraderPython)
A PythonGrader object that runs a python script on the input. final static EvalUpdateResponse.TestingCriterion
ofEvalGraderScoreModel(EvalUpdateResponse.TestingCriterion.EvalGraderScoreModel evalGraderScoreModel)
A ScoreModelGrader object that uses a model to assign a score to the input. -
-
Method Detail
-
labelModelGrader
final Optional<LabelModelGrader> labelModelGrader()
A LabelModelGrader object which uses a model to assign labels to each item in the evaluation.
-
stringCheckGrader
final Optional<StringCheckGrader> stringCheckGrader()
A StringCheckGrader object that performs a string comparison between input and reference using a specified operation.
-
evalGraderTextSimilarity
final Optional<EvalUpdateResponse.TestingCriterion.EvalGraderTextSimilarity> evalGraderTextSimilarity()
A TextSimilarityGrader object which grades text based on similarity metrics.
-
evalGraderPython
final Optional<EvalUpdateResponse.TestingCriterion.EvalGraderPython> evalGraderPython()
A PythonGrader object that runs a python script on the input.
-
evalGraderScoreModel
final Optional<EvalUpdateResponse.TestingCriterion.EvalGraderScoreModel> evalGraderScoreModel()
A ScoreModelGrader object that uses a model to assign a score to the input.
-
isLabelModelGrader
final Boolean isLabelModelGrader()
-
isStringCheckGrader
final Boolean isStringCheckGrader()
-
isEvalGraderTextSimilarity
final Boolean isEvalGraderTextSimilarity()
-
isEvalGraderPython
final Boolean isEvalGraderPython()
-
isEvalGraderScoreModel
final Boolean isEvalGraderScoreModel()
-
asLabelModelGrader
final LabelModelGrader asLabelModelGrader()
A LabelModelGrader object which uses a model to assign labels to each item in the evaluation.
-
asStringCheckGrader
final StringCheckGrader asStringCheckGrader()
A StringCheckGrader object that performs a string comparison between input and reference using a specified operation.
-
asEvalGraderTextSimilarity
final EvalUpdateResponse.TestingCriterion.EvalGraderTextSimilarity asEvalGraderTextSimilarity()
A TextSimilarityGrader object which grades text based on similarity metrics.
-
asEvalGraderPython
final EvalUpdateResponse.TestingCriterion.EvalGraderPython asEvalGraderPython()
A PythonGrader object that runs a python script on the input.
-
asEvalGraderScoreModel
final EvalUpdateResponse.TestingCriterion.EvalGraderScoreModel asEvalGraderScoreModel()
A ScoreModelGrader object that uses a model to assign a score to the input.
-
accept
final <T extends Any> T accept(EvalUpdateResponse.TestingCriterion.Visitor<T> visitor)
-
validate
final EvalUpdateResponse.TestingCriterion validate()
-
ofLabelModelGrader
final static EvalUpdateResponse.TestingCriterion ofLabelModelGrader(LabelModelGrader labelModelGrader)
A LabelModelGrader object which uses a model to assign labels to each item in the evaluation.
-
ofStringCheckGrader
final static EvalUpdateResponse.TestingCriterion ofStringCheckGrader(StringCheckGrader stringCheckGrader)
A StringCheckGrader object that performs a string comparison between input and reference using a specified operation.
-
ofEvalGraderTextSimilarity
final static EvalUpdateResponse.TestingCriterion ofEvalGraderTextSimilarity(EvalUpdateResponse.TestingCriterion.EvalGraderTextSimilarity evalGraderTextSimilarity)
A TextSimilarityGrader object which grades text based on similarity metrics.
-
ofEvalGraderPython
final static EvalUpdateResponse.TestingCriterion ofEvalGraderPython(EvalUpdateResponse.TestingCriterion.EvalGraderPython evalGraderPython)
A PythonGrader object that runs a python script on the input.
-
ofEvalGraderScoreModel
final static EvalUpdateResponse.TestingCriterion ofEvalGraderScoreModel(EvalUpdateResponse.TestingCriterion.EvalGraderScoreModel evalGraderScoreModel)
A ScoreModelGrader object that uses a model to assign a score to the input.
-
-
-
-