Class EvalUpdateResponse.TestingCriterion
-
- All Implemented Interfaces:
public final class EvalUpdateResponse.TestingCriterionA LabelModelGrader object which uses a model to assign labels to each item in the evaluation.
-
-
Nested Class Summary
Nested Classes Modifier and Type Class Description public interfaceEvalUpdateResponse.TestingCriterion.VisitorAn interface that defines how to map each variant of TestingCriterion to a value of type T.
public final classEvalUpdateResponse.TestingCriterion.PythonA PythonGrader object that runs a python script on the input.
public final classEvalUpdateResponse.TestingCriterion.ScoreModelA ScoreModelGrader object that uses a model to assign a score to the input.
-
Method Summary
Modifier and Type Method Description final Optional<EvalLabelModelGrader>labelModel()A LabelModelGrader object which uses a model to assign labels to each item in the evaluation. final Optional<EvalStringCheckGrader>stringCheck()A StringCheckGrader object that performs a string comparison between input and reference using a specified operation. final Optional<EvalTextSimilarityGrader>textSimilarity()A TextSimilarityGrader object which grades text based on similarity metrics. final Optional<EvalUpdateResponse.TestingCriterion.Python>python()A PythonGrader object that runs a python script on the input. final Optional<EvalUpdateResponse.TestingCriterion.ScoreModel>scoreModel()A ScoreModelGrader object that uses a model to assign a score to the input. final BooleanisLabelModel()final BooleanisStringCheck()final BooleanisTextSimilarity()final BooleanisPython()final BooleanisScoreModel()final EvalLabelModelGraderasLabelModel()A LabelModelGrader object which uses a model to assign labels to each item in the evaluation. final EvalStringCheckGraderasStringCheck()A StringCheckGrader object that performs a string comparison between input and reference using a specified operation. final EvalTextSimilarityGraderasTextSimilarity()A TextSimilarityGrader object which grades text based on similarity metrics. final EvalUpdateResponse.TestingCriterion.PythonasPython()A PythonGrader object that runs a python script on the input. final EvalUpdateResponse.TestingCriterion.ScoreModelasScoreModel()A ScoreModelGrader object that uses a model to assign a score to the input. final Optional<JsonValue>_json()final <T extends Any> Taccept(EvalUpdateResponse.TestingCriterion.Visitor<T> visitor)final EvalUpdateResponse.TestingCriterionvalidate()final BooleanisValid()Booleanequals(Object other)IntegerhashCode()StringtoString()final static EvalUpdateResponse.TestingCriterionofLabelModel(EvalLabelModelGrader labelModel)A LabelModelGrader object which uses a model to assign labels to each item in the evaluation. final static EvalUpdateResponse.TestingCriterionofStringCheck(EvalStringCheckGrader stringCheck)A StringCheckGrader object that performs a string comparison between input and reference using a specified operation. final static EvalUpdateResponse.TestingCriterionofTextSimilarity(EvalTextSimilarityGrader textSimilarity)A TextSimilarityGrader object which grades text based on similarity metrics. final static EvalUpdateResponse.TestingCriterionofPython(EvalUpdateResponse.TestingCriterion.Python python)A PythonGrader object that runs a python script on the input. final static EvalUpdateResponse.TestingCriterionofScoreModel(EvalUpdateResponse.TestingCriterion.ScoreModel scoreModel)A ScoreModelGrader object that uses a model to assign a score to the input. -
-
Method Detail
-
labelModel
final Optional<EvalLabelModelGrader> labelModel()
A LabelModelGrader object which uses a model to assign labels to each item in the evaluation.
-
stringCheck
final Optional<EvalStringCheckGrader> stringCheck()
A StringCheckGrader object that performs a string comparison between input and reference using a specified operation.
-
textSimilarity
final Optional<EvalTextSimilarityGrader> textSimilarity()
A TextSimilarityGrader object which grades text based on similarity metrics.
-
python
final Optional<EvalUpdateResponse.TestingCriterion.Python> python()
A PythonGrader object that runs a python script on the input.
-
scoreModel
final Optional<EvalUpdateResponse.TestingCriterion.ScoreModel> scoreModel()
A ScoreModelGrader object that uses a model to assign a score to the input.
-
isLabelModel
final Boolean isLabelModel()
-
isStringCheck
final Boolean isStringCheck()
-
isTextSimilarity
final Boolean isTextSimilarity()
-
isScoreModel
final Boolean isScoreModel()
-
asLabelModel
final EvalLabelModelGrader asLabelModel()
A LabelModelGrader object which uses a model to assign labels to each item in the evaluation.
-
asStringCheck
final EvalStringCheckGrader asStringCheck()
A StringCheckGrader object that performs a string comparison between input and reference using a specified operation.
-
asTextSimilarity
final EvalTextSimilarityGrader asTextSimilarity()
A TextSimilarityGrader object which grades text based on similarity metrics.
-
asPython
final EvalUpdateResponse.TestingCriterion.Python asPython()
A PythonGrader object that runs a python script on the input.
-
asScoreModel
final EvalUpdateResponse.TestingCriterion.ScoreModel asScoreModel()
A ScoreModelGrader object that uses a model to assign a score to the input.
-
accept
final <T extends Any> T accept(EvalUpdateResponse.TestingCriterion.Visitor<T> visitor)
-
validate
final EvalUpdateResponse.TestingCriterion validate()
-
ofLabelModel
final static EvalUpdateResponse.TestingCriterion ofLabelModel(EvalLabelModelGrader labelModel)
A LabelModelGrader object which uses a model to assign labels to each item in the evaluation.
-
ofStringCheck
final static EvalUpdateResponse.TestingCriterion ofStringCheck(EvalStringCheckGrader stringCheck)
A StringCheckGrader object that performs a string comparison between input and reference using a specified operation.
-
ofTextSimilarity
final static EvalUpdateResponse.TestingCriterion ofTextSimilarity(EvalTextSimilarityGrader textSimilarity)
A TextSimilarityGrader object which grades text based on similarity metrics.
-
ofPython
final static EvalUpdateResponse.TestingCriterion ofPython(EvalUpdateResponse.TestingCriterion.Python python)
A PythonGrader object that runs a python script on the input.
-
ofScoreModel
final static EvalUpdateResponse.TestingCriterion ofScoreModel(EvalUpdateResponse.TestingCriterion.ScoreModel scoreModel)
A ScoreModelGrader object that uses a model to assign a score to the input.
-
-
-
-