Class EvalCreateParams.TestingCriterion
-
- All Implemented Interfaces:
public final class EvalCreateParams.TestingCriterion
A LabelModelGrader object which uses a model to assign labels to each item in the evaluation.
-
-
Nested Class Summary
Nested Classes Modifier and Type Class Description public interface
EvalCreateParams.TestingCriterion.Visitor
An interface that defines how to map each variant of TestingCriterion to a value of type T.
public final class
EvalCreateParams.TestingCriterion.LabelModel
A LabelModelGrader object which uses a model to assign labels to each item in the evaluation.
public final class
EvalCreateParams.TestingCriterion.Python
A PythonGrader object that runs a python script on the input.
public final class
EvalCreateParams.TestingCriterion.ScoreModel
A ScoreModelGrader object that uses a model to assign a score to the input.
-
Method Summary
Modifier and Type Method Description final Optional<EvalCreateParams.TestingCriterion.LabelModel>
labelModel()
A LabelModelGrader object which uses a model to assign labels to each item in the evaluation. final Optional<EvalStringCheckGrader>
stringCheck()
A StringCheckGrader object that performs a string comparison between input and reference using a specified operation. final Optional<EvalTextSimilarityGrader>
textSimilarity()
A TextSimilarityGrader object which grades text based on similarity metrics. final Optional<EvalCreateParams.TestingCriterion.Python>
python()
A PythonGrader object that runs a python script on the input. final Optional<EvalCreateParams.TestingCriterion.ScoreModel>
scoreModel()
A ScoreModelGrader object that uses a model to assign a score to the input. final Boolean
isLabelModel()
final Boolean
isStringCheck()
final Boolean
isTextSimilarity()
final Boolean
isPython()
final Boolean
isScoreModel()
final EvalCreateParams.TestingCriterion.LabelModel
asLabelModel()
A LabelModelGrader object which uses a model to assign labels to each item in the evaluation. final EvalStringCheckGrader
asStringCheck()
A StringCheckGrader object that performs a string comparison between input and reference using a specified operation. final EvalTextSimilarityGrader
asTextSimilarity()
A TextSimilarityGrader object which grades text based on similarity metrics. final EvalCreateParams.TestingCriterion.Python
asPython()
A PythonGrader object that runs a python script on the input. final EvalCreateParams.TestingCriterion.ScoreModel
asScoreModel()
A ScoreModelGrader object that uses a model to assign a score to the input. final Optional<JsonValue>
_json()
final <T extends Any> T
accept(EvalCreateParams.TestingCriterion.Visitor<T> visitor)
final EvalCreateParams.TestingCriterion
validate()
final Boolean
isValid()
Boolean
equals(Object other)
Integer
hashCode()
String
toString()
final static EvalCreateParams.TestingCriterion
ofLabelModel(EvalCreateParams.TestingCriterion.LabelModel labelModel)
A LabelModelGrader object which uses a model to assign labels to each item in the evaluation. final static EvalCreateParams.TestingCriterion
ofStringCheck(EvalStringCheckGrader stringCheck)
A StringCheckGrader object that performs a string comparison between input and reference using a specified operation. final static EvalCreateParams.TestingCriterion
ofTextSimilarity(EvalTextSimilarityGrader textSimilarity)
A TextSimilarityGrader object which grades text based on similarity metrics. final static EvalCreateParams.TestingCriterion
ofPython(EvalCreateParams.TestingCriterion.Python python)
A PythonGrader object that runs a python script on the input. final static EvalCreateParams.TestingCriterion
ofScoreModel(EvalCreateParams.TestingCriterion.ScoreModel scoreModel)
A ScoreModelGrader object that uses a model to assign a score to the input. -
-
Method Detail
-
labelModel
final Optional<EvalCreateParams.TestingCriterion.LabelModel> labelModel()
A LabelModelGrader object which uses a model to assign labels to each item in the evaluation.
-
stringCheck
final Optional<EvalStringCheckGrader> stringCheck()
A StringCheckGrader object that performs a string comparison between input and reference using a specified operation.
-
textSimilarity
final Optional<EvalTextSimilarityGrader> textSimilarity()
A TextSimilarityGrader object which grades text based on similarity metrics.
-
python
final Optional<EvalCreateParams.TestingCriterion.Python> python()
A PythonGrader object that runs a python script on the input.
-
scoreModel
final Optional<EvalCreateParams.TestingCriterion.ScoreModel> scoreModel()
A ScoreModelGrader object that uses a model to assign a score to the input.
-
isLabelModel
final Boolean isLabelModel()
-
isStringCheck
final Boolean isStringCheck()
-
isTextSimilarity
final Boolean isTextSimilarity()
-
isScoreModel
final Boolean isScoreModel()
-
asLabelModel
final EvalCreateParams.TestingCriterion.LabelModel asLabelModel()
A LabelModelGrader object which uses a model to assign labels to each item in the evaluation.
-
asStringCheck
final EvalStringCheckGrader asStringCheck()
A StringCheckGrader object that performs a string comparison between input and reference using a specified operation.
-
asTextSimilarity
final EvalTextSimilarityGrader asTextSimilarity()
A TextSimilarityGrader object which grades text based on similarity metrics.
-
asPython
final EvalCreateParams.TestingCriterion.Python asPython()
A PythonGrader object that runs a python script on the input.
-
asScoreModel
final EvalCreateParams.TestingCriterion.ScoreModel asScoreModel()
A ScoreModelGrader object that uses a model to assign a score to the input.
-
accept
final <T extends Any> T accept(EvalCreateParams.TestingCriterion.Visitor<T> visitor)
-
validate
final EvalCreateParams.TestingCriterion validate()
-
ofLabelModel
final static EvalCreateParams.TestingCriterion ofLabelModel(EvalCreateParams.TestingCriterion.LabelModel labelModel)
A LabelModelGrader object which uses a model to assign labels to each item in the evaluation.
-
ofStringCheck
final static EvalCreateParams.TestingCriterion ofStringCheck(EvalStringCheckGrader stringCheck)
A StringCheckGrader object that performs a string comparison between input and reference using a specified operation.
-
ofTextSimilarity
final static EvalCreateParams.TestingCriterion ofTextSimilarity(EvalTextSimilarityGrader textSimilarity)
A TextSimilarityGrader object which grades text based on similarity metrics.
-
ofPython
final static EvalCreateParams.TestingCriterion ofPython(EvalCreateParams.TestingCriterion.Python python)
A PythonGrader object that runs a python script on the input.
-
ofScoreModel
final static EvalCreateParams.TestingCriterion ofScoreModel(EvalCreateParams.TestingCriterion.ScoreModel scoreModel)
A ScoreModelGrader object that uses a model to assign a score to the input.
-
-
-
-