Index

A B C D E F G H I J L M N O P R S T V W 
All Classes and Interfaces|All Packages|Constant Field Values

A

additionalMetadata(Map<String, Object>) - Method in class com.judgmentlabs.judgeval.data.ScorerData.Builder
Sets additional metadata for the evaluation.
additionalProperty(String, Object) - Method in class com.judgmentlabs.judgeval.scorers.APIScorer.Builder
 
addToRunEvalQueue(ExampleEvaluationRun) - Method in class com.judgmentlabs.judgeval.internal.api.JudgmentAsyncClient
 
addToRunEvalQueue(ExampleEvaluationRun) - Method in class com.judgmentlabs.judgeval.internal.api.JudgmentSyncClient
 
ANSWER_CORRECTNESS - Enum constant in enum class com.judgmentlabs.judgeval.data.APIScorerType
 
ANSWER_RELEVANCY - Enum constant in enum class com.judgmentlabs.judgeval.data.APIScorerType
 
answerCorrectness() - Method in class com.judgmentlabs.judgeval.scorers.built_in.BuiltInScorersFactory
Creates a builder for an answer correctness scorer.
AnswerCorrectnessScorer - Class in com.judgmentlabs.judgeval.scorers.built_in
Scorer that evaluates the correctness of an answer against an expected output.
AnswerCorrectnessScorer.Builder - Class in com.judgmentlabs.judgeval.scorers.built_in
Builder for configuring and creating AnswerCorrectnessScorer instances.
answerRelevancy() - Method in class com.judgmentlabs.judgeval.scorers.built_in.BuiltInScorersFactory
Creates a builder for an answer relevancy scorer.
AnswerRelevancyScorer - Class in com.judgmentlabs.judgeval.scorers.built_in
Scorer that evaluates the relevancy of an answer to the input question.
AnswerRelevancyScorer.Builder - Class in com.judgmentlabs.judgeval.scorers.built_in
Builder for configuring and creating AnswerRelevancyScorer instances.
apiClient - Variable in class com.judgmentlabs.judgeval.tracer.BaseTracer
 
apiKey(String) - Method in class com.judgmentlabs.judgeval.Judgeval.Builder
Sets the API key for authentication.
apiKey(String) - Method in class com.judgmentlabs.judgeval.tracer.exporters.JudgmentSpanExporter.Builder
Sets the API key for authentication.
APIScorer - Class in com.judgmentlabs.judgeval.scorers
Base class for API-based scorers that evaluate using the Judgment backend.
APIScorer(APIScorerType) - Constructor for class com.judgmentlabs.judgeval.scorers.APIScorer
 
APIScorer.Builder<T> - Class in com.judgmentlabs.judgeval.scorers
Builder for configuring and creating APIScorer instances.
APIScorerType - Enum Class in com.judgmentlabs.judgeval.data
Available types of API-based scorers.
apiUrl(String) - Method in class com.judgmentlabs.judgeval.Judgeval.Builder
Sets the API URL.
asyncEvaluate(BaseScorer, Example) - Method in class com.judgmentlabs.judgeval.tracer.BaseTracer
Asynchronously evaluates the current span using the specified scorer and example.
asyncTraceEvaluate(BaseScorer) - Method in class com.judgmentlabs.judgeval.tracer.BaseTracer
Asynchronously evaluates the current trace using the specified scorer.

B

BaseScorer - Class in com.judgmentlabs.judgeval.internal.api.models
 
BaseScorer - Interface in com.judgmentlabs.judgeval.scorers
Base interface for all scorers in the Judgment evaluation system.
BaseScorer() - Constructor for class com.judgmentlabs.judgeval.internal.api.models.BaseScorer
 
BaseTracer - Class in com.judgmentlabs.judgeval.tracer
Base tracer providing span manipulation, attribute setting, and evaluation capabilities.
BaseTracer(String, boolean, JudgmentSyncClient, ISerializer) - Constructor for class com.judgmentlabs.judgeval.tracer.BaseTracer
 
build() - Method in class com.judgmentlabs.judgeval.data.Example.Builder
Builds and returns the configured Example.
build() - Method in class com.judgmentlabs.judgeval.data.ScorerData.Builder
Builds and returns the configured ScorerData.
build() - Method in class com.judgmentlabs.judgeval.data.ScoringResult.Builder
Builds and returns the configured ScoringResult.
build() - Method in class com.judgmentlabs.judgeval.evaluation.Evaluation.Builder
Builds and returns a new Evaluation instance.
build() - Method in class com.judgmentlabs.judgeval.Judgeval.Builder
Builds and returns a new Judgeval instance.
build() - Method in class com.judgmentlabs.judgeval.scorers.APIScorer.Builder
 
build() - Method in class com.judgmentlabs.judgeval.scorers.built_in.AnswerCorrectnessScorer.Builder
 
build() - Method in class com.judgmentlabs.judgeval.scorers.built_in.AnswerRelevancyScorer.Builder
 
build() - Method in class com.judgmentlabs.judgeval.scorers.built_in.FaithfulnessScorer.Builder
 
build() - Method in class com.judgmentlabs.judgeval.scorers.custom_scorer.CustomScorer.Builder
 
build() - Method in class com.judgmentlabs.judgeval.scorers.prompt_scorer.PromptScorer.Builder
 
build() - Method in class com.judgmentlabs.judgeval.tracer.exporters.JudgmentSpanExporter.Builder
Builds a new JudgmentSpanExporter instance with the configured settings.
build() - Method in class com.judgmentlabs.judgeval.tracer.Tracer.Builder
Builds and returns a new Tracer instance.
builder() - Static method in class com.judgmentlabs.judgeval.data.Example
Creates a new builder for configuring an Example.
builder() - Static method in class com.judgmentlabs.judgeval.data.ScorerData
Creates a new builder for configuring ScorerData.
builder() - Static method in class com.judgmentlabs.judgeval.data.ScoringResult
Creates a new builder for configuring a ScoringResult.
builder() - Static method in class com.judgmentlabs.judgeval.evaluation.Evaluation
Creates a new builder for configuring an Evaluation.
builder() - Static method in class com.judgmentlabs.judgeval.Judgeval
Creates a new builder for configuring a Judgeval.
builder() - Static method in class com.judgmentlabs.judgeval.scorers.built_in.AnswerCorrectnessScorer
Creates a new builder for configuring an AnswerCorrectnessScorer.
builder() - Static method in class com.judgmentlabs.judgeval.scorers.built_in.AnswerRelevancyScorer
Creates a new builder for configuring an AnswerRelevancyScorer.
builder() - Static method in class com.judgmentlabs.judgeval.scorers.built_in.FaithfulnessScorer
Creates a new builder for configuring a FaithfulnessScorer.
builder() - Static method in class com.judgmentlabs.judgeval.scorers.custom_scorer.CustomScorer
Creates a new builder for configuring a CustomScorer.
builder() - Static method in class com.judgmentlabs.judgeval.scorers.prompt_scorer.PromptScorer
Creates a new builder for configuring a PromptScorer.
builder() - Static method in class com.judgmentlabs.judgeval.tracer.exporters.JudgmentSpanExporter
Creates a new builder for constructing JudgmentSpanExporter instances.
builder() - Static method in class com.judgmentlabs.judgeval.tracer.Tracer
Creates a new builder for configuring a Tracer.
builder(Class<T>) - Static method in class com.judgmentlabs.judgeval.scorers.APIScorer
Creates a new builder for an APIScorer subclass.
Builder() - Constructor for class com.judgmentlabs.judgeval.evaluation.Evaluation.Builder
 
Builder() - Constructor for class com.judgmentlabs.judgeval.Judgeval.Builder
 
Builder() - Constructor for class com.judgmentlabs.judgeval.scorers.built_in.AnswerCorrectnessScorer.Builder
 
Builder() - Constructor for class com.judgmentlabs.judgeval.scorers.built_in.AnswerRelevancyScorer.Builder
 
Builder() - Constructor for class com.judgmentlabs.judgeval.scorers.built_in.FaithfulnessScorer.Builder
 
Builder() - Constructor for class com.judgmentlabs.judgeval.scorers.custom_scorer.CustomScorer.Builder
 
Builder() - Constructor for class com.judgmentlabs.judgeval.scorers.prompt_scorer.PromptScorer.Builder
 
Builder() - Constructor for class com.judgmentlabs.judgeval.tracer.Tracer.Builder
 
builtIn() - Method in class com.judgmentlabs.judgeval.scorers.ScorersFactory
Returns a factory for creating built-in scorers.
BuiltInScorersFactory - Class in com.judgmentlabs.judgeval.scorers.built_in
Factory for creating built-in scorer builders.
BuiltInScorersFactory() - Constructor for class com.judgmentlabs.judgeval.scorers.built_in.BuiltInScorersFactory
 

C

className(String) - Method in class com.judgmentlabs.judgeval.scorers.custom_scorer.CustomScorer.Builder
 
client(JudgmentSyncClient) - Method in class com.judgmentlabs.judgeval.tracer.Tracer.Builder
Sets the Judgment API client.
com.judgmentlabs.judgeval - package com.judgmentlabs.judgeval
Judgeval SDK v1 API.
com.judgmentlabs.judgeval.data - package com.judgmentlabs.judgeval.data
 
com.judgmentlabs.judgeval.evaluation - package com.judgmentlabs.judgeval.evaluation
 
com.judgmentlabs.judgeval.internal.api - package com.judgmentlabs.judgeval.internal.api
 
com.judgmentlabs.judgeval.internal.api.models - package com.judgmentlabs.judgeval.internal.api.models
 
com.judgmentlabs.judgeval.scorers - package com.judgmentlabs.judgeval.scorers
 
com.judgmentlabs.judgeval.scorers.built_in - package com.judgmentlabs.judgeval.scorers.built_in
 
com.judgmentlabs.judgeval.scorers.custom_scorer - package com.judgmentlabs.judgeval.scorers.custom_scorer
 
com.judgmentlabs.judgeval.scorers.prompt_scorer - package com.judgmentlabs.judgeval.scorers.prompt_scorer
 
com.judgmentlabs.judgeval.tracer - package com.judgmentlabs.judgeval.tracer
 
com.judgmentlabs.judgeval.tracer.exporters - package com.judgmentlabs.judgeval.tracer.exporters
 
com.judgmentlabs.judgeval.utils - package com.judgmentlabs.judgeval.utils
 
create() - Method in class com.judgmentlabs.judgeval.evaluation.EvaluationFactory
Creates a new evaluation builder configured with this factory's client.
create() - Method in class com.judgmentlabs.judgeval.tracer.TracerFactory
Creates a new tracer builder configured with this factory's client.
critical(String) - Static method in class com.judgmentlabs.judgeval.utils.Logger
 
CRITICAL - Enum constant in enum class com.judgmentlabs.judgeval.utils.Logger.Level
 
CUSTOM - Enum constant in enum class com.judgmentlabs.judgeval.data.APIScorerType
 
customScorer() - Method in class com.judgmentlabs.judgeval.scorers.ScorersFactory
Returns a factory for creating custom scorers.
CustomScorer - Class in com.judgmentlabs.judgeval.scorers.custom_scorer
Scorer that uses custom user-defined evaluation logic.
CustomScorer.Builder - Class in com.judgmentlabs.judgeval.scorers.custom_scorer
Builder for configuring and creating CustomScorer instances.
CustomScorerFactory - Class in com.judgmentlabs.judgeval.scorers.custom_scorer
Factory for creating custom scorer instances.
CustomScorerFactory() - Constructor for class com.judgmentlabs.judgeval.scorers.custom_scorer.CustomScorerFactory
 

D

dataObject(Example) - Method in class com.judgmentlabs.judgeval.data.ScoringResult.Builder
Sets the data object for the evaluation.
debug(String) - Static method in class com.judgmentlabs.judgeval.utils.Logger
 
DEBUG - Enum constant in enum class com.judgmentlabs.judgeval.utils.Logger.Level
 

E

enableEvaluation - Variable in class com.judgmentlabs.judgeval.tracer.BaseTracer
 
enableEvaluation(boolean) - Method in class com.judgmentlabs.judgeval.tracer.Tracer.Builder
Sets whether evaluation is enabled.
endpoint(String) - Method in class com.judgmentlabs.judgeval.tracer.exporters.JudgmentSpanExporter.Builder
Sets the OTLP endpoint URL.
Env - Class in com.judgmentlabs.judgeval
 
equals(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer
 
equals(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.EvalResults
 
equals(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.EvalResultsFetch
 
equals(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.Example
 
equals(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.ExampleEvaluationRun
 
equals(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.FetchPromptScorersRequest
 
equals(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.FetchPromptScorersResponse
 
equals(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
equals(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.PromptScorer
 
equals(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.ResolveProjectNameRequest
 
equals(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.ResolveProjectNameResponse
 
equals(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.SavePromptScorerRequest
 
equals(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.SavePromptScorerResponse
 
equals(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerConfig
 
equals(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerData
 
equals(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerExistsRequest
 
equals(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerExistsResponse
 
equals(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScoringResult
 
equals(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.TraceEvaluationRun
 
error(String) - Method in class com.judgmentlabs.judgeval.data.ScorerData.Builder
Sets an error message if evaluation failed.
error(String) - Static method in class com.judgmentlabs.judgeval.utils.Logger
 
ERROR - Enum constant in enum class com.judgmentlabs.judgeval.utils.Logger.Level
 
EvalResults - Class in com.judgmentlabs.judgeval.internal.api.models
 
EvalResults() - Constructor for class com.judgmentlabs.judgeval.internal.api.models.EvalResults
 
EvalResultsFetch - Class in com.judgmentlabs.judgeval.internal.api.models
 
EvalResultsFetch() - Constructor for class com.judgmentlabs.judgeval.internal.api.models.EvalResultsFetch
 
evaluation() - Method in class com.judgmentlabs.judgeval.Judgeval
Returns a factory for creating evaluations.
Evaluation - Class in com.judgmentlabs.judgeval.evaluation
Evaluation configuration for running evaluations against traces and spans.
Evaluation.Builder - Class in com.judgmentlabs.judgeval.evaluation
Builder for configuring and creating Evaluation instances.
EvaluationFactory - Class in com.judgmentlabs.judgeval.evaluation
Factory for creating evaluation builders.
EvaluationFactory(JudgmentSyncClient) - Constructor for class com.judgmentlabs.judgeval.evaluation.EvaluationFactory
 
evaluationModel(String) - Method in class com.judgmentlabs.judgeval.data.ScorerData.Builder
Sets the model used for evaluation.
Example - Class in com.judgmentlabs.judgeval.data
Represents an evaluation example with arbitrary properties.
Example - Class in com.judgmentlabs.judgeval.internal.api.models
 
Example() - Constructor for class com.judgmentlabs.judgeval.data.Example
 
Example() - Constructor for class com.judgmentlabs.judgeval.internal.api.models.Example
 
Example.Builder - Class in com.judgmentlabs.judgeval.data
Builder for configuring and creating Example instances.
ExampleEvaluationRun - Class in com.judgmentlabs.judgeval.internal.api.models
 
ExampleEvaluationRun() - Constructor for class com.judgmentlabs.judgeval.internal.api.models.ExampleEvaluationRun
 
export(Collection<SpanData>) - Method in class com.judgmentlabs.judgeval.tracer.exporters.JudgmentSpanExporter
Exports the collection of spans to the Judgment Labs backend.
export(Collection<SpanData>) - Method in class com.judgmentlabs.judgeval.tracer.exporters.NoOpSpanExporter
Discards the collection of spans without exporting.

F

faithfulness() - Method in class com.judgmentlabs.judgeval.scorers.built_in.BuiltInScorersFactory
Creates a builder for a faithfulness scorer.
FAITHFULNESS - Enum constant in enum class com.judgmentlabs.judgeval.data.APIScorerType
 
FaithfulnessScorer - Class in com.judgmentlabs.judgeval.scorers.built_in
Scorer that evaluates whether an answer is faithful to the provided context.
FaithfulnessScorer.Builder - Class in com.judgmentlabs.judgeval.scorers.built_in
Builder for configuring and creating FaithfulnessScorer instances.
fetchExperimentRun(EvalResultsFetch) - Method in class com.judgmentlabs.judgeval.internal.api.JudgmentAsyncClient
 
fetchExperimentRun(EvalResultsFetch) - Method in class com.judgmentlabs.judgeval.internal.api.JudgmentSyncClient
 
FetchPromptScorersRequest - Class in com.judgmentlabs.judgeval.internal.api.models
 
FetchPromptScorersRequest() - Constructor for class com.judgmentlabs.judgeval.internal.api.models.FetchPromptScorersRequest
 
FetchPromptScorersResponse - Class in com.judgmentlabs.judgeval.internal.api.models
 
FetchPromptScorersResponse() - Constructor for class com.judgmentlabs.judgeval.internal.api.models.FetchPromptScorersResponse
 
fetchScorers(FetchPromptScorersRequest) - Method in class com.judgmentlabs.judgeval.internal.api.JudgmentAsyncClient
 
fetchScorers(FetchPromptScorersRequest) - Method in class com.judgmentlabs.judgeval.internal.api.JudgmentSyncClient
 
flush() - Method in class com.judgmentlabs.judgeval.tracer.exporters.JudgmentSpanExporter
Flushes any pending span exports.
flush() - Method in class com.judgmentlabs.judgeval.tracer.exporters.NoOpSpanExporter
Performs a no-op flush operation.
forceFlush(int) - Method in class com.judgmentlabs.judgeval.tracer.BaseTracer
Forces pending spans to flush.
forceFlush(int) - Method in class com.judgmentlabs.judgeval.tracer.Tracer
Forces the tracer to flush any pending spans within the specified timeout.

G

GEN_AI_COMPLETION - Static variable in class com.judgmentlabs.judgeval.JudgmentAttributeKeys.AttributeKeys
 
GEN_AI_PROMPT - Static variable in class com.judgmentlabs.judgeval.JudgmentAttributeKeys.AttributeKeys
 
GEN_AI_REQUEST_MAX_TOKENS - Static variable in class com.judgmentlabs.judgeval.JudgmentAttributeKeys.AttributeKeys
 
GEN_AI_REQUEST_MODEL - Static variable in class com.judgmentlabs.judgeval.JudgmentAttributeKeys.AttributeKeys
 
GEN_AI_REQUEST_TEMPERATURE - Static variable in class com.judgmentlabs.judgeval.JudgmentAttributeKeys.AttributeKeys
 
GEN_AI_RESPONSE_FINISH_REASONS - Static variable in class com.judgmentlabs.judgeval.JudgmentAttributeKeys.AttributeKeys
 
GEN_AI_RESPONSE_MODEL - Static variable in class com.judgmentlabs.judgeval.JudgmentAttributeKeys.AttributeKeys
 
GEN_AI_SYSTEM - Static variable in class com.judgmentlabs.judgeval.JudgmentAttributeKeys.AttributeKeys
 
GEN_AI_USAGE_CACHE_CREATION_INPUT_TOKENS - Static variable in class com.judgmentlabs.judgeval.JudgmentAttributeKeys.AttributeKeys
 
GEN_AI_USAGE_CACHE_READ_INPUT_TOKENS - Static variable in class com.judgmentlabs.judgeval.JudgmentAttributeKeys.AttributeKeys
 
GEN_AI_USAGE_INPUT_TOKENS - Static variable in class com.judgmentlabs.judgeval.JudgmentAttributeKeys.AttributeKeys
 
GEN_AI_USAGE_OUTPUT_TOKENS - Static variable in class com.judgmentlabs.judgeval.JudgmentAttributeKeys.AttributeKeys
 
get(String) - Method in class com.judgmentlabs.judgeval.scorers.custom_scorer.CustomScorerFactory
Creates a custom scorer with the specified name.
get(String) - Method in class com.judgmentlabs.judgeval.scorers.prompt_scorer.PromptScorerFactory
Retrieves a prompt scorer by name from the Judgment API.
get(String, String) - Method in class com.judgmentlabs.judgeval.scorers.custom_scorer.CustomScorerFactory
Creates a custom scorer with the specified name and class name.
getAdditionalMetadata() - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer
 
getAdditionalMetadata() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerData
 
getAdditionalProperties() - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer
 
getAdditionalProperties() - Method in class com.judgmentlabs.judgeval.internal.api.models.EvalResults
 
getAdditionalProperties() - Method in class com.judgmentlabs.judgeval.internal.api.models.EvalResultsFetch
 
getAdditionalProperties() - Method in class com.judgmentlabs.judgeval.internal.api.models.Example
 
getAdditionalProperties() - Method in class com.judgmentlabs.judgeval.internal.api.models.ExampleEvaluationRun
 
getAdditionalProperties() - Method in class com.judgmentlabs.judgeval.internal.api.models.FetchPromptScorersRequest
 
getAdditionalProperties() - Method in class com.judgmentlabs.judgeval.internal.api.models.FetchPromptScorersResponse
 
getAdditionalProperties() - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
getAdditionalProperties() - Method in class com.judgmentlabs.judgeval.internal.api.models.PromptScorer
 
getAdditionalProperties() - Method in class com.judgmentlabs.judgeval.internal.api.models.ResolveProjectNameRequest
 
getAdditionalProperties() - Method in class com.judgmentlabs.judgeval.internal.api.models.ResolveProjectNameResponse
 
getAdditionalProperties() - Method in class com.judgmentlabs.judgeval.internal.api.models.SavePromptScorerRequest
 
getAdditionalProperties() - Method in class com.judgmentlabs.judgeval.internal.api.models.SavePromptScorerResponse
 
getAdditionalProperties() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerConfig
 
getAdditionalProperties() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerData
 
getAdditionalProperties() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerExistsRequest
 
getAdditionalProperties() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerExistsResponse
 
getAdditionalProperties() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScoringResult
 
getAdditionalProperties() - Method in class com.judgmentlabs.judgeval.internal.api.models.TraceEvaluationRun
 
getApiKey() - Method in class com.judgmentlabs.judgeval.internal.api.JudgmentAsyncClient
 
getApiKey() - Method in class com.judgmentlabs.judgeval.internal.api.JudgmentSyncClient
 
getApiUrl() - Method in class com.judgmentlabs.judgeval.internal.api.JudgmentAsyncClient
 
getApiUrl() - Method in class com.judgmentlabs.judgeval.internal.api.JudgmentSyncClient
 
getClassName() - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer
 
getColor() - Method in enum class com.judgmentlabs.judgeval.utils.Logger.Level
 
getCreatedAt() - Method in class com.judgmentlabs.judgeval.internal.api.models.Example
 
getCreatedAt() - Method in class com.judgmentlabs.judgeval.internal.api.models.ExampleEvaluationRun
 
getCreatedAt() - Method in class com.judgmentlabs.judgeval.internal.api.models.PromptScorer
 
getCreatedAt() - Method in class com.judgmentlabs.judgeval.internal.api.models.TraceEvaluationRun
 
getCustomScorers() - Method in class com.judgmentlabs.judgeval.internal.api.models.ExampleEvaluationRun
 
getCustomScorers() - Method in class com.judgmentlabs.judgeval.internal.api.models.TraceEvaluationRun
 
getDataObject() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScoringResult
 
getDescription() - Method in class com.judgmentlabs.judgeval.internal.api.models.PromptScorer
 
getDescription() - Method in class com.judgmentlabs.judgeval.internal.api.models.SavePromptScorerRequest
 
getDuration() - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
getError() - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer
 
getError() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerData
 
getEvalName() - Method in class com.judgmentlabs.judgeval.internal.api.models.ExampleEvaluationRun
 
getEvalName() - Method in class com.judgmentlabs.judgeval.internal.api.models.TraceEvaluationRun
 
getEvaluationCost() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScoringResult
 
getEvaluationModel() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerData
 
getEvents() - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
getExampleId() - Method in class com.judgmentlabs.judgeval.internal.api.models.Example
 
getExamples() - Method in class com.judgmentlabs.judgeval.internal.api.models.ExampleEvaluationRun
 
getExists() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerExistsResponse
 
getExperimentRunId() - Method in class com.judgmentlabs.judgeval.internal.api.models.EvalResultsFetch
 
getId() - Method in class com.judgmentlabs.judgeval.internal.api.models.ExampleEvaluationRun
 
getId() - Method in class com.judgmentlabs.judgeval.internal.api.models.PromptScorer
 
getId() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerData
 
getId() - Method in class com.judgmentlabs.judgeval.internal.api.models.TraceEvaluationRun
 
getIsBucketRubric() - Method in class com.judgmentlabs.judgeval.internal.api.models.PromptScorer
 
getIsBucketRun() - Method in class com.judgmentlabs.judgeval.internal.api.models.TraceEvaluationRun
 
getIsOffline() - Method in class com.judgmentlabs.judgeval.internal.api.models.TraceEvaluationRun
 
getIsTrace() - Method in class com.judgmentlabs.judgeval.internal.api.models.FetchPromptScorersRequest
 
getIsTrace() - Method in class com.judgmentlabs.judgeval.internal.api.models.PromptScorer
 
getIsTrace() - Method in class com.judgmentlabs.judgeval.internal.api.models.SavePromptScorerRequest
 
getJudgmentScorers() - Method in class com.judgmentlabs.judgeval.internal.api.models.ExampleEvaluationRun
 
getJudgmentScorers() - Method in class com.judgmentlabs.judgeval.internal.api.models.TraceEvaluationRun
 
getKwargs() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerConfig
 
getLinks() - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
getModel() - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer
 
getModel() - Method in class com.judgmentlabs.judgeval.internal.api.models.ExampleEvaluationRun
 
getModel() - Method in class com.judgmentlabs.judgeval.internal.api.models.PromptScorer
 
getModel() - Method in class com.judgmentlabs.judgeval.internal.api.models.SavePromptScorerRequest
 
getModel() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerConfig
 
getModel() - Method in class com.judgmentlabs.judgeval.internal.api.models.TraceEvaluationRun
 
getModelClient() - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer
 
getName() - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer
 
getName() - Method in class com.judgmentlabs.judgeval.internal.api.models.Example
 
getName() - Method in class com.judgmentlabs.judgeval.internal.api.models.PromptScorer
 
getName() - Method in class com.judgmentlabs.judgeval.internal.api.models.SavePromptScorerRequest
 
getName() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerConfig
 
getName() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerData
 
getName() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerExistsRequest
 
getName() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScoringResult
 
getName() - Method in class com.judgmentlabs.judgeval.scorers.APIScorer
 
getName() - Method in interface com.judgmentlabs.judgeval.scorers.BaseScorer
Returns the name of this scorer.
getNames() - Method in class com.judgmentlabs.judgeval.internal.api.models.FetchPromptScorersRequest
 
getOptions() - Method in class com.judgmentlabs.judgeval.internal.api.models.PromptScorer
 
getOptions() - Method in class com.judgmentlabs.judgeval.internal.api.models.SavePromptScorerRequest
 
getOptions() - Method in class com.judgmentlabs.judgeval.scorers.prompt_scorer.PromptScorer
 
getOrganizationId() - Method in class com.judgmentlabs.judgeval.internal.api.JudgmentAsyncClient
 
getOrganizationId() - Method in class com.judgmentlabs.judgeval.internal.api.JudgmentSyncClient
 
getOrganizationId() - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
getOrganizationId() - Method in class com.judgmentlabs.judgeval.internal.api.models.PromptScorer
 
getParentSpanId() - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
getProjectId() - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
getProjectId() - Method in class com.judgmentlabs.judgeval.internal.api.models.ResolveProjectNameResponse
 
getProjectId() - Method in class com.judgmentlabs.judgeval.tracer.BaseTracer
Returns the resolved project ID if available.
getProjectName() - Method in class com.judgmentlabs.judgeval.internal.api.models.EvalResultsFetch
 
getProjectName() - Method in class com.judgmentlabs.judgeval.internal.api.models.ExampleEvaluationRun
 
getProjectName() - Method in class com.judgmentlabs.judgeval.internal.api.models.ResolveProjectNameRequest
 
getProjectName() - Method in class com.judgmentlabs.judgeval.internal.api.models.TraceEvaluationRun
 
getProjectName() - Method in class com.judgmentlabs.judgeval.tracer.BaseTracer
Returns the project name.
getPrompt() - Method in class com.judgmentlabs.judgeval.internal.api.models.PromptScorer
 
getPrompt() - Method in class com.judgmentlabs.judgeval.internal.api.models.SavePromptScorerRequest
 
getPrompt() - Method in class com.judgmentlabs.judgeval.scorers.prompt_scorer.PromptScorer
 
getReason() - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer
 
getReason() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerData
 
getRequiredParams() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerConfig
 
getRequiredParams() - Method in class com.judgmentlabs.judgeval.scorers.APIScorer
 
getResourceAttributes() - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
getResults() - Method in class com.judgmentlabs.judgeval.internal.api.models.EvalResults
 
getRun() - Method in class com.judgmentlabs.judgeval.internal.api.models.EvalResults
 
getRunDuration() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScoringResult
 
getScore() - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer
 
getScore() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerData
 
getScoreBreakdown() - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer
 
getScorerConfig() - Method in class com.judgmentlabs.judgeval.scorers.APIScorer
 
getScorerConfig() - Method in interface com.judgmentlabs.judgeval.scorers.BaseScorer
Returns the configuration for this scorer.
getScorerConfig() - Method in class com.judgmentlabs.judgeval.scorers.custom_scorer.CustomScorer
 
getScorerConfig() - Method in class com.judgmentlabs.judgeval.scorers.prompt_scorer.PromptScorer
 
getScorerName() - Method in class com.judgmentlabs.judgeval.scorers.prompt_scorer.PromptScorer
 
getScorerResponse() - Method in class com.judgmentlabs.judgeval.internal.api.models.SavePromptScorerResponse
 
getScorers() - Method in class com.judgmentlabs.judgeval.internal.api.models.FetchPromptScorersResponse
 
getScorersData() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScoringResult
 
getScoreType() - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer
 
getScoreType() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerConfig
 
getScoreType() - Method in class com.judgmentlabs.judgeval.scorers.APIScorer
 
getServerHosted() - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer
 
getServiceName() - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
getSpanAttributes() - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
getSpanExporter() - Method in class com.judgmentlabs.judgeval.tracer.BaseTracer
Returns the span exporter for this tracer.
getSpanId() - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
getSpanKind() - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
getSpanName() - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
getStatusCode() - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
getStatusMessage() - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
getStrictMode() - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer
 
getStrictMode() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerConfig
 
getStrictMode() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerData
 
getStrictMode() - Method in class com.judgmentlabs.judgeval.scorers.APIScorer
 
getSuccess() - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer
 
getSuccess() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerData
 
getSuccess() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScoringResult
 
getThreshold() - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer
 
getThreshold() - Method in class com.judgmentlabs.judgeval.internal.api.models.PromptScorer
 
getThreshold() - Method in class com.judgmentlabs.judgeval.internal.api.models.SavePromptScorerRequest
 
getThreshold() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerConfig
 
getThreshold() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerData
 
getThreshold() - Method in class com.judgmentlabs.judgeval.scorers.APIScorer
 
getTimestamp() - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
getTraceAndSpanIds() - Method in class com.judgmentlabs.judgeval.internal.api.models.TraceEvaluationRun
 
getTraceId() - Method in class com.judgmentlabs.judgeval.internal.api.models.ExampleEvaluationRun
 
getTraceId() - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
getTraceId() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScoringResult
 
getTracer() - Method in class com.judgmentlabs.judgeval.tracer.BaseTracer
Returns the OpenTelemetry tracer instance.
getTraceSpanId() - Method in class com.judgmentlabs.judgeval.internal.api.models.ExampleEvaluationRun
 
getTraceState() - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
getUpdatedAt() - Method in class com.judgmentlabs.judgeval.internal.api.models.PromptScorer
 
getUser() - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer
 
getUserId() - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
getUserId() - Method in class com.judgmentlabs.judgeval.internal.api.models.PromptScorer
 
getUsingNativeModel() - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer
 
getValue() - Method in enum class com.judgmentlabs.judgeval.data.APIScorerType
 
getValue() - Method in enum class com.judgmentlabs.judgeval.utils.Logger.Level
 
getVersion() - Static method in class com.judgmentlabs.judgeval.Version
Gets the current SDK version.

H

hashCode() - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer
 
hashCode() - Method in class com.judgmentlabs.judgeval.internal.api.models.EvalResults
 
hashCode() - Method in class com.judgmentlabs.judgeval.internal.api.models.EvalResultsFetch
 
hashCode() - Method in class com.judgmentlabs.judgeval.internal.api.models.Example
 
hashCode() - Method in class com.judgmentlabs.judgeval.internal.api.models.ExampleEvaluationRun
 
hashCode() - Method in class com.judgmentlabs.judgeval.internal.api.models.FetchPromptScorersRequest
 
hashCode() - Method in class com.judgmentlabs.judgeval.internal.api.models.FetchPromptScorersResponse
 
hashCode() - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
hashCode() - Method in class com.judgmentlabs.judgeval.internal.api.models.PromptScorer
 
hashCode() - Method in class com.judgmentlabs.judgeval.internal.api.models.ResolveProjectNameRequest
 
hashCode() - Method in class com.judgmentlabs.judgeval.internal.api.models.ResolveProjectNameResponse
 
hashCode() - Method in class com.judgmentlabs.judgeval.internal.api.models.SavePromptScorerRequest
 
hashCode() - Method in class com.judgmentlabs.judgeval.internal.api.models.SavePromptScorerResponse
 
hashCode() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerConfig
 
hashCode() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerData
 
hashCode() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerExistsRequest
 
hashCode() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerExistsResponse
 
hashCode() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScoringResult
 
hashCode() - Method in class com.judgmentlabs.judgeval.internal.api.models.TraceEvaluationRun
 

I

info(String) - Static method in class com.judgmentlabs.judgeval.utils.Logger
 
INFO - Enum constant in enum class com.judgmentlabs.judgeval.utils.Logger.Level
 
initialize() - Method in class com.judgmentlabs.judgeval.tracer.BaseTracer
Initializes the tracer.
initialize() - Method in class com.judgmentlabs.judgeval.tracer.Tracer
Initializes the tracer by setting up the OpenTelemetry SDK with a span exporter, configuring the tracer provider with batch span processing, and registering it globally.
initialize(boolean) - Method in class com.judgmentlabs.judgeval.tracer.Tracer.Builder
Sets whether to automatically initialize the tracer on build.
isEnableEvaluation() - Method in class com.judgmentlabs.judgeval.tracer.BaseTracer
Returns whether evaluation is enabled.
ISerializer - Interface in com.judgmentlabs.judgeval.tracer
Serializes objects to string representations.

J

jacksonMapper - Variable in class com.judgmentlabs.judgeval.tracer.BaseTracer
 
Judgeval - Class in com.judgmentlabs.judgeval
Main entry point for the Judgment SDK.
Judgeval(Judgeval.Builder) - Constructor for class com.judgmentlabs.judgeval.Judgeval
 
Judgeval.Builder - Class in com.judgmentlabs.judgeval
Builder for configuring and creating Judgeval instances.
JUDGMENT_AGENT_CLASS_NAME - Static variable in class com.judgmentlabs.judgeval.JudgmentAttributeKeys.AttributeKeys
 
JUDGMENT_AGENT_ID - Static variable in class com.judgmentlabs.judgeval.JudgmentAttributeKeys.AttributeKeys
 
JUDGMENT_AGENT_INSTANCE_NAME - Static variable in class com.judgmentlabs.judgeval.JudgmentAttributeKeys.AttributeKeys
 
JUDGMENT_API_KEY - Static variable in class com.judgmentlabs.judgeval.Env
 
JUDGMENT_API_URL - Static variable in class com.judgmentlabs.judgeval.Env
 
JUDGMENT_CUMULATIVE_LLM_COST - Static variable in class com.judgmentlabs.judgeval.JudgmentAttributeKeys.AttributeKeys
 
JUDGMENT_CUSTOMER_ID - Static variable in class com.judgmentlabs.judgeval.JudgmentAttributeKeys.AttributeKeys
 
JUDGMENT_DEFAULT_GPT_MODEL - Static variable in class com.judgmentlabs.judgeval.Env
 
JUDGMENT_INPUT - Static variable in class com.judgmentlabs.judgeval.JudgmentAttributeKeys.AttributeKeys
 
JUDGMENT_IS_AGENT_ENTRY_POINT - Static variable in class com.judgmentlabs.judgeval.JudgmentAttributeKeys.AttributeKeys
 
JUDGMENT_LOG_LEVEL - Static variable in class com.judgmentlabs.judgeval.Env
 
JUDGMENT_NO_COLOR - Static variable in class com.judgmentlabs.judgeval.Env
 
JUDGMENT_OFFLINE_MODE - Static variable in class com.judgmentlabs.judgeval.JudgmentAttributeKeys.AttributeKeys
 
JUDGMENT_ORG_ID - Static variable in class com.judgmentlabs.judgeval.Env
 
JUDGMENT_OUTPUT - Static variable in class com.judgmentlabs.judgeval.JudgmentAttributeKeys.AttributeKeys
 
JUDGMENT_PARENT_AGENT_ID - Static variable in class com.judgmentlabs.judgeval.JudgmentAttributeKeys.AttributeKeys
 
JUDGMENT_PENDING_TRACE_EVAL - Static variable in class com.judgmentlabs.judgeval.JudgmentAttributeKeys.AttributeKeys
 
JUDGMENT_PROJECT_ID - Static variable in class com.judgmentlabs.judgeval.JudgmentAttributeKeys.ResourceKeys
 
JUDGMENT_SPAN_KIND - Static variable in class com.judgmentlabs.judgeval.JudgmentAttributeKeys.AttributeKeys
 
JUDGMENT_STATE_AFTER - Static variable in class com.judgmentlabs.judgeval.JudgmentAttributeKeys.AttributeKeys
 
JUDGMENT_STATE_BEFORE - Static variable in class com.judgmentlabs.judgeval.JudgmentAttributeKeys.AttributeKeys
 
JUDGMENT_UPDATE_ID - Static variable in class com.judgmentlabs.judgeval.JudgmentAttributeKeys.AttributeKeys
 
JudgmentAsyncClient - Class in com.judgmentlabs.judgeval.internal.api
 
JudgmentAsyncClient(String, String, String) - Constructor for class com.judgmentlabs.judgeval.internal.api.JudgmentAsyncClient
 
JudgmentAttributeKeys - Class in com.judgmentlabs.judgeval
 
JudgmentAttributeKeys.AttributeKeys - Class in com.judgmentlabs.judgeval
 
JudgmentAttributeKeys.ResourceKeys - Class in com.judgmentlabs.judgeval
 
JudgmentSpanExporter - Class in com.judgmentlabs.judgeval.tracer.exporters
SpanExporter implementation that sends spans to Judgment Labs with project identification.
JudgmentSpanExporter(String, String, String, String) - Constructor for class com.judgmentlabs.judgeval.tracer.exporters.JudgmentSpanExporter
Creates a new JudgmentSpanExporter with the specified configuration.
JudgmentSpanExporter.Builder - Class in com.judgmentlabs.judgeval.tracer.exporters
Builder for creating JudgmentSpanExporter instances.
JudgmentSyncClient - Class in com.judgmentlabs.judgeval.internal.api
 
JudgmentSyncClient(String, String, String) - Constructor for class com.judgmentlabs.judgeval.internal.api.JudgmentSyncClient
 

L

logEvalResults(EvalResults) - Method in class com.judgmentlabs.judgeval.internal.api.JudgmentAsyncClient
 
logEvalResults(EvalResults) - Method in class com.judgmentlabs.judgeval.internal.api.JudgmentSyncClient
 
Logger - Class in com.judgmentlabs.judgeval.utils
 
Logger() - Constructor for class com.judgmentlabs.judgeval.utils.Logger
 
Logger.Level - Enum Class in com.judgmentlabs.judgeval.utils
 

M

metadata(String, Object) - Method in class com.judgmentlabs.judgeval.data.ScorerData.Builder
Adds a single metadata entry.
model(String) - Method in class com.judgmentlabs.judgeval.scorers.APIScorer.Builder
 
model(String) - Method in class com.judgmentlabs.judgeval.scorers.built_in.AnswerCorrectnessScorer.Builder
 
model(String) - Method in class com.judgmentlabs.judgeval.scorers.built_in.AnswerRelevancyScorer.Builder
 
model(String) - Method in class com.judgmentlabs.judgeval.scorers.built_in.FaithfulnessScorer.Builder
 

N

name(String) - Method in class com.judgmentlabs.judgeval.data.Example.Builder
Sets the name of the example.
name(String) - Method in class com.judgmentlabs.judgeval.data.ScorerData.Builder
Sets the scorer name.
name(String) - Method in class com.judgmentlabs.judgeval.scorers.APIScorer.Builder
 
name(String) - Method in class com.judgmentlabs.judgeval.scorers.built_in.AnswerCorrectnessScorer.Builder
 
name(String) - Method in class com.judgmentlabs.judgeval.scorers.built_in.AnswerRelevancyScorer.Builder
 
name(String) - Method in class com.judgmentlabs.judgeval.scorers.built_in.FaithfulnessScorer.Builder
 
name(String) - Method in class com.judgmentlabs.judgeval.scorers.custom_scorer.CustomScorer.Builder
 
name(String) - Method in class com.judgmentlabs.judgeval.scorers.prompt_scorer.PromptScorer.Builder
 
NoOpSpanExporter - Class in com.judgmentlabs.judgeval.tracer.exporters
A no-op implementation of SpanExporter that discards all spans.
NoOpSpanExporter() - Constructor for class com.judgmentlabs.judgeval.tracer.exporters.NoOpSpanExporter
 

O

options(Map<String, Double>) - Method in class com.judgmentlabs.judgeval.scorers.prompt_scorer.PromptScorer.Builder
 
organizationId(String) - Method in class com.judgmentlabs.judgeval.Judgeval.Builder
Sets the organization ID.
organizationId(String) - Method in class com.judgmentlabs.judgeval.tracer.exporters.JudgmentSpanExporter.Builder
Sets the organization ID.
OtelTraceSpan - Class in com.judgmentlabs.judgeval.internal.api.models
 
OtelTraceSpan() - Constructor for class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 

P

projectId - Variable in class com.judgmentlabs.judgeval.tracer.BaseTracer
 
projectId(String) - Method in class com.judgmentlabs.judgeval.tracer.exporters.JudgmentSpanExporter.Builder
Sets the project ID.
projectName - Variable in class com.judgmentlabs.judgeval.tracer.BaseTracer
 
projectName(String) - Method in class com.judgmentlabs.judgeval.tracer.Tracer.Builder
Sets the project name for this tracer.
projectsResolve(ResolveProjectNameRequest) - Method in class com.judgmentlabs.judgeval.internal.api.JudgmentAsyncClient
 
projectsResolve(ResolveProjectNameRequest) - Method in class com.judgmentlabs.judgeval.internal.api.JudgmentSyncClient
 
prompt(String) - Method in class com.judgmentlabs.judgeval.scorers.prompt_scorer.PromptScorer.Builder
 
PROMPT_SCORER - Enum constant in enum class com.judgmentlabs.judgeval.data.APIScorerType
 
promptScorer() - Method in class com.judgmentlabs.judgeval.scorers.ScorersFactory
Returns a factory for creating prompt-based scorers.
PromptScorer - Class in com.judgmentlabs.judgeval.internal.api.models
 
PromptScorer - Class in com.judgmentlabs.judgeval.scorers.prompt_scorer
Scorer that evaluates traces using Judgment-hosted prompt scorers.
PromptScorer() - Constructor for class com.judgmentlabs.judgeval.internal.api.models.PromptScorer
 
PromptScorer.Builder - Class in com.judgmentlabs.judgeval.scorers.prompt_scorer
Builder for configuring and creating PromptScorer instances.
PromptScorerFactory - Class in com.judgmentlabs.judgeval.scorers.prompt_scorer
Factory for retrieving prompt-based scorers.
PromptScorerFactory(JudgmentSyncClient, boolean) - Constructor for class com.judgmentlabs.judgeval.scorers.prompt_scorer.PromptScorerFactory
 
property(String, Object) - Method in class com.judgmentlabs.judgeval.data.Example.Builder
Sets a custom property on the example.

R

reason(String) - Method in class com.judgmentlabs.judgeval.data.ScorerData.Builder
Sets the reason for the evaluation result.
requiredParams(List<String>) - Method in class com.judgmentlabs.judgeval.scorers.APIScorer.Builder
 
ResolveProjectNameRequest - Class in com.judgmentlabs.judgeval.internal.api.models
 
ResolveProjectNameRequest() - Constructor for class com.judgmentlabs.judgeval.internal.api.models.ResolveProjectNameRequest
 
ResolveProjectNameResponse - Class in com.judgmentlabs.judgeval.internal.api.models
 
ResolveProjectNameResponse() - Constructor for class com.judgmentlabs.judgeval.internal.api.models.ResolveProjectNameResponse
 

S

SavePromptScorerRequest - Class in com.judgmentlabs.judgeval.internal.api.models
 
SavePromptScorerRequest() - Constructor for class com.judgmentlabs.judgeval.internal.api.models.SavePromptScorerRequest
 
SavePromptScorerResponse - Class in com.judgmentlabs.judgeval.internal.api.models
 
SavePromptScorerResponse() - Constructor for class com.judgmentlabs.judgeval.internal.api.models.SavePromptScorerResponse
 
saveScorer(SavePromptScorerRequest) - Method in class com.judgmentlabs.judgeval.internal.api.JudgmentAsyncClient
 
saveScorer(SavePromptScorerRequest) - Method in class com.judgmentlabs.judgeval.internal.api.JudgmentSyncClient
 
score(Double) - Method in class com.judgmentlabs.judgeval.data.ScorerData.Builder
Sets the evaluation score.
ScorerConfig - Class in com.judgmentlabs.judgeval.internal.api.models
 
ScorerConfig() - Constructor for class com.judgmentlabs.judgeval.internal.api.models.ScorerConfig
 
scorerData(ScorerData) - Method in class com.judgmentlabs.judgeval.data.ScoringResult.Builder
Adds a single scorer result.
ScorerData - Class in com.judgmentlabs.judgeval.data
Represents the result of a single scorer evaluation.
ScorerData - Class in com.judgmentlabs.judgeval.internal.api.models
 
ScorerData() - Constructor for class com.judgmentlabs.judgeval.data.ScorerData
 
ScorerData() - Constructor for class com.judgmentlabs.judgeval.internal.api.models.ScorerData
 
ScorerData.Builder - Class in com.judgmentlabs.judgeval.data
Builder for configuring and creating ScorerData instances.
scorerExists(ScorerExistsRequest) - Method in class com.judgmentlabs.judgeval.internal.api.JudgmentAsyncClient
 
scorerExists(ScorerExistsRequest) - Method in class com.judgmentlabs.judgeval.internal.api.JudgmentSyncClient
 
ScorerExistsRequest - Class in com.judgmentlabs.judgeval.internal.api.models
 
ScorerExistsRequest() - Constructor for class com.judgmentlabs.judgeval.internal.api.models.ScorerExistsRequest
 
ScorerExistsResponse - Class in com.judgmentlabs.judgeval.internal.api.models
 
ScorerExistsResponse() - Constructor for class com.judgmentlabs.judgeval.internal.api.models.ScorerExistsResponse
 
scorers() - Method in class com.judgmentlabs.judgeval.Judgeval
Returns a factory for creating scorers.
scorersData(List<ScorerData>) - Method in class com.judgmentlabs.judgeval.data.ScoringResult.Builder
Sets the list of scorer results.
ScorersFactory - Class in com.judgmentlabs.judgeval.scorers
Factory for creating scorer builders and accessing scorer types.
ScorersFactory(JudgmentSyncClient) - Constructor for class com.judgmentlabs.judgeval.scorers.ScorersFactory
 
ScoringResult - Class in com.judgmentlabs.judgeval.data
Represents a collection of scorer evaluation results.
ScoringResult - Class in com.judgmentlabs.judgeval.internal.api.models
 
ScoringResult() - Constructor for class com.judgmentlabs.judgeval.data.ScoringResult
 
ScoringResult() - Constructor for class com.judgmentlabs.judgeval.internal.api.models.ScoringResult
 
ScoringResult.Builder - Class in com.judgmentlabs.judgeval.data
Builder for configuring and creating ScoringResult instances.
serialize(Object) - Method in interface com.judgmentlabs.judgeval.tracer.ISerializer
Serializes an object to a string.
serialize(Object, Type) - Method in interface com.judgmentlabs.judgeval.tracer.ISerializer
Serializes an object to a string using the specified type.
serializer - Variable in class com.judgmentlabs.judgeval.tracer.BaseTracer
 
serializer(ISerializer) - Method in class com.judgmentlabs.judgeval.tracer.Tracer.Builder
Sets the custom serializer for span attributes.
SERVICE_NAME - Static variable in class com.judgmentlabs.judgeval.JudgmentAttributeKeys.ResourceKeys
 
setAdditionalMetadata(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer
 
setAdditionalMetadata(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerData
 
setAdditionalProperty(String, Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer
 
setAdditionalProperty(String, Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.EvalResults
 
setAdditionalProperty(String, Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.EvalResultsFetch
 
setAdditionalProperty(String, Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.Example
 
setAdditionalProperty(String, Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.ExampleEvaluationRun
 
setAdditionalProperty(String, Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.FetchPromptScorersRequest
 
setAdditionalProperty(String, Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.FetchPromptScorersResponse
 
setAdditionalProperty(String, Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
setAdditionalProperty(String, Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.PromptScorer
 
setAdditionalProperty(String, Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.ResolveProjectNameRequest
 
setAdditionalProperty(String, Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.ResolveProjectNameResponse
 
setAdditionalProperty(String, Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.SavePromptScorerRequest
 
setAdditionalProperty(String, Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.SavePromptScorerResponse
 
setAdditionalProperty(String, Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerConfig
 
setAdditionalProperty(String, Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerData
 
setAdditionalProperty(String, Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerExistsRequest
 
setAdditionalProperty(String, Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerExistsResponse
 
setAdditionalProperty(String, Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScoringResult
 
setAdditionalProperty(String, Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.TraceEvaluationRun
 
setAttribute(String, boolean) - Method in class com.judgmentlabs.judgeval.tracer.BaseTracer
Sets a boolean attribute on the current span.
setAttribute(String, double) - Method in class com.judgmentlabs.judgeval.tracer.BaseTracer
Sets a double attribute on the current span.
setAttribute(String, long) - Method in class com.judgmentlabs.judgeval.tracer.BaseTracer
Sets a long attribute on the current span.
setAttribute(String, Object) - Method in class com.judgmentlabs.judgeval.tracer.BaseTracer
Sets an attribute on the current span by serializing the value.
setAttribute(String, Object, Type) - Method in class com.judgmentlabs.judgeval.tracer.BaseTracer
Sets an attribute on the current span by serializing the value with the specified type.
setAttribute(String, String) - Method in class com.judgmentlabs.judgeval.tracer.BaseTracer
Sets a string attribute on the current span.
setAttributes(Map<String, Object>) - Method in class com.judgmentlabs.judgeval.tracer.BaseTracer
Sets multiple attributes on the current span.
setClassName(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer
 
setCreatedAt(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.Example
 
setCreatedAt(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.ExampleEvaluationRun
 
setCreatedAt(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.PromptScorer
 
setCreatedAt(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.TraceEvaluationRun
 
setCustomScorers(List<BaseScorer>) - Method in class com.judgmentlabs.judgeval.internal.api.models.ExampleEvaluationRun
 
setCustomScorers(List<BaseScorer>) - Method in class com.judgmentlabs.judgeval.internal.api.models.TraceEvaluationRun
 
setDataObject(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScoringResult
 
setDescription(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.PromptScorer
 
setDescription(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.SavePromptScorerRequest
 
setDuration(Integer) - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
setError(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer
 
setError(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerData
 
setEvalName(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.ExampleEvaluationRun
 
setEvalName(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.TraceEvaluationRun
 
setEvaluationCost(Double) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScoringResult
 
setEvaluationModel(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerData
 
setEvents(List<Object>) - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
setExampleId(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.Example
 
setExamples(List<Example>) - Method in class com.judgmentlabs.judgeval.internal.api.models.ExampleEvaluationRun
 
setExists(Boolean) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerExistsResponse
 
setExperimentRunId(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.EvalResultsFetch
 
setGeneralSpan() - Method in class com.judgmentlabs.judgeval.tracer.BaseTracer
Marks the current span as a general span.
setId(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.ExampleEvaluationRun
 
setId(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.PromptScorer
 
setId(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerData
 
setId(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.TraceEvaluationRun
 
setInput(Object) - Method in class com.judgmentlabs.judgeval.tracer.BaseTracer
Sets the input attribute on the current span.
setInput(Object, Type) - Method in class com.judgmentlabs.judgeval.tracer.BaseTracer
Sets the input attribute on the current span using the specified type.
setIsBucketRubric(Boolean) - Method in class com.judgmentlabs.judgeval.internal.api.models.PromptScorer
 
setIsBucketRun(Boolean) - Method in class com.judgmentlabs.judgeval.internal.api.models.TraceEvaluationRun
 
setIsOffline(Boolean) - Method in class com.judgmentlabs.judgeval.internal.api.models.TraceEvaluationRun
 
setIsTrace(Boolean) - Method in class com.judgmentlabs.judgeval.internal.api.models.FetchPromptScorersRequest
 
setIsTrace(Boolean) - Method in class com.judgmentlabs.judgeval.internal.api.models.PromptScorer
 
setIsTrace(Boolean) - Method in class com.judgmentlabs.judgeval.internal.api.models.SavePromptScorerRequest
 
setJudgmentScorers(List<ScorerConfig>) - Method in class com.judgmentlabs.judgeval.internal.api.models.ExampleEvaluationRun
 
setJudgmentScorers(List<ScorerConfig>) - Method in class com.judgmentlabs.judgeval.internal.api.models.TraceEvaluationRun
 
setKwargs(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerConfig
 
setLevel(Logger.Level) - Static method in class com.judgmentlabs.judgeval.utils.Logger
 
setLinks(List<Object>) - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
setLLMSpan() - Method in class com.judgmentlabs.judgeval.tracer.BaseTracer
Marks the current span as an LLM span.
setModel(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer
 
setModel(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.ExampleEvaluationRun
 
setModel(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.PromptScorer
 
setModel(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.SavePromptScorerRequest
 
setModel(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerConfig
 
setModel(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.TraceEvaluationRun
 
setModelClient(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer
 
setName(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer
 
setName(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.Example
 
setName(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.PromptScorer
 
setName(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.SavePromptScorerRequest
 
setName(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerConfig
 
setName(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerData
 
setName(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerExistsRequest
 
setName(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScoringResult
 
setNames(List<String>) - Method in class com.judgmentlabs.judgeval.internal.api.models.FetchPromptScorersRequest
 
setOptions(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.PromptScorer
 
setOptions(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.SavePromptScorerRequest
 
setOrganizationId(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
setOrganizationId(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.PromptScorer
 
setOutput(PrintStream) - Static method in class com.judgmentlabs.judgeval.utils.Logger
 
setOutput(Object) - Method in class com.judgmentlabs.judgeval.tracer.BaseTracer
Sets the output attribute on the current span.
setOutput(Object, Type) - Method in class com.judgmentlabs.judgeval.tracer.BaseTracer
Sets the output attribute on the current span using the specified type.
setParentSpanId(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
setProjectId(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
setProjectId(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.ResolveProjectNameResponse
 
setProjectName(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.EvalResultsFetch
 
setProjectName(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.ExampleEvaluationRun
 
setProjectName(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.ResolveProjectNameRequest
 
setProjectName(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.TraceEvaluationRun
 
setPrompt(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.PromptScorer
 
setPrompt(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.SavePromptScorerRequest
 
setReason(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer
 
setReason(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerData
 
setRequiredParams(List<String>) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerConfig
 
setRequiredParams(List<String>) - Method in class com.judgmentlabs.judgeval.scorers.APIScorer
 
setResourceAttributes(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
setResults(List<ScoringResult>) - Method in class com.judgmentlabs.judgeval.internal.api.models.EvalResults
 
setRun(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.EvalResults
 
setRunDuration(Double) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScoringResult
 
setScore(Double) - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer
 
setScore(Double) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerData
 
setScoreBreakdown(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer
 
setScorerResponse(PromptScorer) - Method in class com.judgmentlabs.judgeval.internal.api.models.SavePromptScorerResponse
 
setScorers(List<PromptScorer>) - Method in class com.judgmentlabs.judgeval.internal.api.models.FetchPromptScorersResponse
 
setScorersData(List<ScorerData>) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScoringResult
 
setScoreType(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer
 
setScoreType(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerConfig
 
setServerHosted(Boolean) - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer
 
setServiceName(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
setSpanAttributes(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
setSpanId(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
setSpanKind(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
setSpanKind(String) - Method in class com.judgmentlabs.judgeval.tracer.BaseTracer
Sets the span kind attribute on the current span.
setSpanName(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
setStatusCode(Integer) - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
setStatusMessage(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
setStrictMode(Boolean) - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer
 
setStrictMode(Boolean) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerConfig
 
setStrictMode(Boolean) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerData
 
setSuccess(Boolean) - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer
 
setSuccess(Boolean) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerData
 
setSuccess(Boolean) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScoringResult
 
setThreshold(double) - Method in class com.judgmentlabs.judgeval.scorers.APIScorer
 
setThreshold(Double) - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer
 
setThreshold(Double) - Method in class com.judgmentlabs.judgeval.internal.api.models.PromptScorer
 
setThreshold(Double) - Method in class com.judgmentlabs.judgeval.internal.api.models.SavePromptScorerRequest
 
setThreshold(Double) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerConfig
 
setThreshold(Double) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerData
 
setTimestamp(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
setToolSpan() - Method in class com.judgmentlabs.judgeval.tracer.BaseTracer
Marks the current span as a tool span.
setTraceAndSpanIds(List<List<Object>>) - Method in class com.judgmentlabs.judgeval.internal.api.models.TraceEvaluationRun
 
setTraceId(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.ExampleEvaluationRun
 
setTraceId(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
setTraceId(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScoringResult
 
setTraceSpanId(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.ExampleEvaluationRun
 
setTraceState(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
setUpdatedAt(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.PromptScorer
 
setUseColor(boolean) - Static method in class com.judgmentlabs.judgeval.utils.Logger
 
setUser(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer
 
setUserId(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
setUserId(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.PromptScorer
 
setUsingNativeModel(Boolean) - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer
 
shutdown() - Method in class com.judgmentlabs.judgeval.tracer.exporters.JudgmentSpanExporter
Shuts down this exporter and releases any resources.
shutdown() - Method in class com.judgmentlabs.judgeval.tracer.exporters.NoOpSpanExporter
Performs a no-op shutdown operation.
shutdown(int) - Method in class com.judgmentlabs.judgeval.tracer.BaseTracer
Shuts down the tracer.
shutdown(int) - Method in class com.judgmentlabs.judgeval.tracer.Tracer
Shuts down the tracer, flushing any remaining spans and releasing resources.
span(String) - Static method in class com.judgmentlabs.judgeval.tracer.BaseTracer
Creates and returns a new span with the specified name.
span(String, Runnable) - Method in class com.judgmentlabs.judgeval.tracer.BaseTracer
Executes a runnable within a new span, automatically handling span lifecycle and errors.
span(String, Callable<T>) - Method in class com.judgmentlabs.judgeval.tracer.BaseTracer
Executes a callable within a new span, automatically handling span lifecycle and errors.
strictMode(boolean) - Method in class com.judgmentlabs.judgeval.scorers.APIScorer.Builder
 
strictMode(boolean) - Method in class com.judgmentlabs.judgeval.scorers.built_in.AnswerCorrectnessScorer.Builder
 
strictMode(boolean) - Method in class com.judgmentlabs.judgeval.scorers.built_in.AnswerRelevancyScorer.Builder
 
strictMode(boolean) - Method in class com.judgmentlabs.judgeval.scorers.built_in.FaithfulnessScorer.Builder
 
strictMode(Boolean) - Method in class com.judgmentlabs.judgeval.data.ScorerData.Builder
Sets strict mode for evaluation.
success(Boolean) - Method in class com.judgmentlabs.judgeval.data.ScorerData.Builder
Sets whether the evaluation succeeded.
success(Boolean) - Method in class com.judgmentlabs.judgeval.data.ScoringResult.Builder
Sets whether the overall evaluation succeeded.

T

TELEMETRY_SDK_LANGUAGE - Static variable in class com.judgmentlabs.judgeval.JudgmentAttributeKeys.ResourceKeys
 
TELEMETRY_SDK_NAME - Static variable in class com.judgmentlabs.judgeval.JudgmentAttributeKeys.ResourceKeys
 
TELEMETRY_SDK_VERSION - Static variable in class com.judgmentlabs.judgeval.JudgmentAttributeKeys.ResourceKeys
 
threshold(double) - Method in class com.judgmentlabs.judgeval.scorers.APIScorer.Builder
 
threshold(double) - Method in class com.judgmentlabs.judgeval.scorers.built_in.AnswerCorrectnessScorer.Builder
 
threshold(double) - Method in class com.judgmentlabs.judgeval.scorers.built_in.AnswerRelevancyScorer.Builder
 
threshold(double) - Method in class com.judgmentlabs.judgeval.scorers.built_in.FaithfulnessScorer.Builder
 
threshold(double) - Method in class com.judgmentlabs.judgeval.scorers.prompt_scorer.PromptScorer.Builder
 
threshold(Double) - Method in class com.judgmentlabs.judgeval.data.ScorerData.Builder
Sets the evaluation threshold.
toString() - Method in enum class com.judgmentlabs.judgeval.data.APIScorerType
 
toString() - Method in class com.judgmentlabs.judgeval.scorers.prompt_scorer.PromptScorer
 
TRACE_PROMPT_SCORER - Enum constant in enum class com.judgmentlabs.judgeval.data.APIScorerType
 
TraceEvaluationRun - Class in com.judgmentlabs.judgeval.internal.api.models
 
TraceEvaluationRun() - Constructor for class com.judgmentlabs.judgeval.internal.api.models.TraceEvaluationRun
 
tracePromptScorer() - Method in class com.judgmentlabs.judgeval.scorers.ScorersFactory
Returns a factory for creating trace-level prompt scorers.
tracer() - Method in class com.judgmentlabs.judgeval.Judgeval
Returns a factory for creating tracers.
Tracer - Class in com.judgmentlabs.judgeval.tracer
 
TRACER_NAME - Static variable in class com.judgmentlabs.judgeval.tracer.BaseTracer
 
Tracer.Builder - Class in com.judgmentlabs.judgeval.tracer
Builder for configuring and creating Tracer instances.
TracerFactory - Class in com.judgmentlabs.judgeval.tracer
Factory for creating tracer builders.
TracerFactory(JudgmentSyncClient) - Constructor for class com.judgmentlabs.judgeval.tracer.TracerFactory
 

V

valueOf(String) - Static method in enum class com.judgmentlabs.judgeval.data.APIScorerType
Returns the enum constant of this class with the specified name.
valueOf(String) - Static method in enum class com.judgmentlabs.judgeval.utils.Logger.Level
Returns the enum constant of this class with the specified name.
values() - Static method in enum class com.judgmentlabs.judgeval.data.APIScorerType
Returns an array containing the constants of this enum class, in the order they are declared.
values() - Static method in enum class com.judgmentlabs.judgeval.utils.Logger.Level
Returns an array containing the constants of this enum class, in the order they are declared.
Version - Class in com.judgmentlabs.judgeval
 

W

warning(String) - Static method in class com.judgmentlabs.judgeval.utils.Logger
 
WARNING - Enum constant in enum class com.judgmentlabs.judgeval.utils.Logger.Level
 
A B C D E F G H I J L M N O P R S T V W 
All Classes and Interfaces|All Packages|Constant Field Values