Index

A B C D E F G H I J L M N O P R S T V W 
All Classes and Interfaces|All Packages|Constant Field Values|Serialized Form

A

additionalMetadata(Map<String, Object>) - Method in class com.judgmentlabs.judgeval.data.ScorerData.Builder
 
additionalProperty(String, Object) - Method in class com.judgmentlabs.judgeval.scorers.APIScorer.Builder
 
addToRunEvalQueue(ExampleEvaluationRun) - Method in class com.judgmentlabs.judgeval.internal.api.JudgmentAsyncClient
 
addToRunEvalQueue(ExampleEvaluationRun) - Method in class com.judgmentlabs.judgeval.internal.api.JudgmentSyncClient
 
ANSWER_CORRECTNESS - Enum constant in enum class com.judgmentlabs.judgeval.data.APIScorerType
 
ANSWER_RELEVANCY - Enum constant in enum class com.judgmentlabs.judgeval.data.APIScorerType
 
AnswerCorrectnessScorer - Class in com.judgmentlabs.judgeval.scorers.api_scorers
 
AnswerCorrectnessScorer() - Constructor for class com.judgmentlabs.judgeval.scorers.api_scorers.AnswerCorrectnessScorer
 
AnswerRelevancyScorer - Class in com.judgmentlabs.judgeval.scorers.api_scorers
 
AnswerRelevancyScorer() - Constructor for class com.judgmentlabs.judgeval.scorers.api_scorers.AnswerRelevancyScorer
 
apiClient - Variable in class com.judgmentlabs.judgeval.tracer.BaseTracer
 
apiKey() - Method in class com.judgmentlabs.judgeval.tracer.TracerConfiguration
 
apiKey(String) - Method in class com.judgmentlabs.judgeval.tracer.exporters.JudgmentSpanExporter.Builder
Sets the API key for authentication.
apiKey(String) - Method in class com.judgmentlabs.judgeval.tracer.TracerConfiguration.Builder
 
APIScorer - Class in com.judgmentlabs.judgeval.scorers
 
APIScorer(APIScorerType) - Constructor for class com.judgmentlabs.judgeval.scorers.APIScorer
 
APIScorer.Builder<T> - Class in com.judgmentlabs.judgeval.scorers
 
APIScorerType - Enum Class in com.judgmentlabs.judgeval.data
 
apiUrl() - Method in class com.judgmentlabs.judgeval.tracer.TracerConfiguration
 
apiUrl(String) - Method in class com.judgmentlabs.judgeval.tracer.TracerConfiguration.Builder
 
appendToPrompt(String) - Method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.BasePromptScorer
 
asyncEvaluate(BaseScorer, Example) - Method in class com.judgmentlabs.judgeval.tracer.BaseTracer
 
asyncEvaluate(BaseScorer, Example, String) - Method in class com.judgmentlabs.judgeval.tracer.BaseTracer
Asynchronously evaluates a scorer with an example using current trace context.
asyncTraceEvaluate(BaseScorer) - Method in class com.judgmentlabs.judgeval.tracer.BaseTracer
 
asyncTraceEvaluate(BaseScorer, String) - Method in class com.judgmentlabs.judgeval.tracer.BaseTracer
Asynchronously evaluates a scorer with trace context.

B

BasePromptScorer - Class in com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer
 
BasePromptScorer(APIScorerType, String, String, double, Map<String, Double>, String, String) - Constructor for class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.BasePromptScorer
 
BaseScorer - Class in com.judgmentlabs.judgeval.internal.api.models
 
BaseScorer - Interface in com.judgmentlabs.judgeval.scorers
Minimal interface for scorers used by BaseTracer.
BaseScorer() - Constructor for class com.judgmentlabs.judgeval.internal.api.models.BaseScorer
 
BaseTracer - Class in com.judgmentlabs.judgeval.tracer
 
BaseTracer(TracerConfiguration, ISerializer, boolean) - Constructor for class com.judgmentlabs.judgeval.tracer.BaseTracer
 
BaseTracer.GsonSerializer - Class in com.judgmentlabs.judgeval.tracer
 
build() - Method in class com.judgmentlabs.judgeval.data.Example.Builder
 
build() - Method in class com.judgmentlabs.judgeval.data.ExampleEvaluationRun.Builder
 
build() - Method in class com.judgmentlabs.judgeval.data.ScorerData.Builder
 
build() - Method in class com.judgmentlabs.judgeval.data.ScoringResult.Builder
 
build() - Method in class com.judgmentlabs.judgeval.data.TraceEvaluationRun.Builder
 
build() - Method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.PromptScorer.Builder
 
build() - Method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.TracePromptScorer.Builder
 
build() - Method in class com.judgmentlabs.judgeval.scorers.APIScorer.Builder
 
build() - Method in class com.judgmentlabs.judgeval.tracer.exporters.JudgmentSpanExporter.Builder
Builds a new JudgmentSpanExporter with the current configuration.
build() - Method in class com.judgmentlabs.judgeval.tracer.Tracer.TracerBuilder
 
build() - Method in class com.judgmentlabs.judgeval.tracer.TracerConfiguration.Builder
 
builder() - Static method in class com.judgmentlabs.judgeval.data.Example
 
builder() - Static method in class com.judgmentlabs.judgeval.data.ExampleEvaluationRun
 
builder() - Static method in class com.judgmentlabs.judgeval.data.ScorerData
 
builder() - Static method in class com.judgmentlabs.judgeval.data.ScoringResult
 
builder() - Static method in class com.judgmentlabs.judgeval.data.TraceEvaluationRun
 
builder() - Static method in class com.judgmentlabs.judgeval.scorers.api_scorers.AnswerCorrectnessScorer
 
builder() - Static method in class com.judgmentlabs.judgeval.scorers.api_scorers.AnswerRelevancyScorer
 
builder() - Static method in class com.judgmentlabs.judgeval.scorers.api_scorers.DerailmentScorer
 
builder() - Static method in class com.judgmentlabs.judgeval.scorers.api_scorers.FaithfulnessScorer
 
builder() - Static method in class com.judgmentlabs.judgeval.scorers.api_scorers.InstructionAdherenceScorer
 
builder() - Static method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.PromptScorer
 
builder() - Static method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.TracePromptScorer
 
builder() - Static method in class com.judgmentlabs.judgeval.tracer.exporters.JudgmentSpanExporter
Creates a new builder for constructing JudgmentSpanExporter instances.
builder() - Static method in class com.judgmentlabs.judgeval.tracer.Tracer
 
builder() - Static method in class com.judgmentlabs.judgeval.tracer.TracerConfiguration
 
builder(Class<T>) - Static method in class com.judgmentlabs.judgeval.scorers.APIScorer
 
builder(String, String) - Static method in class com.judgmentlabs.judgeval.data.ExampleEvaluationRun
 
builder(String, String) - Static method in class com.judgmentlabs.judgeval.data.TraceEvaluationRun
 
builder(String, String) - Static method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.PromptScorer
 
builder(String, String) - Static method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.TracePromptScorer
 
Builder() - Constructor for class com.judgmentlabs.judgeval.tracer.TracerConfiguration.Builder
 

C

CLASSIFIER - Enum constant in enum class com.judgmentlabs.judgeval.data.APIScorerType
 
com.judgmentlabs.judgeval - package com.judgmentlabs.judgeval
 
com.judgmentlabs.judgeval.data - package com.judgmentlabs.judgeval.data
 
com.judgmentlabs.judgeval.exceptions - package com.judgmentlabs.judgeval.exceptions
 
com.judgmentlabs.judgeval.internal.api - package com.judgmentlabs.judgeval.internal.api
 
com.judgmentlabs.judgeval.internal.api.models - package com.judgmentlabs.judgeval.internal.api.models
 
com.judgmentlabs.judgeval.scorers - package com.judgmentlabs.judgeval.scorers
 
com.judgmentlabs.judgeval.scorers.api_scorers - package com.judgmentlabs.judgeval.scorers.api_scorers
 
com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer - package com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer
 
com.judgmentlabs.judgeval.tracer - package com.judgmentlabs.judgeval.tracer
 
com.judgmentlabs.judgeval.tracer.exporters - package com.judgmentlabs.judgeval.tracer.exporters
 
com.judgmentlabs.judgeval.utils - package com.judgmentlabs.judgeval.utils
 
configuration - Variable in class com.judgmentlabs.judgeval.tracer.BaseTracer
 
configuration(TracerConfiguration) - Method in class com.judgmentlabs.judgeval.tracer.Tracer.TracerBuilder
 
create() - Static method in class com.judgmentlabs.judgeval.scorers.api_scorers.AnswerCorrectnessScorer
 
create() - Static method in class com.judgmentlabs.judgeval.scorers.api_scorers.AnswerRelevancyScorer
 
create() - Static method in class com.judgmentlabs.judgeval.scorers.api_scorers.DerailmentScorer
 
create() - Static method in class com.judgmentlabs.judgeval.scorers.api_scorers.FaithfulnessScorer
 
create() - Static method in class com.judgmentlabs.judgeval.scorers.api_scorers.InstructionAdherenceScorer
 
create(double) - Static method in class com.judgmentlabs.judgeval.scorers.api_scorers.AnswerCorrectnessScorer
 
create(double) - Static method in class com.judgmentlabs.judgeval.scorers.api_scorers.AnswerRelevancyScorer
 
create(double) - Static method in class com.judgmentlabs.judgeval.scorers.api_scorers.DerailmentScorer
 
create(double) - Static method in class com.judgmentlabs.judgeval.scorers.api_scorers.FaithfulnessScorer
 
create(double) - Static method in class com.judgmentlabs.judgeval.scorers.api_scorers.InstructionAdherenceScorer
 
create(String, String) - Static method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.PromptScorer
 
create(String, String) - Static method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.TracePromptScorer
 
create(String, String, double) - Static method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.PromptScorer
 
create(String, String, double) - Static method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.TracePromptScorer
 
create(String, String, double, Map<String, Double>) - Static method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.PromptScorer
 
create(String, String, double, Map<String, Double>) - Static method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.TracePromptScorer
 
create(String, String, double, Map<String, Double>, String, String) - Static method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.PromptScorer
 
create(String, String, double, Map<String, Double>, String, String) - Static method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.TracePromptScorer
 
createDefault(String) - Static method in class com.judgmentlabs.judgeval.tracer.Tracer
 
createDefault(String) - Static method in class com.judgmentlabs.judgeval.tracer.TracerConfiguration
Creates a default configuration with the given project name.
createWithConfiguration(TracerConfiguration) - Static method in class com.judgmentlabs.judgeval.tracer.Tracer
 
critical(String) - Static method in class com.judgmentlabs.judgeval.utils.Logger
 
CRITICAL - Enum constant in enum class com.judgmentlabs.judgeval.utils.Logger.Level
 
CUSTOM - Enum constant in enum class com.judgmentlabs.judgeval.data.APIScorerType
 

D

dataObject(Example) - Method in class com.judgmentlabs.judgeval.data.ScoringResult.Builder
 
debug(String) - Static method in class com.judgmentlabs.judgeval.utils.Logger
 
DEBUG - Enum constant in enum class com.judgmentlabs.judgeval.utils.Logger.Level
 
DERAILMENT - Enum constant in enum class com.judgmentlabs.judgeval.data.APIScorerType
 
DerailmentScorer - Class in com.judgmentlabs.judgeval.scorers.api_scorers
 
DerailmentScorer() - Constructor for class com.judgmentlabs.judgeval.scorers.api_scorers.DerailmentScorer
 

E

enableEvaluation() - Method in class com.judgmentlabs.judgeval.tracer.TracerConfiguration
 
enableEvaluation(boolean) - Method in class com.judgmentlabs.judgeval.tracer.TracerConfiguration.Builder
 
endpoint(String) - Method in class com.judgmentlabs.judgeval.tracer.exporters.JudgmentSpanExporter.Builder
Sets the OTLP endpoint URL.
Env - Class in com.judgmentlabs.judgeval
 
equals(Object) - Method in class com.judgmentlabs.judgeval.data.ExampleEvaluationRun
 
equals(Object) - Method in class com.judgmentlabs.judgeval.data.TraceEvaluationRun
 
equals(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer
 
equals(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.EvalResults
 
equals(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.EvalResultsFetch
 
equals(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.Example
 
equals(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.ExampleEvaluationRun
 
equals(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.FetchPromptScorersRequest
 
equals(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.FetchPromptScorersResponse
 
equals(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
equals(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.PromptScorer
 
equals(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.ResolveProjectNameRequest
 
equals(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.ResolveProjectNameResponse
 
equals(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.SavePromptScorerRequest
 
equals(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.SavePromptScorerResponse
 
equals(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerConfig
 
equals(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerData
 
equals(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerExistsRequest
 
equals(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerExistsResponse
 
equals(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScoringResult
 
equals(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.TraceEvaluationRun
 
error(String) - Method in class com.judgmentlabs.judgeval.data.ScorerData.Builder
 
error(String) - Static method in class com.judgmentlabs.judgeval.utils.Logger
 
ERROR - Enum constant in enum class com.judgmentlabs.judgeval.utils.Logger.Level
 
evalName(String) - Method in class com.judgmentlabs.judgeval.data.ExampleEvaluationRun.Builder
 
evalName(String) - Method in class com.judgmentlabs.judgeval.data.TraceEvaluationRun.Builder
 
EvalResults - Class in com.judgmentlabs.judgeval.internal.api.models
 
EvalResults() - Constructor for class com.judgmentlabs.judgeval.internal.api.models.EvalResults
 
EvalResultsFetch - Class in com.judgmentlabs.judgeval.internal.api.models
 
EvalResultsFetch() - Constructor for class com.judgmentlabs.judgeval.internal.api.models.EvalResultsFetch
 
evaluationModel(String) - Method in class com.judgmentlabs.judgeval.data.ScorerData.Builder
 
example(Example) - Method in class com.judgmentlabs.judgeval.data.ExampleEvaluationRun.Builder
 
Example - Class in com.judgmentlabs.judgeval.data
 
Example - Class in com.judgmentlabs.judgeval.internal.api.models
 
Example() - Constructor for class com.judgmentlabs.judgeval.data.Example
 
Example() - Constructor for class com.judgmentlabs.judgeval.internal.api.models.Example
 
Example.Builder - Class in com.judgmentlabs.judgeval.data
 
ExampleEvaluationRun - Class in com.judgmentlabs.judgeval.data
 
ExampleEvaluationRun - Class in com.judgmentlabs.judgeval.internal.api.models
 
ExampleEvaluationRun() - Constructor for class com.judgmentlabs.judgeval.data.ExampleEvaluationRun
 
ExampleEvaluationRun() - Constructor for class com.judgmentlabs.judgeval.internal.api.models.ExampleEvaluationRun
 
ExampleEvaluationRun(String, String, List<Example>, List<ScorerConfig>, String, String) - Constructor for class com.judgmentlabs.judgeval.data.ExampleEvaluationRun
 
ExampleEvaluationRun.Builder - Class in com.judgmentlabs.judgeval.data
 
examples(List<Example>) - Method in class com.judgmentlabs.judgeval.data.ExampleEvaluationRun.Builder
 
EXECUTION_ORDER - Enum constant in enum class com.judgmentlabs.judgeval.data.APIScorerType
 
export(Collection<SpanData>) - Method in class com.judgmentlabs.judgeval.tracer.exporters.JudgmentSpanExporter
 
export(Collection<SpanData>) - Method in class com.judgmentlabs.judgeval.tracer.exporters.NoOpSpanExporter
 

F

FAITHFULNESS - Enum constant in enum class com.judgmentlabs.judgeval.data.APIScorerType
 
FaithfulnessScorer - Class in com.judgmentlabs.judgeval.scorers.api_scorers
 
FaithfulnessScorer() - Constructor for class com.judgmentlabs.judgeval.scorers.api_scorers.FaithfulnessScorer
 
fetchExperimentRun(EvalResultsFetch) - Method in class com.judgmentlabs.judgeval.internal.api.JudgmentAsyncClient
 
fetchExperimentRun(EvalResultsFetch) - Method in class com.judgmentlabs.judgeval.internal.api.JudgmentSyncClient
 
fetchPromptScorer(String, String, String) - Static method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.BasePromptScorer
 
FetchPromptScorersRequest - Class in com.judgmentlabs.judgeval.internal.api.models
 
FetchPromptScorersRequest() - Constructor for class com.judgmentlabs.judgeval.internal.api.models.FetchPromptScorersRequest
 
FetchPromptScorersResponse - Class in com.judgmentlabs.judgeval.internal.api.models
 
FetchPromptScorersResponse() - Constructor for class com.judgmentlabs.judgeval.internal.api.models.FetchPromptScorersResponse
 
fetchScorers(FetchPromptScorersRequest) - Method in class com.judgmentlabs.judgeval.internal.api.JudgmentAsyncClient
 
fetchScorers(FetchPromptScorersRequest) - Method in class com.judgmentlabs.judgeval.internal.api.JudgmentSyncClient
 
flush() - Method in class com.judgmentlabs.judgeval.tracer.exporters.JudgmentSpanExporter
 
flush() - Method in class com.judgmentlabs.judgeval.tracer.exporters.NoOpSpanExporter
 

G

get(String) - Static method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.PromptScorer
 
get(String) - Static method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.TracePromptScorer
 
get(String, String, String) - Static method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.PromptScorer
 
get(String, String, String) - Static method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.TracePromptScorer
 
getAdditionalMetadata() - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer
 
getAdditionalMetadata() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerData
 
getAdditionalProperties() - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer
 
getAdditionalProperties() - Method in class com.judgmentlabs.judgeval.internal.api.models.EvalResults
 
getAdditionalProperties() - Method in class com.judgmentlabs.judgeval.internal.api.models.EvalResultsFetch
 
getAdditionalProperties() - Method in class com.judgmentlabs.judgeval.internal.api.models.Example
 
getAdditionalProperties() - Method in class com.judgmentlabs.judgeval.internal.api.models.ExampleEvaluationRun
 
getAdditionalProperties() - Method in class com.judgmentlabs.judgeval.internal.api.models.FetchPromptScorersRequest
 
getAdditionalProperties() - Method in class com.judgmentlabs.judgeval.internal.api.models.FetchPromptScorersResponse
 
getAdditionalProperties() - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
getAdditionalProperties() - Method in class com.judgmentlabs.judgeval.internal.api.models.PromptScorer
 
getAdditionalProperties() - Method in class com.judgmentlabs.judgeval.internal.api.models.ResolveProjectNameRequest
 
getAdditionalProperties() - Method in class com.judgmentlabs.judgeval.internal.api.models.ResolveProjectNameResponse
 
getAdditionalProperties() - Method in class com.judgmentlabs.judgeval.internal.api.models.SavePromptScorerRequest
 
getAdditionalProperties() - Method in class com.judgmentlabs.judgeval.internal.api.models.SavePromptScorerResponse
 
getAdditionalProperties() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerConfig
 
getAdditionalProperties() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerData
 
getAdditionalProperties() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerExistsRequest
 
getAdditionalProperties() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerExistsResponse
 
getAdditionalProperties() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScoringResult
 
getAdditionalProperties() - Method in class com.judgmentlabs.judgeval.internal.api.models.TraceEvaluationRun
 
getAgentId() - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
getClassName() - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer
 
getColor() - Method in enum class com.judgmentlabs.judgeval.utils.Logger.Level
 
getConfig() - Method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.BasePromptScorer
 
getCreatedAt() - Method in class com.judgmentlabs.judgeval.internal.api.models.Example
 
getCreatedAt() - Method in class com.judgmentlabs.judgeval.internal.api.models.ExampleEvaluationRun
 
getCreatedAt() - Method in class com.judgmentlabs.judgeval.internal.api.models.PromptScorer
 
getCreatedAt() - Method in class com.judgmentlabs.judgeval.internal.api.models.TraceEvaluationRun
 
getCumulativeLlmCost() - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
getCustomScorers() - Method in class com.judgmentlabs.judgeval.internal.api.models.ExampleEvaluationRun
 
getCustomScorers() - Method in class com.judgmentlabs.judgeval.internal.api.models.TraceEvaluationRun
 
getDataObject() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScoringResult
 
getDetail() - Method in exception class com.judgmentlabs.judgeval.exceptions.JudgmentAPIError
 
getDuration() - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
getError() - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer
 
getError() - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
getError() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerData
 
getEvalName() - Method in class com.judgmentlabs.judgeval.internal.api.models.ExampleEvaluationRun
 
getEvalName() - Method in class com.judgmentlabs.judgeval.internal.api.models.TraceEvaluationRun
 
getEvaluationCost() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScoringResult
 
getEvaluationModel() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerData
 
getEvaluationStatus(String, String) - Method in class com.judgmentlabs.judgeval.internal.api.JudgmentAsyncClient
 
getEvaluationStatus(String, String) - Method in class com.judgmentlabs.judgeval.internal.api.JudgmentSyncClient
 
getEvents() - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
getExampleId() - Method in class com.judgmentlabs.judgeval.internal.api.models.Example
 
getExamples() - Method in class com.judgmentlabs.judgeval.internal.api.models.ExampleEvaluationRun
 
getExists() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerExistsResponse
 
getExperimentRunId() - Method in class com.judgmentlabs.judgeval.internal.api.models.EvalResultsFetch
 
getId() - Method in class com.judgmentlabs.judgeval.internal.api.models.ExampleEvaluationRun
 
getId() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerData
 
getId() - Method in class com.judgmentlabs.judgeval.internal.api.models.TraceEvaluationRun
 
getInputs() - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
getIsOffline() - Method in class com.judgmentlabs.judgeval.internal.api.models.TraceEvaluationRun
 
getIsTrace() - Method in class com.judgmentlabs.judgeval.internal.api.models.PromptScorer
 
getIsTrace() - Method in class com.judgmentlabs.judgeval.internal.api.models.SavePromptScorerRequest
 
getJudgmentScorers() - Method in class com.judgmentlabs.judgeval.internal.api.models.ExampleEvaluationRun
 
getJudgmentScorers() - Method in class com.judgmentlabs.judgeval.internal.api.models.TraceEvaluationRun
 
getKwargs() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerConfig
 
getLegacySpanId() - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
getLinks() - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
getMessage() - Method in class com.judgmentlabs.judgeval.internal.api.models.SavePromptScorerResponse
 
getModel() - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer
 
getModel() - Method in class com.judgmentlabs.judgeval.internal.api.models.ExampleEvaluationRun
 
getModel() - Method in class com.judgmentlabs.judgeval.internal.api.models.TraceEvaluationRun
 
getModelClient() - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer
 
getName() - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer
 
getName() - Method in class com.judgmentlabs.judgeval.internal.api.models.Example
 
getName() - Method in class com.judgmentlabs.judgeval.internal.api.models.PromptScorer
 
getName() - Method in class com.judgmentlabs.judgeval.internal.api.models.SavePromptScorerRequest
 
getName() - Method in class com.judgmentlabs.judgeval.internal.api.models.SavePromptScorerResponse
 
getName() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerConfig
 
getName() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerData
 
getName() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerExistsRequest
 
getName() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScoringResult
 
getName() - Method in class com.judgmentlabs.judgeval.scorers.APIScorer
 
getName() - Method in interface com.judgmentlabs.judgeval.scorers.BaseScorer
Gets the name of the scorer.
getNames() - Method in class com.judgmentlabs.judgeval.internal.api.models.FetchPromptScorersRequest
 
getOptions() - Method in class com.judgmentlabs.judgeval.internal.api.models.PromptScorer
 
getOptions() - Method in class com.judgmentlabs.judgeval.internal.api.models.SavePromptScorerRequest
 
getOptions() - Method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.BasePromptScorer
 
getOrganizationId() - Method in class com.judgmentlabs.judgeval.data.ExampleEvaluationRun
 
getOrganizationId() - Method in class com.judgmentlabs.judgeval.data.TraceEvaluationRun
 
getOrganizationId() - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
getOutput() - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
getParentSpanId() - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
getProjectId() - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
getProjectId() - Method in class com.judgmentlabs.judgeval.internal.api.models.ResolveProjectNameResponse
 
getProjectName() - Method in class com.judgmentlabs.judgeval.internal.api.models.EvalResultsFetch
 
getProjectName() - Method in class com.judgmentlabs.judgeval.internal.api.models.ExampleEvaluationRun
 
getProjectName() - Method in class com.judgmentlabs.judgeval.internal.api.models.ResolveProjectNameRequest
 
getProjectName() - Method in class com.judgmentlabs.judgeval.internal.api.models.TraceEvaluationRun
 
getPrompt() - Method in class com.judgmentlabs.judgeval.internal.api.models.PromptScorer
 
getPrompt() - Method in class com.judgmentlabs.judgeval.internal.api.models.SavePromptScorerRequest
 
getPrompt() - Method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.BasePromptScorer
 
getReason() - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer
 
getReason() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerData
 
getRequiredParams() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerConfig
 
getRequiredParams() - Method in class com.judgmentlabs.judgeval.scorers.APIScorer
 
getResourceAttributes() - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
getResults() - Method in class com.judgmentlabs.judgeval.internal.api.models.EvalResults
 
getRun() - Method in class com.judgmentlabs.judgeval.internal.api.models.EvalResults
 
getRunDuration() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScoringResult
 
getScore() - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer
 
getScore() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerData
 
getScoreBreakdown() - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer
 
getScorerConfig() - Method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.PromptScorer
 
getScorerConfig() - Method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.TracePromptScorer
 
getScorerConfig() - Method in class com.judgmentlabs.judgeval.scorers.APIScorer
 
getScorerConfig() - Method in interface com.judgmentlabs.judgeval.scorers.BaseScorer
Gets the scorer configuration for evaluation runs.
getScorerName() - Method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.BasePromptScorer
 
getScorers() - Method in class com.judgmentlabs.judgeval.internal.api.models.FetchPromptScorersResponse
 
getScorersData() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScoringResult
 
getScoreType() - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer
 
getScoreType() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerConfig
 
getScoreType() - Method in class com.judgmentlabs.judgeval.scorers.APIScorer
 
getServerHosted() - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer
 
getServiceName() - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
getSpanAttributes() - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
getSpanExporter() - Method in class com.judgmentlabs.judgeval.tracer.BaseTracer
Gets the SpanExporter for OpenTelemetry integration.
getSpanId() - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
getSpanKind() - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
getSpanName() - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
getStateAfter() - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
getStateBefore() - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
getStatusCode() - Method in exception class com.judgmentlabs.judgeval.exceptions.JudgmentAPIError
 
getStatusCode() - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
getStatusMessage() - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
getStrictMode() - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer
 
getStrictMode() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerConfig
 
getStrictMode() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerData
 
getStrictMode() - Method in class com.judgmentlabs.judgeval.scorers.APIScorer
 
getSuccess() - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer
 
getSuccess() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerData
 
getSuccess() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScoringResult
 
getThreshold() - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer
 
getThreshold() - Method in class com.judgmentlabs.judgeval.internal.api.models.PromptScorer
 
getThreshold() - Method in class com.judgmentlabs.judgeval.internal.api.models.SavePromptScorerRequest
 
getThreshold() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerConfig
 
getThreshold() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerData
 
getThreshold() - Method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.BasePromptScorer
 
getThreshold() - Method in class com.judgmentlabs.judgeval.scorers.APIScorer
 
getTimestamp() - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
getTraceAndSpanIds() - Method in class com.judgmentlabs.judgeval.internal.api.models.TraceEvaluationRun
 
getTraceId() - Method in class com.judgmentlabs.judgeval.internal.api.models.ExampleEvaluationRun
 
getTraceId() - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
getTraceId() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScoringResult
 
getTracer() - Method in class com.judgmentlabs.judgeval.tracer.BaseTracer
Gets the OpenTelemetry tracer instance.
getTraceSpanId() - Method in class com.judgmentlabs.judgeval.internal.api.models.ExampleEvaluationRun
 
getTraceState() - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
getUpdatedAt() - Method in class com.judgmentlabs.judgeval.internal.api.models.PromptScorer
 
getUser() - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer
 
getUserId() - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
getUsingNativeModel() - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer
 
getValue() - Method in enum class com.judgmentlabs.judgeval.data.APIScorerType
 
getValue() - Method in enum class com.judgmentlabs.judgeval.utils.Logger.Level
 
getVersion() - Static method in class com.judgmentlabs.judgeval.Version
Gets the current SDK version.
GsonSerializer() - Constructor for class com.judgmentlabs.judgeval.tracer.BaseTracer.GsonSerializer
 

H

hashCode() - Method in class com.judgmentlabs.judgeval.data.ExampleEvaluationRun
 
hashCode() - Method in class com.judgmentlabs.judgeval.data.TraceEvaluationRun
 
hashCode() - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer
 
hashCode() - Method in class com.judgmentlabs.judgeval.internal.api.models.EvalResults
 
hashCode() - Method in class com.judgmentlabs.judgeval.internal.api.models.EvalResultsFetch
 
hashCode() - Method in class com.judgmentlabs.judgeval.internal.api.models.Example
 
hashCode() - Method in class com.judgmentlabs.judgeval.internal.api.models.ExampleEvaluationRun
 
hashCode() - Method in class com.judgmentlabs.judgeval.internal.api.models.FetchPromptScorersRequest
 
hashCode() - Method in class com.judgmentlabs.judgeval.internal.api.models.FetchPromptScorersResponse
 
hashCode() - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
hashCode() - Method in class com.judgmentlabs.judgeval.internal.api.models.PromptScorer
 
hashCode() - Method in class com.judgmentlabs.judgeval.internal.api.models.ResolveProjectNameRequest
 
hashCode() - Method in class com.judgmentlabs.judgeval.internal.api.models.ResolveProjectNameResponse
 
hashCode() - Method in class com.judgmentlabs.judgeval.internal.api.models.SavePromptScorerRequest
 
hashCode() - Method in class com.judgmentlabs.judgeval.internal.api.models.SavePromptScorerResponse
 
hashCode() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerConfig
 
hashCode() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerData
 
hashCode() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerExistsRequest
 
hashCode() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerExistsResponse
 
hashCode() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScoringResult
 
hashCode() - Method in class com.judgmentlabs.judgeval.internal.api.models.TraceEvaluationRun
 

I

info(String) - Static method in class com.judgmentlabs.judgeval.utils.Logger
 
INFO - Enum constant in enum class com.judgmentlabs.judgeval.utils.Logger.Level
 
initialize() - Method in class com.judgmentlabs.judgeval.tracer.BaseTracer
 
initialize() - Method in class com.judgmentlabs.judgeval.tracer.Tracer
Initializes the OpenTelemetry SDK with batch span processor and registers it globally.
initialize(boolean) - Method in class com.judgmentlabs.judgeval.tracer.Tracer.TracerBuilder
 
INSTRUCTION_ADHERENCE - Enum constant in enum class com.judgmentlabs.judgeval.data.APIScorerType
 
InstructionAdherenceScorer - Class in com.judgmentlabs.judgeval.scorers.api_scorers
 
InstructionAdherenceScorer() - Constructor for class com.judgmentlabs.judgeval.scorers.api_scorers.InstructionAdherenceScorer
 
ISerializer - Interface in com.judgmentlabs.judgeval.tracer
 
isTrace() - Method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.BasePromptScorer
 
isTrace() - Method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.PromptScorer
 
isTrace() - Method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.TracePromptScorer
 

J

jacksonMapper - Variable in class com.judgmentlabs.judgeval.tracer.BaseTracer
 
JUDGMENT_AGENT_CLASS_NAME - Static variable in class com.judgmentlabs.judgeval.tracer.OpenTelemetryKeys.AttributeKeys
 
JUDGMENT_AGENT_ID - Static variable in class com.judgmentlabs.judgeval.tracer.OpenTelemetryKeys.AttributeKeys
 
JUDGMENT_AGENT_INSTANCE_NAME - Static variable in class com.judgmentlabs.judgeval.tracer.OpenTelemetryKeys.AttributeKeys
 
JUDGMENT_API_KEY - Static variable in class com.judgmentlabs.judgeval.Env
 
JUDGMENT_API_URL - Static variable in class com.judgmentlabs.judgeval.Env
 
JUDGMENT_CUMULATIVE_LLM_COST - Static variable in class com.judgmentlabs.judgeval.tracer.OpenTelemetryKeys.AttributeKeys
 
JUDGMENT_CUSTOMER_ID - Static variable in class com.judgmentlabs.judgeval.tracer.OpenTelemetryKeys.AttributeKeys
 
JUDGMENT_DEFAULT_GPT_MODEL - Static variable in class com.judgmentlabs.judgeval.Env
 
JUDGMENT_INPUT - Static variable in class com.judgmentlabs.judgeval.tracer.OpenTelemetryKeys.AttributeKeys
 
JUDGMENT_IS_AGENT_ENTRY_POINT - Static variable in class com.judgmentlabs.judgeval.tracer.OpenTelemetryKeys.AttributeKeys
 
JUDGMENT_LOG_LEVEL - Static variable in class com.judgmentlabs.judgeval.Env
 
JUDGMENT_NO_COLOR - Static variable in class com.judgmentlabs.judgeval.Env
 
JUDGMENT_OFFLINE_MODE - Static variable in class com.judgmentlabs.judgeval.tracer.OpenTelemetryKeys.AttributeKeys
 
JUDGMENT_ORG_ID - Static variable in class com.judgmentlabs.judgeval.Env
 
JUDGMENT_OUTPUT - Static variable in class com.judgmentlabs.judgeval.tracer.OpenTelemetryKeys.AttributeKeys
 
JUDGMENT_PARENT_AGENT_ID - Static variable in class com.judgmentlabs.judgeval.tracer.OpenTelemetryKeys.AttributeKeys
 
JUDGMENT_PROJECT_ID - Static variable in class com.judgmentlabs.judgeval.tracer.OpenTelemetryKeys.ResourceKeys
 
JUDGMENT_SPAN_KIND - Static variable in class com.judgmentlabs.judgeval.tracer.OpenTelemetryKeys.AttributeKeys
 
JUDGMENT_STATE_AFTER - Static variable in class com.judgmentlabs.judgeval.tracer.OpenTelemetryKeys.AttributeKeys
 
JUDGMENT_STATE_BEFORE - Static variable in class com.judgmentlabs.judgeval.tracer.OpenTelemetryKeys.AttributeKeys
 
JUDGMENT_UPDATE_ID - Static variable in class com.judgmentlabs.judgeval.tracer.OpenTelemetryKeys.AttributeKeys
 
JudgmentAPIError - Exception Class in com.judgmentlabs.judgeval.exceptions
 
JudgmentAPIError(int, String) - Constructor for exception class com.judgmentlabs.judgeval.exceptions.JudgmentAPIError
 
judgmentApiKey - Variable in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.BasePromptScorer
 
judgmentApiKey(String) - Method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.PromptScorer.Builder
 
judgmentApiKey(String) - Method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.TracePromptScorer.Builder
 
JudgmentAsyncClient - Class in com.judgmentlabs.judgeval.internal.api
 
JudgmentAsyncClient(String, String, String) - Constructor for class com.judgmentlabs.judgeval.internal.api.JudgmentAsyncClient
 
JudgmentRuntimeError - Exception Class in com.judgmentlabs.judgeval.exceptions
 
JudgmentRuntimeError(String) - Constructor for exception class com.judgmentlabs.judgeval.exceptions.JudgmentRuntimeError
 
JudgmentRuntimeError(String, Throwable) - Constructor for exception class com.judgmentlabs.judgeval.exceptions.JudgmentRuntimeError
 
JudgmentSpanExporter - Class in com.judgmentlabs.judgeval.tracer.exporters
SpanExporter implementation that sends spans to Judgment Labs with project identification.
JudgmentSpanExporter(String, String, String, String) - Constructor for class com.judgmentlabs.judgeval.tracer.exporters.JudgmentSpanExporter
Creates a new JudgmentSpanExporter with the specified configuration.
JudgmentSpanExporter.Builder - Class in com.judgmentlabs.judgeval.tracer.exporters
Builder for creating JudgmentSpanExporter instances.
JudgmentSyncClient - Class in com.judgmentlabs.judgeval.internal.api
 
JudgmentSyncClient(String, String, String) - Constructor for class com.judgmentlabs.judgeval.internal.api.JudgmentSyncClient
 
JudgmentTestError - Exception Class in com.judgmentlabs.judgeval.exceptions
 
JudgmentTestError(String) - Constructor for exception class com.judgmentlabs.judgeval.exceptions.JudgmentTestError
 
JudgmentTestError(String, Throwable) - Constructor for exception class com.judgmentlabs.judgeval.exceptions.JudgmentTestError
 

L

logEvalResults(EvalResults) - Method in class com.judgmentlabs.judgeval.internal.api.JudgmentAsyncClient
 
logEvalResults(EvalResults) - Method in class com.judgmentlabs.judgeval.internal.api.JudgmentSyncClient
 
Logger - Class in com.judgmentlabs.judgeval.utils
 
Logger() - Constructor for class com.judgmentlabs.judgeval.utils.Logger
 
Logger.Level - Enum Class in com.judgmentlabs.judgeval.utils
 

M

metadata(String, Object) - Method in class com.judgmentlabs.judgeval.data.ScorerData.Builder
 
model(String) - Method in class com.judgmentlabs.judgeval.data.ExampleEvaluationRun.Builder
 
model(String) - Method in class com.judgmentlabs.judgeval.data.TraceEvaluationRun.Builder
 
model(String) - Method in class com.judgmentlabs.judgeval.scorers.APIScorer.Builder
 

N

name(String) - Method in class com.judgmentlabs.judgeval.data.Example.Builder
 
name(String) - Method in class com.judgmentlabs.judgeval.data.ScorerData.Builder
 
name(String) - Method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.PromptScorer.Builder
 
name(String) - Method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.TracePromptScorer.Builder
 
name(String) - Method in class com.judgmentlabs.judgeval.scorers.APIScorer.Builder
 
NoOpSpanExporter - Class in com.judgmentlabs.judgeval.tracer.exporters
 
NoOpSpanExporter() - Constructor for class com.judgmentlabs.judgeval.tracer.exporters.NoOpSpanExporter
 

O

OpenTelemetryKeys - Class in com.judgmentlabs.judgeval.tracer
 
OpenTelemetryKeys.AttributeKeys - Class in com.judgmentlabs.judgeval.tracer
 
OpenTelemetryKeys.ResourceKeys - Class in com.judgmentlabs.judgeval.tracer
 
option(String, Double) - Method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.PromptScorer.Builder
 
option(String, Double) - Method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.TracePromptScorer.Builder
 
options - Variable in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.BasePromptScorer
 
options(Map<String, Double>) - Method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.PromptScorer.Builder
 
options(Map<String, Double>) - Method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.TracePromptScorer.Builder
 
organizationId - Variable in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.BasePromptScorer
 
organizationId() - Method in class com.judgmentlabs.judgeval.tracer.TracerConfiguration
 
organizationId(String) - Method in class com.judgmentlabs.judgeval.data.ExampleEvaluationRun.Builder
 
organizationId(String) - Method in class com.judgmentlabs.judgeval.data.TraceEvaluationRun.Builder
 
organizationId(String) - Method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.PromptScorer.Builder
 
organizationId(String) - Method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.TracePromptScorer.Builder
 
organizationId(String) - Method in class com.judgmentlabs.judgeval.tracer.exporters.JudgmentSpanExporter.Builder
Sets the organization ID.
organizationId(String) - Method in class com.judgmentlabs.judgeval.tracer.TracerConfiguration.Builder
 
OtelTraceSpan - Class in com.judgmentlabs.judgeval.internal.api.models
 
OtelTraceSpan() - Constructor for class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 

P

PENDING_TRACE_EVAL - Static variable in class com.judgmentlabs.judgeval.tracer.OpenTelemetryKeys.AttributeKeys
 
projectId - Variable in class com.judgmentlabs.judgeval.tracer.BaseTracer
 
projectId(String) - Method in class com.judgmentlabs.judgeval.tracer.exporters.JudgmentSpanExporter.Builder
Sets the project ID.
projectName() - Method in class com.judgmentlabs.judgeval.tracer.TracerConfiguration
 
projectName(String) - Method in class com.judgmentlabs.judgeval.data.ExampleEvaluationRun.Builder
 
projectName(String) - Method in class com.judgmentlabs.judgeval.data.TraceEvaluationRun.Builder
 
projectName(String) - Method in class com.judgmentlabs.judgeval.tracer.TracerConfiguration.Builder
 
projectsResolve(ResolveProjectNameRequest) - Method in class com.judgmentlabs.judgeval.internal.api.JudgmentAsyncClient
 
projectsResolve(ResolveProjectNameRequest) - Method in class com.judgmentlabs.judgeval.internal.api.JudgmentSyncClient
 
prompt - Variable in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.BasePromptScorer
 
prompt(String) - Method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.PromptScorer.Builder
 
prompt(String) - Method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.TracePromptScorer.Builder
 
PROMPT_SCORER - Enum constant in enum class com.judgmentlabs.judgeval.data.APIScorerType
 
PromptScorer - Class in com.judgmentlabs.judgeval.internal.api.models
 
PromptScorer - Class in com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer
 
PromptScorer() - Constructor for class com.judgmentlabs.judgeval.internal.api.models.PromptScorer
 
PromptScorer(String, String, double, Map<String, Double>) - Constructor for class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.PromptScorer
 
PromptScorer(String, String, double, Map<String, Double>, String, String) - Constructor for class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.PromptScorer
 
PromptScorer.Builder - Class in com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer
 
property(String, Object) - Method in class com.judgmentlabs.judgeval.data.Example.Builder
 
pushPromptScorer() - Method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.BasePromptScorer
 
pushPromptScorer(String, String, double, Map<String, Double>, String, String, Boolean) - Static method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.BasePromptScorer
 

R

reason(String) - Method in class com.judgmentlabs.judgeval.data.ScorerData.Builder
 
requiredParams(List<String>) - Method in class com.judgmentlabs.judgeval.scorers.APIScorer.Builder
 
resolveProjectId(String) - Method in class com.judgmentlabs.judgeval.tracer.BaseTracer
 
ResolveProjectNameRequest - Class in com.judgmentlabs.judgeval.internal.api.models
 
ResolveProjectNameRequest() - Constructor for class com.judgmentlabs.judgeval.internal.api.models.ResolveProjectNameRequest
 
ResolveProjectNameResponse - Class in com.judgmentlabs.judgeval.internal.api.models
 
ResolveProjectNameResponse() - Constructor for class com.judgmentlabs.judgeval.internal.api.models.ResolveProjectNameResponse
 

S

SavePromptScorerRequest - Class in com.judgmentlabs.judgeval.internal.api.models
 
SavePromptScorerRequest() - Constructor for class com.judgmentlabs.judgeval.internal.api.models.SavePromptScorerRequest
 
SavePromptScorerResponse - Class in com.judgmentlabs.judgeval.internal.api.models
 
SavePromptScorerResponse() - Constructor for class com.judgmentlabs.judgeval.internal.api.models.SavePromptScorerResponse
 
saveScorer(SavePromptScorerRequest) - Method in class com.judgmentlabs.judgeval.internal.api.JudgmentAsyncClient
 
saveScorer(SavePromptScorerRequest) - Method in class com.judgmentlabs.judgeval.internal.api.JudgmentSyncClient
 
score(Double) - Method in class com.judgmentlabs.judgeval.data.ScorerData.Builder
 
scorer(ScorerConfig) - Method in class com.judgmentlabs.judgeval.data.ExampleEvaluationRun.Builder
 
scorer(ScorerConfig) - Method in class com.judgmentlabs.judgeval.data.TraceEvaluationRun.Builder
 
ScorerConfig - Class in com.judgmentlabs.judgeval.internal.api.models
 
ScorerConfig() - Constructor for class com.judgmentlabs.judgeval.internal.api.models.ScorerConfig
 
scorerData(ScorerData) - Method in class com.judgmentlabs.judgeval.data.ScoringResult.Builder
 
ScorerData - Class in com.judgmentlabs.judgeval.data
 
ScorerData - Class in com.judgmentlabs.judgeval.internal.api.models
 
ScorerData() - Constructor for class com.judgmentlabs.judgeval.data.ScorerData
 
ScorerData() - Constructor for class com.judgmentlabs.judgeval.internal.api.models.ScorerData
 
ScorerData.Builder - Class in com.judgmentlabs.judgeval.data
 
scorerExists(ScorerExistsRequest) - Method in class com.judgmentlabs.judgeval.internal.api.JudgmentAsyncClient
 
scorerExists(ScorerExistsRequest) - Method in class com.judgmentlabs.judgeval.internal.api.JudgmentSyncClient
 
scorerExists(String, String, String) - Static method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.BasePromptScorer
 
ScorerExistsRequest - Class in com.judgmentlabs.judgeval.internal.api.models
 
ScorerExistsRequest() - Constructor for class com.judgmentlabs.judgeval.internal.api.models.ScorerExistsRequest
 
ScorerExistsResponse - Class in com.judgmentlabs.judgeval.internal.api.models
 
ScorerExistsResponse() - Constructor for class com.judgmentlabs.judgeval.internal.api.models.ScorerExistsResponse
 
scorers(List<ScorerConfig>) - Method in class com.judgmentlabs.judgeval.data.ExampleEvaluationRun.Builder
 
scorers(List<ScorerConfig>) - Method in class com.judgmentlabs.judgeval.data.TraceEvaluationRun.Builder
 
scorersData(List<ScorerData>) - Method in class com.judgmentlabs.judgeval.data.ScoringResult.Builder
 
ScoringResult - Class in com.judgmentlabs.judgeval.data
 
ScoringResult - Class in com.judgmentlabs.judgeval.internal.api.models
 
ScoringResult() - Constructor for class com.judgmentlabs.judgeval.data.ScoringResult
 
ScoringResult() - Constructor for class com.judgmentlabs.judgeval.internal.api.models.ScoringResult
 
ScoringResult.Builder - Class in com.judgmentlabs.judgeval.data
 
serialize(Object) - Method in class com.judgmentlabs.judgeval.tracer.BaseTracer.GsonSerializer
 
serialize(Object) - Method in interface com.judgmentlabs.judgeval.tracer.ISerializer
 
serialize(Object, Type) - Method in class com.judgmentlabs.judgeval.tracer.BaseTracer.GsonSerializer
 
serialize(Object, Type) - Method in interface com.judgmentlabs.judgeval.tracer.ISerializer
 
serializer - Variable in class com.judgmentlabs.judgeval.tracer.BaseTracer
 
serializer(ISerializer) - Method in class com.judgmentlabs.judgeval.tracer.Tracer.TracerBuilder
 
SERVICE_NAME - Static variable in class com.judgmentlabs.judgeval.tracer.OpenTelemetryKeys.ResourceKeys
 
setAdditionalMetadata(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer
 
setAdditionalMetadata(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerData
 
setAdditionalProperty(String, Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer
 
setAdditionalProperty(String, Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.EvalResults
 
setAdditionalProperty(String, Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.EvalResultsFetch
 
setAdditionalProperty(String, Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.Example
 
setAdditionalProperty(String, Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.ExampleEvaluationRun
 
setAdditionalProperty(String, Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.FetchPromptScorersRequest
 
setAdditionalProperty(String, Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.FetchPromptScorersResponse
 
setAdditionalProperty(String, Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
setAdditionalProperty(String, Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.PromptScorer
 
setAdditionalProperty(String, Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.ResolveProjectNameRequest
 
setAdditionalProperty(String, Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.ResolveProjectNameResponse
 
setAdditionalProperty(String, Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.SavePromptScorerRequest
 
setAdditionalProperty(String, Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.SavePromptScorerResponse
 
setAdditionalProperty(String, Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerConfig
 
setAdditionalProperty(String, Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerData
 
setAdditionalProperty(String, Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerExistsRequest
 
setAdditionalProperty(String, Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerExistsResponse
 
setAdditionalProperty(String, Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScoringResult
 
setAdditionalProperty(String, Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.TraceEvaluationRun
 
setAgentId(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
setAttribute(String, Object) - Method in class com.judgmentlabs.judgeval.tracer.BaseTracer
Sets a custom attribute on the current span.
setAttribute(String, Object, Type) - Method in class com.judgmentlabs.judgeval.tracer.BaseTracer
Sets a custom attribute on the current span with specific type for JSON serialization.
setAttributes(Map<String, Object>) - Method in class com.judgmentlabs.judgeval.tracer.BaseTracer
 
setClassName(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer
 
setCreatedAt(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.Example
 
setCreatedAt(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.ExampleEvaluationRun
 
setCreatedAt(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.PromptScorer
 
setCreatedAt(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.TraceEvaluationRun
 
setCumulativeLlmCost(Double) - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
setCustomScorers(List<BaseScorer>) - Method in class com.judgmentlabs.judgeval.internal.api.models.ExampleEvaluationRun
 
setCustomScorers(List<BaseScorer>) - Method in class com.judgmentlabs.judgeval.internal.api.models.TraceEvaluationRun
 
setDataObject(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScoringResult
 
setDuration(Integer) - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
setError(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
setError(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer
 
setError(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerData
 
setEvalName(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.ExampleEvaluationRun
 
setEvalName(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.TraceEvaluationRun
 
setEvaluationCost(Double) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScoringResult
 
setEvaluationModel(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerData
 
setEvents(List<Object>) - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
setExampleId(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.Example
 
setExamples(List<Example>) - Method in class com.judgmentlabs.judgeval.internal.api.models.ExampleEvaluationRun
 
setExists(Boolean) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerExistsResponse
 
setExperimentRunId(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.EvalResultsFetch
 
setGeneralSpan() - Method in class com.judgmentlabs.judgeval.tracer.BaseTracer
 
setId(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.ExampleEvaluationRun
 
setId(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerData
 
setId(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.TraceEvaluationRun
 
setInput(Object) - Method in class com.judgmentlabs.judgeval.tracer.BaseTracer
 
setInput(Object, Type) - Method in class com.judgmentlabs.judgeval.tracer.BaseTracer
 
setInputs(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
setIsOffline(Boolean) - Method in class com.judgmentlabs.judgeval.internal.api.models.TraceEvaluationRun
 
setIsTrace(Boolean) - Method in class com.judgmentlabs.judgeval.internal.api.models.PromptScorer
 
setIsTrace(Boolean) - Method in class com.judgmentlabs.judgeval.internal.api.models.SavePromptScorerRequest
 
setJudgmentScorers(List<ScorerConfig>) - Method in class com.judgmentlabs.judgeval.internal.api.models.ExampleEvaluationRun
 
setJudgmentScorers(List<ScorerConfig>) - Method in class com.judgmentlabs.judgeval.internal.api.models.TraceEvaluationRun
 
setKwargs(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerConfig
 
setLegacySpanId(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
setLevel(Logger.Level) - Static method in class com.judgmentlabs.judgeval.utils.Logger
 
setLinks(List<Object>) - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
setLLMSpan() - Method in class com.judgmentlabs.judgeval.tracer.BaseTracer
 
setMessage(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.SavePromptScorerResponse
 
setModel(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer
 
setModel(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.ExampleEvaluationRun
 
setModel(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.TraceEvaluationRun
 
setModelClient(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer
 
setName(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer
 
setName(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.Example
 
setName(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.PromptScorer
 
setName(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.SavePromptScorerRequest
 
setName(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.SavePromptScorerResponse
 
setName(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerConfig
 
setName(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerData
 
setName(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerExistsRequest
 
setName(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScoringResult
 
setNames(List<String>) - Method in class com.judgmentlabs.judgeval.internal.api.models.FetchPromptScorersRequest
 
setOptions(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.PromptScorer
 
setOptions(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.SavePromptScorerRequest
 
setOptions(Map<String, Double>) - Method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.BasePromptScorer
 
setOrganizationId(String) - Method in class com.judgmentlabs.judgeval.data.ExampleEvaluationRun
 
setOrganizationId(String) - Method in class com.judgmentlabs.judgeval.data.TraceEvaluationRun
 
setOrganizationId(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
setOutput(PrintStream) - Static method in class com.judgmentlabs.judgeval.utils.Logger
 
setOutput(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
setOutput(Object) - Method in class com.judgmentlabs.judgeval.tracer.BaseTracer
 
setOutput(Object, Type) - Method in class com.judgmentlabs.judgeval.tracer.BaseTracer
 
setParentSpanId(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
setProjectId(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
setProjectId(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.ResolveProjectNameResponse
 
setProjectName(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.EvalResultsFetch
 
setProjectName(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.ExampleEvaluationRun
 
setProjectName(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.ResolveProjectNameRequest
 
setProjectName(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.TraceEvaluationRun
 
setPrompt(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.PromptScorer
 
setPrompt(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.SavePromptScorerRequest
 
setPrompt(String) - Method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.BasePromptScorer
 
setReason(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer
 
setReason(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerData
 
setRequiredParams(List<String>) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerConfig
 
setRequiredParams(List<String>) - Method in class com.judgmentlabs.judgeval.scorers.APIScorer
 
setResourceAttributes(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
setResults(List<ScoringResult>) - Method in class com.judgmentlabs.judgeval.internal.api.models.EvalResults
 
setRun(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.EvalResults
 
setRunDuration(Double) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScoringResult
 
setScore(Double) - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer
 
setScore(Double) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerData
 
setScoreBreakdown(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer
 
setScorers(List<PromptScorer>) - Method in class com.judgmentlabs.judgeval.internal.api.models.FetchPromptScorersResponse
 
setScorersData(List<ScorerData>) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScoringResult
 
setScoreType(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer
 
setScoreType(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerConfig
 
setServerHosted(Boolean) - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer
 
setServiceName(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
setSpanAttributes(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
setSpanId(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
setSpanKind(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
setSpanKind(String) - Method in class com.judgmentlabs.judgeval.tracer.BaseTracer
Sets the span kind attribute on the current span.
setSpanName(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
setStateAfter(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
setStateBefore(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
setStatusCode(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
setStatusMessage(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
setStrictMode(Boolean) - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer
 
setStrictMode(Boolean) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerConfig
 
setStrictMode(Boolean) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerData
 
setSuccess(Boolean) - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer
 
setSuccess(Boolean) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerData
 
setSuccess(Boolean) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScoringResult
 
setThreshold(double) - Method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.BasePromptScorer
 
setThreshold(double) - Method in class com.judgmentlabs.judgeval.scorers.APIScorer
 
setThreshold(Double) - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer
 
setThreshold(Double) - Method in class com.judgmentlabs.judgeval.internal.api.models.PromptScorer
 
setThreshold(Double) - Method in class com.judgmentlabs.judgeval.internal.api.models.SavePromptScorerRequest
 
setThreshold(Double) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerConfig
 
setThreshold(Double) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerData
 
setTimestamp(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
setToolSpan() - Method in class com.judgmentlabs.judgeval.tracer.BaseTracer
 
setTraceAndSpanIds(List<List<Object>>) - Method in class com.judgmentlabs.judgeval.internal.api.models.TraceEvaluationRun
 
setTraceId(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.ExampleEvaluationRun
 
setTraceId(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
setTraceId(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScoringResult
 
setTraceSpanId(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.ExampleEvaluationRun
 
setTraceState(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
setUpdatedAt(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.PromptScorer
 
setUseColor(boolean) - Static method in class com.judgmentlabs.judgeval.utils.Logger
 
setUser(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer
 
setUserId(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan
 
setUsingNativeModel(Boolean) - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer
 
shutdown() - Method in class com.judgmentlabs.judgeval.tracer.exporters.JudgmentSpanExporter
 
shutdown() - Method in class com.judgmentlabs.judgeval.tracer.exporters.NoOpSpanExporter
 
span(String) - Static method in class com.judgmentlabs.judgeval.tracer.BaseTracer
Creates a new span with the given name.
span(String, Runnable) - Method in class com.judgmentlabs.judgeval.tracer.BaseTracer
Creates a new span with the given name and executes the provided runnable within its scope.
span(String, Callable<T>) - Method in class com.judgmentlabs.judgeval.tracer.BaseTracer
Creates a new span with the given name and executes the provided callable within its scope.
strictMode(boolean) - Method in class com.judgmentlabs.judgeval.scorers.APIScorer.Builder
 
strictMode(Boolean) - Method in class com.judgmentlabs.judgeval.data.ScorerData.Builder
 
success(Boolean) - Method in class com.judgmentlabs.judgeval.data.ScorerData.Builder
 
success(Boolean) - Method in class com.judgmentlabs.judgeval.data.ScoringResult.Builder
 

T

TELEMETRY_SDK_LANGUAGE - Static variable in class com.judgmentlabs.judgeval.tracer.OpenTelemetryKeys.ResourceKeys
 
TELEMETRY_SDK_NAME - Static variable in class com.judgmentlabs.judgeval.tracer.OpenTelemetryKeys.ResourceKeys
 
TELEMETRY_SDK_VERSION - Static variable in class com.judgmentlabs.judgeval.tracer.OpenTelemetryKeys.ResourceKeys
 
threshold(double) - Method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.PromptScorer.Builder
 
threshold(double) - Method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.TracePromptScorer.Builder
 
threshold(double) - Method in class com.judgmentlabs.judgeval.scorers.APIScorer.Builder
 
threshold(Double) - Method in class com.judgmentlabs.judgeval.data.ScorerData.Builder
 
TOOL_DEPENDENCY - Enum constant in enum class com.judgmentlabs.judgeval.data.APIScorerType
 
TOOL_ORDER - Enum constant in enum class com.judgmentlabs.judgeval.data.APIScorerType
 
toString() - Method in enum class com.judgmentlabs.judgeval.data.APIScorerType
 
toString() - Method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.BasePromptScorer
 
TRACE_PROMPT_SCORER - Enum constant in enum class com.judgmentlabs.judgeval.data.APIScorerType
 
traceAndSpanId(String, String) - Method in class com.judgmentlabs.judgeval.data.TraceEvaluationRun.Builder
 
traceAndSpanIds(List<List<String>>) - Method in class com.judgmentlabs.judgeval.data.TraceEvaluationRun.Builder
 
TraceEvaluationRun - Class in com.judgmentlabs.judgeval.data
 
TraceEvaluationRun - Class in com.judgmentlabs.judgeval.internal.api.models
 
TraceEvaluationRun() - Constructor for class com.judgmentlabs.judgeval.data.TraceEvaluationRun
 
TraceEvaluationRun() - Constructor for class com.judgmentlabs.judgeval.internal.api.models.TraceEvaluationRun
 
TraceEvaluationRun(String, String, List<ScorerConfig>, String, String, List<List<String>>) - Constructor for class com.judgmentlabs.judgeval.data.TraceEvaluationRun
 
TraceEvaluationRun.Builder - Class in com.judgmentlabs.judgeval.data
 
TracePromptScorer - Class in com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer
 
TracePromptScorer(String, String, double, Map<String, Double>) - Constructor for class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.TracePromptScorer
 
TracePromptScorer(String, String, double, Map<String, Double>, String, String) - Constructor for class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.TracePromptScorer
 
TracePromptScorer.Builder - Class in com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer
 
Tracer - Class in com.judgmentlabs.judgeval.tracer
Main tracer for Judgment Labs distributed tracing and evaluation.
TRACER_NAME - Static variable in class com.judgmentlabs.judgeval.tracer.BaseTracer
 
Tracer.TracerBuilder - Class in com.judgmentlabs.judgeval.tracer
Builder for creating Tracer instances.
TracerBuilder() - Constructor for class com.judgmentlabs.judgeval.tracer.Tracer.TracerBuilder
 
TracerConfiguration - Class in com.judgmentlabs.judgeval.tracer
Configuration for the Judgment Tracer that controls how tracing and evaluation behave.
TracerConfiguration.Builder - Class in com.judgmentlabs.judgeval.tracer
Builder for creating TracerConfiguration instances.

V

valueOf(String) - Static method in enum class com.judgmentlabs.judgeval.data.APIScorerType
Returns the enum constant of this class with the specified name.
valueOf(String) - Static method in enum class com.judgmentlabs.judgeval.utils.Logger.Level
Returns the enum constant of this class with the specified name.
values() - Static method in enum class com.judgmentlabs.judgeval.data.APIScorerType
Returns an array containing the constants of this enum class, in the order they are declared.
values() - Static method in enum class com.judgmentlabs.judgeval.utils.Logger.Level
Returns an array containing the constants of this enum class, in the order they are declared.
Version - Class in com.judgmentlabs.judgeval
 

W

warning(String) - Static method in class com.judgmentlabs.judgeval.utils.Logger
 
WARNING - Enum constant in enum class com.judgmentlabs.judgeval.utils.Logger.Level
 
A B C D E F G H I J L M N O P R S T V W 
All Classes and Interfaces|All Packages|Constant Field Values|Serialized Form