Index

A B C D E F G H I J L M N O P R S T V W
All Classes and Interfaces|All Packages|Constant Field Values|Serialized Form

A

ACTUAL_OUTPUT - Enum constant in enum class com.judgmentlabs.judgeval.data.Example.ExampleParams

actualOutput(String) - Method in class com.judgmentlabs.judgeval.data.Example.Builder

ADDITIONAL_METADATA - Enum constant in enum class com.judgmentlabs.judgeval.data.Example.ExampleParams

additionalMetadata(Map<String, Object>) - Method in class com.judgmentlabs.judgeval.data.Example.Builder

additionalMetadata(Map<String, Object>) - Method in class com.judgmentlabs.judgeval.data.ScorerData.Builder

additionalProperty(String, Object) - Method in class com.judgmentlabs.judgeval.scorers.APIScorer.Builder

addModel(String) - Method in class com.judgmentlabs.judgeval.scorers.BaseScorer

addToRunEvalQueue(ExampleEvaluationRun) - Method in class com.judgmentlabs.judgeval.internal.api.JudgmentAsyncClient

addToRunEvalQueue(ExampleEvaluationRun) - Method in class com.judgmentlabs.judgeval.internal.api.JudgmentSyncClient

Advanced Configuration - Search tag in class com.judgmentlabs.judgeval.tracer.Tracer

Section

ANSWER_CORRECTNESS - Enum constant in enum class com.judgmentlabs.judgeval.data.APIScorerType

ANSWER_RELEVANCY - Enum constant in enum class com.judgmentlabs.judgeval.data.APIScorerType

AnswerCorrectnessScorer - Class in com.judgmentlabs.judgeval.scorers.api_scorers

AnswerCorrectnessScorer() - Constructor for class com.judgmentlabs.judgeval.scorers.api_scorers.AnswerCorrectnessScorer

AnswerRelevancyScorer - Class in com.judgmentlabs.judgeval.scorers.api_scorers

AnswerRelevancyScorer() - Constructor for class com.judgmentlabs.judgeval.scorers.api_scorers.AnswerRelevancyScorer

apiClient(JudgmentSyncClient) - Method in class com.judgmentlabs.judgeval.tracer.Tracer.TracerBuilder

apiKey() - Method in class com.judgmentlabs.judgeval.tracer.TracerConfiguration

apiKey(String) - Method in class com.judgmentlabs.judgeval.tracer.exporters.JudgmentSpanExporter.Builder

Sets the API key for authentication.

apiKey(String) - Method in class com.judgmentlabs.judgeval.tracer.TracerConfiguration.Builder

APIScorer - Class in com.judgmentlabs.judgeval.scorers

APIScorer(APIScorerType) - Constructor for class com.judgmentlabs.judgeval.scorers.APIScorer

APIScorer.Builder<T> - Class in com.judgmentlabs.judgeval.scorers

APIScorerType - Enum Class in com.judgmentlabs.judgeval.data

apiUrl() - Method in class com.judgmentlabs.judgeval.tracer.TracerConfiguration

apiUrl(String) - Method in class com.judgmentlabs.judgeval.tracer.TracerConfiguration.Builder

appendToPrompt(String) - Method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.BasePromptScorer

asyncEvaluate(BaseScorer, Example) - Method in class com.judgmentlabs.judgeval.tracer.Tracer

asyncEvaluate(BaseScorer, Example, String) - Method in class com.judgmentlabs.judgeval.tracer.Tracer

Asynchronously evaluates a scorer with an example.

asyncTraceEvaluate(BaseScorer) - Method in class com.judgmentlabs.judgeval.tracer.Tracer

asyncTraceEvaluate(BaseScorer, String) - Method in class com.judgmentlabs.judgeval.tracer.Tracer

Asynchronously evaluates a scorer with trace and span context.

B

BasePromptScorer - Class in com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer

BasePromptScorer(APIScorerType, String, String, double, Map<String, Double>, String, String) - Constructor for class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.BasePromptScorer

BaseScorer - Class in com.judgmentlabs.judgeval.internal.api.models

BaseScorer - Class in com.judgmentlabs.judgeval.scorers

BaseScorer() - Constructor for class com.judgmentlabs.judgeval.internal.api.models.BaseScorer

BaseScorer() - Constructor for class com.judgmentlabs.judgeval.scorers.BaseScorer

Basic Usage - Search tag in class com.judgmentlabs.judgeval.tracer.Tracer

Section

build() - Method in class com.judgmentlabs.judgeval.data.Example.Builder

build() - Method in class com.judgmentlabs.judgeval.data.ExampleEvaluationRun.Builder

build() - Method in class com.judgmentlabs.judgeval.data.ScorerData.Builder

build() - Method in class com.judgmentlabs.judgeval.data.ScoringResult.Builder

build() - Method in class com.judgmentlabs.judgeval.data.TraceEvaluationRun.Builder

build() - Method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.PromptScorer.Builder

build() - Method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.TracePromptScorer.Builder

build() - Method in class com.judgmentlabs.judgeval.scorers.APIScorer.Builder

build() - Method in class com.judgmentlabs.judgeval.tracer.exporters.JudgmentSpanExporter.Builder

Builds a new JudgmentSpanExporter with the current configuration.

build() - Method in class com.judgmentlabs.judgeval.tracer.Tracer.TracerBuilder

build() - Method in class com.judgmentlabs.judgeval.tracer.TracerConfiguration.Builder

builder() - Static method in class com.judgmentlabs.judgeval.data.Example

builder() - Static method in class com.judgmentlabs.judgeval.data.ExampleEvaluationRun

builder() - Static method in class com.judgmentlabs.judgeval.data.ScorerData

builder() - Static method in class com.judgmentlabs.judgeval.data.ScoringResult

builder() - Static method in class com.judgmentlabs.judgeval.data.TraceEvaluationRun

builder() - Static method in class com.judgmentlabs.judgeval.scorers.api_scorers.AnswerCorrectnessScorer

builder() - Static method in class com.judgmentlabs.judgeval.scorers.api_scorers.AnswerRelevancyScorer

builder() - Static method in class com.judgmentlabs.judgeval.scorers.api_scorers.DerailmentScorer

builder() - Static method in class com.judgmentlabs.judgeval.scorers.api_scorers.FaithfulnessScorer

builder() - Static method in class com.judgmentlabs.judgeval.scorers.api_scorers.InstructionAdherenceScorer

builder() - Static method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.PromptScorer

builder() - Static method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.TracePromptScorer

builder() - Static method in class com.judgmentlabs.judgeval.tracer.exporters.JudgmentSpanExporter

Creates a new builder for constructing JudgmentSpanExporter instances.

builder() - Static method in class com.judgmentlabs.judgeval.tracer.Tracer

builder() - Static method in class com.judgmentlabs.judgeval.tracer.TracerConfiguration

builder(Class<T>) - Static method in class com.judgmentlabs.judgeval.scorers.APIScorer

builder(String, String) - Static method in class com.judgmentlabs.judgeval.data.ExampleEvaluationRun

builder(String, String) - Static method in class com.judgmentlabs.judgeval.data.TraceEvaluationRun

builder(String, String) - Static method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.PromptScorer

builder(String, String) - Static method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.TracePromptScorer

Builder() - Constructor for class com.judgmentlabs.judgeval.tracer.TracerConfiguration.Builder

C

CLASSIFIER - Enum constant in enum class com.judgmentlabs.judgeval.data.APIScorerType

com.judgmentlabs.judgeval - package com.judgmentlabs.judgeval

com.judgmentlabs.judgeval.data - package com.judgmentlabs.judgeval.data

com.judgmentlabs.judgeval.exceptions - package com.judgmentlabs.judgeval.exceptions

com.judgmentlabs.judgeval.internal.api - package com.judgmentlabs.judgeval.internal.api

com.judgmentlabs.judgeval.internal.api.models - package com.judgmentlabs.judgeval.internal.api.models

com.judgmentlabs.judgeval.scorers - package com.judgmentlabs.judgeval.scorers

com.judgmentlabs.judgeval.scorers.api_scorers - package com.judgmentlabs.judgeval.scorers.api_scorers

com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer - package com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer

com.judgmentlabs.judgeval.tracer - package com.judgmentlabs.judgeval.tracer

com.judgmentlabs.judgeval.tracer.exporters - package com.judgmentlabs.judgeval.tracer.exporters

com.judgmentlabs.judgeval.utils - package com.judgmentlabs.judgeval.utils

configuration(TracerConfiguration) - Method in class com.judgmentlabs.judgeval.tracer.Tracer.TracerBuilder

context(String) - Method in class com.judgmentlabs.judgeval.data.Example.Builder

CONTEXT - Enum constant in enum class com.judgmentlabs.judgeval.data.Example.ExampleParams

create() - Static method in class com.judgmentlabs.judgeval.scorers.api_scorers.AnswerCorrectnessScorer

create() - Static method in class com.judgmentlabs.judgeval.scorers.api_scorers.AnswerRelevancyScorer

create() - Static method in class com.judgmentlabs.judgeval.scorers.api_scorers.DerailmentScorer

create() - Static method in class com.judgmentlabs.judgeval.scorers.api_scorers.FaithfulnessScorer

create() - Static method in class com.judgmentlabs.judgeval.scorers.api_scorers.InstructionAdherenceScorer

create(double) - Static method in class com.judgmentlabs.judgeval.scorers.api_scorers.AnswerCorrectnessScorer

create(double) - Static method in class com.judgmentlabs.judgeval.scorers.api_scorers.AnswerRelevancyScorer

create(double) - Static method in class com.judgmentlabs.judgeval.scorers.api_scorers.DerailmentScorer

create(double) - Static method in class com.judgmentlabs.judgeval.scorers.api_scorers.FaithfulnessScorer

create(double) - Static method in class com.judgmentlabs.judgeval.scorers.api_scorers.InstructionAdherenceScorer

create(String, String) - Static method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.PromptScorer

create(String, String) - Static method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.TracePromptScorer

create(String, String, double) - Static method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.PromptScorer

create(String, String, double) - Static method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.TracePromptScorer

create(String, String, double, Map<String, Double>) - Static method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.PromptScorer

create(String, String, double, Map<String, Double>) - Static method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.TracePromptScorer

create(String, String, double, Map<String, Double>, String, String) - Static method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.PromptScorer

create(String, String, double, Map<String, Double>, String, String) - Static method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.TracePromptScorer

createDefault(String) - Static method in class com.judgmentlabs.judgeval.tracer.Tracer

createDefault(String) - Static method in class com.judgmentlabs.judgeval.tracer.TracerConfiguration

Creates a default configuration with the given project name.

createWithConfiguration(TracerConfiguration) - Static method in class com.judgmentlabs.judgeval.tracer.Tracer

critical(String) - Static method in class com.judgmentlabs.judgeval.utils.Logger

CRITICAL - Enum constant in enum class com.judgmentlabs.judgeval.utils.Logger.Level

CUSTOM - Enum constant in enum class com.judgmentlabs.judgeval.data.APIScorerType

D

dataObject(Example) - Method in class com.judgmentlabs.judgeval.data.ScoringResult.Builder

debug(String) - Static method in class com.judgmentlabs.judgeval.utils.Logger

DEBUG - Enum constant in enum class com.judgmentlabs.judgeval.utils.Logger.Level

DERAILMENT - Enum constant in enum class com.judgmentlabs.judgeval.data.APIScorerType

DerailmentScorer - Class in com.judgmentlabs.judgeval.scorers.api_scorers

DerailmentScorer() - Constructor for class com.judgmentlabs.judgeval.scorers.api_scorers.DerailmentScorer

E

enableEvaluation() - Method in class com.judgmentlabs.judgeval.tracer.TracerConfiguration

enableEvaluation(boolean) - Method in class com.judgmentlabs.judgeval.tracer.TracerConfiguration.Builder

endpoint(String) - Method in class com.judgmentlabs.judgeval.tracer.exporters.JudgmentSpanExporter.Builder

Sets the OTLP endpoint URL.

Env - Class in com.judgmentlabs.judgeval

equals(Object) - Method in class com.judgmentlabs.judgeval.data.ExampleEvaluationRun

equals(Object) - Method in class com.judgmentlabs.judgeval.data.TraceEvaluationRun

equals(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer

equals(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.EvalResults

equals(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.EvalResultsFetch

equals(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.Example

equals(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.ExampleEvaluationRun

equals(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.FetchPromptScorersRequest

equals(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.FetchPromptScorersResponse

equals(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan

equals(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.PromptScorer

equals(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.ResolveProjectNameRequest

equals(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.ResolveProjectNameResponse

equals(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.SavePromptScorerRequest

equals(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.SavePromptScorerResponse

equals(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerConfig

equals(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerData

equals(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerExistsRequest

equals(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerExistsResponse

equals(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScoringResult

equals(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.TraceEvaluationRun

error(String) - Method in class com.judgmentlabs.judgeval.data.ScorerData.Builder

error(String) - Static method in class com.judgmentlabs.judgeval.utils.Logger

ERROR - Enum constant in enum class com.judgmentlabs.judgeval.utils.Logger.Level

evalName(String) - Method in class com.judgmentlabs.judgeval.data.ExampleEvaluationRun.Builder

evalName(String) - Method in class com.judgmentlabs.judgeval.data.TraceEvaluationRun.Builder

EvalResults - Class in com.judgmentlabs.judgeval.internal.api.models

EvalResults() - Constructor for class com.judgmentlabs.judgeval.internal.api.models.EvalResults

EvalResultsFetch - Class in com.judgmentlabs.judgeval.internal.api.models

EvalResultsFetch() - Constructor for class com.judgmentlabs.judgeval.internal.api.models.EvalResultsFetch

evaluationModel(String) - Method in class com.judgmentlabs.judgeval.data.ScorerData.Builder

example(Example) - Method in class com.judgmentlabs.judgeval.data.ExampleEvaluationRun.Builder

Example - Class in com.judgmentlabs.judgeval.data

Example - Class in com.judgmentlabs.judgeval.internal.api.models

Example() - Constructor for class com.judgmentlabs.judgeval.data.Example

Example() - Constructor for class com.judgmentlabs.judgeval.internal.api.models.Example

Example.Builder - Class in com.judgmentlabs.judgeval.data

Example.ExampleParams - Enum Class in com.judgmentlabs.judgeval.data

ExampleEvaluationRun - Class in com.judgmentlabs.judgeval.data

ExampleEvaluationRun - Class in com.judgmentlabs.judgeval.internal.api.models

ExampleEvaluationRun() - Constructor for class com.judgmentlabs.judgeval.data.ExampleEvaluationRun

ExampleEvaluationRun() - Constructor for class com.judgmentlabs.judgeval.internal.api.models.ExampleEvaluationRun

ExampleEvaluationRun(String, String, List<Example>, List<ScorerConfig>, String, String) - Constructor for class com.judgmentlabs.judgeval.data.ExampleEvaluationRun

ExampleEvaluationRun.Builder - Class in com.judgmentlabs.judgeval.data

examples(List<Example>) - Method in class com.judgmentlabs.judgeval.data.ExampleEvaluationRun.Builder

ExampleScorer - Class in com.judgmentlabs.judgeval.scorers

ExampleScorer() - Constructor for class com.judgmentlabs.judgeval.scorers.ExampleScorer

EXECUTION_ORDER - Enum constant in enum class com.judgmentlabs.judgeval.data.APIScorerType

EXPECTED_OUTPUT - Enum constant in enum class com.judgmentlabs.judgeval.data.Example.ExampleParams

EXPECTED_TOOLS - Enum constant in enum class com.judgmentlabs.judgeval.data.Example.ExampleParams

expectedOutput(String) - Method in class com.judgmentlabs.judgeval.data.Example.Builder

expectedTools(Object) - Method in class com.judgmentlabs.judgeval.data.Example.Builder

export(Collection<SpanData>) - Method in class com.judgmentlabs.judgeval.tracer.exporters.JudgmentSpanExporter

export(Collection<SpanData>) - Method in class com.judgmentlabs.judgeval.tracer.exporters.NoOpSpanExporter

F

FAITHFULNESS - Enum constant in enum class com.judgmentlabs.judgeval.data.APIScorerType

FaithfulnessScorer - Class in com.judgmentlabs.judgeval.scorers.api_scorers

FaithfulnessScorer() - Constructor for class com.judgmentlabs.judgeval.scorers.api_scorers.FaithfulnessScorer

fetchExperimentRun(EvalResultsFetch) - Method in class com.judgmentlabs.judgeval.internal.api.JudgmentAsyncClient

fetchExperimentRun(EvalResultsFetch) - Method in class com.judgmentlabs.judgeval.internal.api.JudgmentSyncClient

fetchPromptScorer(String, String, String) - Static method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.BasePromptScorer

FetchPromptScorersRequest - Class in com.judgmentlabs.judgeval.internal.api.models

FetchPromptScorersRequest() - Constructor for class com.judgmentlabs.judgeval.internal.api.models.FetchPromptScorersRequest

FetchPromptScorersResponse - Class in com.judgmentlabs.judgeval.internal.api.models

FetchPromptScorersResponse() - Constructor for class com.judgmentlabs.judgeval.internal.api.models.FetchPromptScorersResponse

fetchScorers(FetchPromptScorersRequest) - Method in class com.judgmentlabs.judgeval.internal.api.JudgmentAsyncClient

fetchScorers(FetchPromptScorersRequest) - Method in class com.judgmentlabs.judgeval.internal.api.JudgmentSyncClient

flush() - Method in class com.judgmentlabs.judgeval.tracer.exporters.JudgmentSpanExporter

flush() - Method in class com.judgmentlabs.judgeval.tracer.exporters.NoOpSpanExporter

G

get(String) - Static method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.PromptScorer

get(String) - Static method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.TracePromptScorer

get(String, String, String) - Static method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.PromptScorer

get(String, String, String) - Static method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.TracePromptScorer

getAdditionalMetadata() - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer

getAdditionalMetadata() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerData

getAdditionalMetadata() - Method in class com.judgmentlabs.judgeval.scorers.BaseScorer

getAdditionalProperties() - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer

getAdditionalProperties() - Method in class com.judgmentlabs.judgeval.internal.api.models.EvalResults

getAdditionalProperties() - Method in class com.judgmentlabs.judgeval.internal.api.models.EvalResultsFetch

getAdditionalProperties() - Method in class com.judgmentlabs.judgeval.internal.api.models.Example

getAdditionalProperties() - Method in class com.judgmentlabs.judgeval.internal.api.models.ExampleEvaluationRun

getAdditionalProperties() - Method in class com.judgmentlabs.judgeval.internal.api.models.FetchPromptScorersRequest

getAdditionalProperties() - Method in class com.judgmentlabs.judgeval.internal.api.models.FetchPromptScorersResponse

getAdditionalProperties() - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan

getAdditionalProperties() - Method in class com.judgmentlabs.judgeval.internal.api.models.PromptScorer

getAdditionalProperties() - Method in class com.judgmentlabs.judgeval.internal.api.models.ResolveProjectNameRequest

getAdditionalProperties() - Method in class com.judgmentlabs.judgeval.internal.api.models.ResolveProjectNameResponse

getAdditionalProperties() - Method in class com.judgmentlabs.judgeval.internal.api.models.SavePromptScorerRequest

getAdditionalProperties() - Method in class com.judgmentlabs.judgeval.internal.api.models.SavePromptScorerResponse

getAdditionalProperties() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerConfig

getAdditionalProperties() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerData

getAdditionalProperties() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerExistsRequest

getAdditionalProperties() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerExistsResponse

getAdditionalProperties() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScoringResult

getAdditionalProperties() - Method in class com.judgmentlabs.judgeval.internal.api.models.TraceEvaluationRun

getAgentId() - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan

getClassName() - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer

getClassName() - Method in class com.judgmentlabs.judgeval.scorers.BaseScorer

getColor() - Method in enum class com.judgmentlabs.judgeval.utils.Logger.Level

getConfig() - Method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.BasePromptScorer

getCreatedAt() - Method in class com.judgmentlabs.judgeval.internal.api.models.Example

getCreatedAt() - Method in class com.judgmentlabs.judgeval.internal.api.models.ExampleEvaluationRun

getCreatedAt() - Method in class com.judgmentlabs.judgeval.internal.api.models.PromptScorer

getCreatedAt() - Method in class com.judgmentlabs.judgeval.internal.api.models.TraceEvaluationRun

getCumulativeLlmCost() - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan

getCustomScorers() - Method in class com.judgmentlabs.judgeval.internal.api.models.ExampleEvaluationRun

getCustomScorers() - Method in class com.judgmentlabs.judgeval.internal.api.models.TraceEvaluationRun

getDataObject() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScoringResult

getDetail() - Method in exception class com.judgmentlabs.judgeval.exceptions.JudgmentAPIError

getDuration() - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan

getError() - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer

getError() - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan

getError() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerData

getError() - Method in class com.judgmentlabs.judgeval.scorers.BaseScorer

getEvalName() - Method in class com.judgmentlabs.judgeval.internal.api.models.ExampleEvaluationRun

getEvalName() - Method in class com.judgmentlabs.judgeval.internal.api.models.TraceEvaluationRun

getEvaluationCost() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScoringResult

getEvaluationModel() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerData

getEvaluationStatus(String, String) - Method in class com.judgmentlabs.judgeval.internal.api.JudgmentAsyncClient

getEvaluationStatus(String, String) - Method in class com.judgmentlabs.judgeval.internal.api.JudgmentSyncClient

getEvents() - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan

getExampleId() - Method in class com.judgmentlabs.judgeval.internal.api.models.Example

getExamples() - Method in class com.judgmentlabs.judgeval.internal.api.models.ExampleEvaluationRun

getExists() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerExistsResponse

getExperimentRunId() - Method in class com.judgmentlabs.judgeval.internal.api.models.EvalResultsFetch

getId() - Method in class com.judgmentlabs.judgeval.internal.api.models.ExampleEvaluationRun

getId() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerData

getId() - Method in class com.judgmentlabs.judgeval.internal.api.models.TraceEvaluationRun

getInputs() - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan

getIsOffline() - Method in class com.judgmentlabs.judgeval.internal.api.models.TraceEvaluationRun

getIsTrace() - Method in class com.judgmentlabs.judgeval.internal.api.models.PromptScorer

getIsTrace() - Method in class com.judgmentlabs.judgeval.internal.api.models.SavePromptScorerRequest

getJudgmentScorers() - Method in class com.judgmentlabs.judgeval.internal.api.models.ExampleEvaluationRun

getJudgmentScorers() - Method in class com.judgmentlabs.judgeval.internal.api.models.TraceEvaluationRun

getKwargs() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerConfig

getLegacySpanId() - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan

getLinks() - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan

getMessage() - Method in class com.judgmentlabs.judgeval.internal.api.models.SavePromptScorerResponse

getModel() - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer

getModel() - Method in class com.judgmentlabs.judgeval.internal.api.models.ExampleEvaluationRun

getModel() - Method in class com.judgmentlabs.judgeval.internal.api.models.TraceEvaluationRun

getModel() - Method in class com.judgmentlabs.judgeval.scorers.BaseScorer

getModelClient() - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer

getModelClient() - Method in class com.judgmentlabs.judgeval.scorers.BaseScorer

getName() - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer

getName() - Method in class com.judgmentlabs.judgeval.internal.api.models.Example

getName() - Method in class com.judgmentlabs.judgeval.internal.api.models.PromptScorer

getName() - Method in class com.judgmentlabs.judgeval.internal.api.models.SavePromptScorerRequest

getName() - Method in class com.judgmentlabs.judgeval.internal.api.models.SavePromptScorerResponse

getName() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerConfig

getName() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerData

getName() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerExistsRequest

getName() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScoringResult

getName() - Method in class com.judgmentlabs.judgeval.scorers.BaseScorer

getNames() - Method in class com.judgmentlabs.judgeval.internal.api.models.FetchPromptScorersRequest

getOptions() - Method in class com.judgmentlabs.judgeval.internal.api.models.PromptScorer

getOptions() - Method in class com.judgmentlabs.judgeval.internal.api.models.SavePromptScorerRequest

getOptions() - Method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.BasePromptScorer

getOrganizationId() - Method in class com.judgmentlabs.judgeval.data.ExampleEvaluationRun

getOrganizationId() - Method in class com.judgmentlabs.judgeval.data.TraceEvaluationRun

getOrganizationId() - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan

getOutput() - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan

getParentSpanId() - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan

getProjectId() - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan

getProjectId() - Method in class com.judgmentlabs.judgeval.internal.api.models.ResolveProjectNameResponse

getProjectName() - Method in class com.judgmentlabs.judgeval.internal.api.models.EvalResultsFetch

getProjectName() - Method in class com.judgmentlabs.judgeval.internal.api.models.ExampleEvaluationRun

getProjectName() - Method in class com.judgmentlabs.judgeval.internal.api.models.ResolveProjectNameRequest

getProjectName() - Method in class com.judgmentlabs.judgeval.internal.api.models.TraceEvaluationRun

getPrompt() - Method in class com.judgmentlabs.judgeval.internal.api.models.PromptScorer

getPrompt() - Method in class com.judgmentlabs.judgeval.internal.api.models.SavePromptScorerRequest

getPrompt() - Method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.BasePromptScorer

getReason() - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer

getReason() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerData

getReason() - Method in class com.judgmentlabs.judgeval.scorers.BaseScorer

getRequiredParams() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerConfig

getRequiredParams() - Method in class com.judgmentlabs.judgeval.scorers.APIScorer

getRequiredParams() - Method in class com.judgmentlabs.judgeval.scorers.BaseScorer

getRequiredParams() - Method in class com.judgmentlabs.judgeval.scorers.ExampleScorer

getResourceAttributes() - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan

getResults() - Method in class com.judgmentlabs.judgeval.internal.api.models.EvalResults

getRun() - Method in class com.judgmentlabs.judgeval.internal.api.models.EvalResults

getRunDuration() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScoringResult

getScore() - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer

getScore() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerData

getScore() - Method in class com.judgmentlabs.judgeval.scorers.BaseScorer

getScoreBreakdown() - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer

getScoreBreakdown() - Method in class com.judgmentlabs.judgeval.scorers.BaseScorer

getScorerName() - Method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.BasePromptScorer

getScorers() - Method in class com.judgmentlabs.judgeval.internal.api.models.FetchPromptScorersResponse

getScorersData() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScoringResult

getScoreType() - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer

getScoreType() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerConfig

getScoreType() - Method in class com.judgmentlabs.judgeval.scorers.APIScorer

getScoreType() - Method in class com.judgmentlabs.judgeval.scorers.BaseScorer

getServerHosted() - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer

getServiceName() - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan

getSpanAttributes() - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan

getSpanExporter() - Method in class com.judgmentlabs.judgeval.tracer.Tracer

Gets the SpanExporter for integration with OpenTelemetry.

getSpanId() - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan

getSpanKind() - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan

getSpanName() - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan

getStateAfter() - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan

getStateBefore() - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan

getStatusCode() - Method in exception class com.judgmentlabs.judgeval.exceptions.JudgmentAPIError

getStatusCode() - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan

getStatusMessage() - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan

getStrictMode() - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer

getStrictMode() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerConfig

getStrictMode() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerData

getSuccess() - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer

getSuccess() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerData

getSuccess() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScoringResult

getSuccess() - Method in class com.judgmentlabs.judgeval.scorers.BaseScorer

getThreshold() - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer

getThreshold() - Method in class com.judgmentlabs.judgeval.internal.api.models.PromptScorer

getThreshold() - Method in class com.judgmentlabs.judgeval.internal.api.models.SavePromptScorerRequest

getThreshold() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerConfig

getThreshold() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerData

getThreshold() - Method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.BasePromptScorer

getThreshold() - Method in class com.judgmentlabs.judgeval.scorers.BaseScorer

getTimestamp() - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan

getTraceAndSpanIds() - Method in class com.judgmentlabs.judgeval.internal.api.models.TraceEvaluationRun

getTraceId() - Method in class com.judgmentlabs.judgeval.internal.api.models.ExampleEvaluationRun

getTraceId() - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan

getTraceId() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScoringResult

getTraceSpanId() - Method in class com.judgmentlabs.judgeval.internal.api.models.ExampleEvaluationRun

getTraceState() - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan

getUpdatedAt() - Method in class com.judgmentlabs.judgeval.internal.api.models.PromptScorer

getUser() - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer

getUser() - Method in class com.judgmentlabs.judgeval.scorers.BaseScorer

getUserId() - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan

getUsingNativeModel() - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer

getUsingNativeModel() - Method in class com.judgmentlabs.judgeval.scorers.BaseScorer

getValue() - Method in enum class com.judgmentlabs.judgeval.data.APIScorerType

getValue() - Method in enum class com.judgmentlabs.judgeval.data.Example.ExampleParams

getValue() - Method in enum class com.judgmentlabs.judgeval.utils.Logger.Level

H

hashCode() - Method in class com.judgmentlabs.judgeval.data.ExampleEvaluationRun

hashCode() - Method in class com.judgmentlabs.judgeval.data.TraceEvaluationRun

hashCode() - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer

hashCode() - Method in class com.judgmentlabs.judgeval.internal.api.models.EvalResults

hashCode() - Method in class com.judgmentlabs.judgeval.internal.api.models.EvalResultsFetch

hashCode() - Method in class com.judgmentlabs.judgeval.internal.api.models.Example

hashCode() - Method in class com.judgmentlabs.judgeval.internal.api.models.ExampleEvaluationRun

hashCode() - Method in class com.judgmentlabs.judgeval.internal.api.models.FetchPromptScorersRequest

hashCode() - Method in class com.judgmentlabs.judgeval.internal.api.models.FetchPromptScorersResponse

hashCode() - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan

hashCode() - Method in class com.judgmentlabs.judgeval.internal.api.models.PromptScorer

hashCode() - Method in class com.judgmentlabs.judgeval.internal.api.models.ResolveProjectNameRequest

hashCode() - Method in class com.judgmentlabs.judgeval.internal.api.models.ResolveProjectNameResponse

hashCode() - Method in class com.judgmentlabs.judgeval.internal.api.models.SavePromptScorerRequest

hashCode() - Method in class com.judgmentlabs.judgeval.internal.api.models.SavePromptScorerResponse

hashCode() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerConfig

hashCode() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerData

hashCode() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerExistsRequest

hashCode() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerExistsResponse

hashCode() - Method in class com.judgmentlabs.judgeval.internal.api.models.ScoringResult

hashCode() - Method in class com.judgmentlabs.judgeval.internal.api.models.TraceEvaluationRun

I

info(String) - Static method in class com.judgmentlabs.judgeval.utils.Logger

INFO - Enum constant in enum class com.judgmentlabs.judgeval.utils.Logger.Level

input(String) - Method in class com.judgmentlabs.judgeval.data.Example.Builder

INPUT - Enum constant in enum class com.judgmentlabs.judgeval.data.Example.ExampleParams

INSTRUCTION_ADHERENCE - Enum constant in enum class com.judgmentlabs.judgeval.data.APIScorerType

InstructionAdherenceScorer - Class in com.judgmentlabs.judgeval.scorers.api_scorers

InstructionAdherenceScorer() - Constructor for class com.judgmentlabs.judgeval.scorers.api_scorers.InstructionAdherenceScorer

ISerializer - Interface in com.judgmentlabs.judgeval.tracer

isServerHosted() - Method in class com.judgmentlabs.judgeval.scorers.BaseScorer

isStrictMode() - Method in class com.judgmentlabs.judgeval.scorers.BaseScorer

isTrace() - Method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.BasePromptScorer

isTrace() - Method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.PromptScorer

isTrace() - Method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.TracePromptScorer

J

JUDGMENT_AGENT_CLASS_NAME - Static variable in class com.judgmentlabs.judgeval.tracer.OpenTelemetryKeys.AttributeKeys

JUDGMENT_AGENT_ID - Static variable in class com.judgmentlabs.judgeval.tracer.OpenTelemetryKeys.AttributeKeys

JUDGMENT_AGENT_INSTANCE_NAME - Static variable in class com.judgmentlabs.judgeval.tracer.OpenTelemetryKeys.AttributeKeys

JUDGMENT_API_KEY - Static variable in class com.judgmentlabs.judgeval.Env

JUDGMENT_API_URL - Static variable in class com.judgmentlabs.judgeval.Env

JUDGMENT_CUMULATIVE_LLM_COST - Static variable in class com.judgmentlabs.judgeval.tracer.OpenTelemetryKeys.AttributeKeys

JUDGMENT_CUSTOMER_ID - Static variable in class com.judgmentlabs.judgeval.tracer.OpenTelemetryKeys.AttributeKeys

JUDGMENT_DEFAULT_GPT_MODEL - Static variable in class com.judgmentlabs.judgeval.Env

JUDGMENT_INPUT - Static variable in class com.judgmentlabs.judgeval.tracer.OpenTelemetryKeys.AttributeKeys

JUDGMENT_IS_AGENT_ENTRY_POINT - Static variable in class com.judgmentlabs.judgeval.tracer.OpenTelemetryKeys.AttributeKeys

JUDGMENT_NO_COLOR - Static variable in class com.judgmentlabs.judgeval.Env

JUDGMENT_OFFLINE_MODE - Static variable in class com.judgmentlabs.judgeval.tracer.OpenTelemetryKeys.AttributeKeys

JUDGMENT_ORG_ID - Static variable in class com.judgmentlabs.judgeval.Env

JUDGMENT_OUTPUT - Static variable in class com.judgmentlabs.judgeval.tracer.OpenTelemetryKeys.AttributeKeys

JUDGMENT_PARENT_AGENT_ID - Static variable in class com.judgmentlabs.judgeval.tracer.OpenTelemetryKeys.AttributeKeys

JUDGMENT_PROJECT_ID - Static variable in class com.judgmentlabs.judgeval.tracer.OpenTelemetryKeys.ResourceKeys

JUDGMENT_SPAN_KIND - Static variable in class com.judgmentlabs.judgeval.tracer.OpenTelemetryKeys.AttributeKeys

JUDGMENT_STATE_AFTER - Static variable in class com.judgmentlabs.judgeval.tracer.OpenTelemetryKeys.AttributeKeys

JUDGMENT_STATE_BEFORE - Static variable in class com.judgmentlabs.judgeval.tracer.OpenTelemetryKeys.AttributeKeys

JUDGMENT_UPDATE_ID - Static variable in class com.judgmentlabs.judgeval.tracer.OpenTelemetryKeys.AttributeKeys

JudgmentAPIError - Exception Class in com.judgmentlabs.judgeval.exceptions

JudgmentAPIError(int, String) - Constructor for exception class com.judgmentlabs.judgeval.exceptions.JudgmentAPIError

judgmentApiKey - Variable in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.BasePromptScorer

judgmentApiKey(String) - Method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.PromptScorer.Builder

judgmentApiKey(String) - Method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.TracePromptScorer.Builder

JudgmentAsyncClient - Class in com.judgmentlabs.judgeval.internal.api

JudgmentAsyncClient(String, String, String) - Constructor for class com.judgmentlabs.judgeval.internal.api.JudgmentAsyncClient

JudgmentRuntimeError - Exception Class in com.judgmentlabs.judgeval.exceptions

JudgmentRuntimeError(String) - Constructor for exception class com.judgmentlabs.judgeval.exceptions.JudgmentRuntimeError

JudgmentRuntimeError(String, Throwable) - Constructor for exception class com.judgmentlabs.judgeval.exceptions.JudgmentRuntimeError

JudgmentSpanExporter - Class in com.judgmentlabs.judgeval.tracer.exporters

SpanExporter implementation that sends spans to Judgment Labs with project identification.

JudgmentSpanExporter(String, String, String, String) - Constructor for class com.judgmentlabs.judgeval.tracer.exporters.JudgmentSpanExporter

Creates a new JudgmentSpanExporter with the specified configuration.

JudgmentSpanExporter.Builder - Class in com.judgmentlabs.judgeval.tracer.exporters

Builder for creating JudgmentSpanExporter instances.

JudgmentSyncClient - Class in com.judgmentlabs.judgeval.internal.api

JudgmentSyncClient(String, String, String) - Constructor for class com.judgmentlabs.judgeval.internal.api.JudgmentSyncClient

JudgmentTestError - Exception Class in com.judgmentlabs.judgeval.exceptions

JudgmentTestError(String) - Constructor for exception class com.judgmentlabs.judgeval.exceptions.JudgmentTestError

JudgmentTestError(String, Throwable) - Constructor for exception class com.judgmentlabs.judgeval.exceptions.JudgmentTestError

L

logEvalResults(EvalResults) - Method in class com.judgmentlabs.judgeval.internal.api.JudgmentAsyncClient

logEvalResults(EvalResults) - Method in class com.judgmentlabs.judgeval.internal.api.JudgmentSyncClient

Logger - Class in com.judgmentlabs.judgeval.utils

Logger() - Constructor for class com.judgmentlabs.judgeval.utils.Logger

Logger.Level - Enum Class in com.judgmentlabs.judgeval.utils

M

metadata(String, Object) - Method in class com.judgmentlabs.judgeval.data.ScorerData.Builder

model(String) - Method in class com.judgmentlabs.judgeval.data.ExampleEvaluationRun.Builder

model(String) - Method in class com.judgmentlabs.judgeval.data.TraceEvaluationRun.Builder

model(String) - Method in class com.judgmentlabs.judgeval.scorers.APIScorer.Builder

N

name(String) - Method in class com.judgmentlabs.judgeval.data.Example.Builder

name(String) - Method in class com.judgmentlabs.judgeval.data.ScorerData.Builder

name(String) - Method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.PromptScorer.Builder

name(String) - Method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.TracePromptScorer.Builder

name(String) - Method in class com.judgmentlabs.judgeval.scorers.APIScorer.Builder

NoOpSpanExporter - Class in com.judgmentlabs.judgeval.tracer.exporters

NoOpSpanExporter() - Constructor for class com.judgmentlabs.judgeval.tracer.exporters.NoOpSpanExporter

O

OpenTelemetry Integration - Search tag in class com.judgmentlabs.judgeval.tracer.Tracer

Section

OpenTelemetryKeys - Class in com.judgmentlabs.judgeval.tracer

OpenTelemetryKeys.AttributeKeys - Class in com.judgmentlabs.judgeval.tracer

OpenTelemetryKeys.ResourceKeys - Class in com.judgmentlabs.judgeval.tracer

option(String, Double) - Method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.PromptScorer.Builder

option(String, Double) - Method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.TracePromptScorer.Builder

options - Variable in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.BasePromptScorer

options(Map<String, Double>) - Method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.PromptScorer.Builder

options(Map<String, Double>) - Method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.TracePromptScorer.Builder

organizationId - Variable in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.BasePromptScorer

organizationId() - Method in class com.judgmentlabs.judgeval.tracer.TracerConfiguration

organizationId(String) - Method in class com.judgmentlabs.judgeval.data.ExampleEvaluationRun.Builder

organizationId(String) - Method in class com.judgmentlabs.judgeval.data.TraceEvaluationRun.Builder

organizationId(String) - Method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.PromptScorer.Builder

organizationId(String) - Method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.TracePromptScorer.Builder

organizationId(String) - Method in class com.judgmentlabs.judgeval.tracer.exporters.JudgmentSpanExporter.Builder

Sets the organization ID.

organizationId(String) - Method in class com.judgmentlabs.judgeval.tracer.TracerConfiguration.Builder

OtelTraceSpan - Class in com.judgmentlabs.judgeval.internal.api.models

OtelTraceSpan() - Constructor for class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan

P

PENDING_TRACE_EVAL - Static variable in class com.judgmentlabs.judgeval.tracer.OpenTelemetryKeys.AttributeKeys

projectId(String) - Method in class com.judgmentlabs.judgeval.tracer.exporters.JudgmentSpanExporter.Builder

Sets the project ID.

projectName() - Method in class com.judgmentlabs.judgeval.tracer.TracerConfiguration

projectName(String) - Method in class com.judgmentlabs.judgeval.data.ExampleEvaluationRun.Builder

projectName(String) - Method in class com.judgmentlabs.judgeval.data.TraceEvaluationRun.Builder

projectName(String) - Method in class com.judgmentlabs.judgeval.tracer.TracerConfiguration.Builder

projectsResolve(ResolveProjectNameRequest) - Method in class com.judgmentlabs.judgeval.internal.api.JudgmentAsyncClient

projectsResolve(ResolveProjectNameRequest) - Method in class com.judgmentlabs.judgeval.internal.api.JudgmentSyncClient

prompt - Variable in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.BasePromptScorer

prompt(String) - Method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.PromptScorer.Builder

prompt(String) - Method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.TracePromptScorer.Builder

PROMPT_SCORER - Enum constant in enum class com.judgmentlabs.judgeval.data.APIScorerType

PromptScorer - Class in com.judgmentlabs.judgeval.internal.api.models

PromptScorer - Class in com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer

PromptScorer() - Constructor for class com.judgmentlabs.judgeval.internal.api.models.PromptScorer

PromptScorer(String, String, double, Map<String, Double>) - Constructor for class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.PromptScorer

PromptScorer(String, String, double, Map<String, Double>, String, String) - Constructor for class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.PromptScorer

PromptScorer.Builder - Class in com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer

property(String, Object) - Method in class com.judgmentlabs.judgeval.data.Example.Builder

pushPromptScorer() - Method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.BasePromptScorer

pushPromptScorer(String, String, double, Map<String, Double>, String, String, Boolean) - Static method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.BasePromptScorer

R

reason(String) - Method in class com.judgmentlabs.judgeval.data.ScorerData.Builder

requiredParams(List<String>) - Method in class com.judgmentlabs.judgeval.scorers.APIScorer.Builder

ResolveProjectNameRequest - Class in com.judgmentlabs.judgeval.internal.api.models

ResolveProjectNameRequest() - Constructor for class com.judgmentlabs.judgeval.internal.api.models.ResolveProjectNameRequest

ResolveProjectNameResponse - Class in com.judgmentlabs.judgeval.internal.api.models

ResolveProjectNameResponse() - Constructor for class com.judgmentlabs.judgeval.internal.api.models.ResolveProjectNameResponse

RETRIEVAL_CONTEXT - Enum constant in enum class com.judgmentlabs.judgeval.data.Example.ExampleParams

retrievalContext(String) - Method in class com.judgmentlabs.judgeval.data.Example.Builder

S

SavePromptScorerRequest - Class in com.judgmentlabs.judgeval.internal.api.models

SavePromptScorerRequest() - Constructor for class com.judgmentlabs.judgeval.internal.api.models.SavePromptScorerRequest

SavePromptScorerResponse - Class in com.judgmentlabs.judgeval.internal.api.models

SavePromptScorerResponse() - Constructor for class com.judgmentlabs.judgeval.internal.api.models.SavePromptScorerResponse

saveScorer(SavePromptScorerRequest) - Method in class com.judgmentlabs.judgeval.internal.api.JudgmentAsyncClient

saveScorer(SavePromptScorerRequest) - Method in class com.judgmentlabs.judgeval.internal.api.JudgmentSyncClient

score(Double) - Method in class com.judgmentlabs.judgeval.data.ScorerData.Builder

scoreExample(Example) - Method in class com.judgmentlabs.judgeval.scorers.ExampleScorer

scorer(ScorerConfig) - Method in class com.judgmentlabs.judgeval.data.ExampleEvaluationRun.Builder

scorer(ScorerConfig) - Method in class com.judgmentlabs.judgeval.data.TraceEvaluationRun.Builder

ScorerConfig - Class in com.judgmentlabs.judgeval.internal.api.models

ScorerConfig() - Constructor for class com.judgmentlabs.judgeval.internal.api.models.ScorerConfig

scorerData(ScorerData) - Method in class com.judgmentlabs.judgeval.data.ScoringResult.Builder

ScorerData - Class in com.judgmentlabs.judgeval.data

ScorerData - Class in com.judgmentlabs.judgeval.internal.api.models

ScorerData() - Constructor for class com.judgmentlabs.judgeval.data.ScorerData

ScorerData() - Constructor for class com.judgmentlabs.judgeval.internal.api.models.ScorerData

ScorerData.Builder - Class in com.judgmentlabs.judgeval.data

scorerExists(ScorerExistsRequest) - Method in class com.judgmentlabs.judgeval.internal.api.JudgmentAsyncClient

scorerExists(ScorerExistsRequest) - Method in class com.judgmentlabs.judgeval.internal.api.JudgmentSyncClient

scorerExists(String, String, String) - Static method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.BasePromptScorer

ScorerExistsRequest - Class in com.judgmentlabs.judgeval.internal.api.models

ScorerExistsRequest() - Constructor for class com.judgmentlabs.judgeval.internal.api.models.ScorerExistsRequest

ScorerExistsResponse - Class in com.judgmentlabs.judgeval.internal.api.models

ScorerExistsResponse() - Constructor for class com.judgmentlabs.judgeval.internal.api.models.ScorerExistsResponse

scorers(List<ScorerConfig>) - Method in class com.judgmentlabs.judgeval.data.ExampleEvaluationRun.Builder

scorers(List<ScorerConfig>) - Method in class com.judgmentlabs.judgeval.data.TraceEvaluationRun.Builder

scorersData(List<ScorerData>) - Method in class com.judgmentlabs.judgeval.data.ScoringResult.Builder

ScoringResult - Class in com.judgmentlabs.judgeval.data

ScoringResult - Class in com.judgmentlabs.judgeval.internal.api.models

ScoringResult() - Constructor for class com.judgmentlabs.judgeval.data.ScoringResult

ScoringResult() - Constructor for class com.judgmentlabs.judgeval.internal.api.models.ScoringResult

ScoringResult.Builder - Class in com.judgmentlabs.judgeval.data

serialize(Object) - Method in interface com.judgmentlabs.judgeval.tracer.ISerializer

serialize(Object, Type) - Method in interface com.judgmentlabs.judgeval.tracer.ISerializer

serializer(ISerializer) - Method in class com.judgmentlabs.judgeval.tracer.Tracer.TracerBuilder

SERVICE_NAME - Static variable in class com.judgmentlabs.judgeval.tracer.OpenTelemetryKeys.ResourceKeys

setAdditionalMetadata(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer

setAdditionalMetadata(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerData

setAdditionalMetadata(Map<String, Object>) - Method in class com.judgmentlabs.judgeval.scorers.BaseScorer

setAdditionalProperty(String, Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer

setAdditionalProperty(String, Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.EvalResults

setAdditionalProperty(String, Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.EvalResultsFetch

setAdditionalProperty(String, Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.Example

setAdditionalProperty(String, Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.ExampleEvaluationRun

setAdditionalProperty(String, Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.FetchPromptScorersRequest

setAdditionalProperty(String, Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.FetchPromptScorersResponse

setAdditionalProperty(String, Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan

setAdditionalProperty(String, Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.PromptScorer

setAdditionalProperty(String, Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.ResolveProjectNameRequest

setAdditionalProperty(String, Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.ResolveProjectNameResponse

setAdditionalProperty(String, Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.SavePromptScorerRequest

setAdditionalProperty(String, Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.SavePromptScorerResponse

setAdditionalProperty(String, Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerConfig

setAdditionalProperty(String, Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerData

setAdditionalProperty(String, Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerExistsRequest

setAdditionalProperty(String, Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerExistsResponse

setAdditionalProperty(String, Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScoringResult

setAdditionalProperty(String, Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.TraceEvaluationRun

setAgentId(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan

setAttribute(String, Object) - Method in class com.judgmentlabs.judgeval.tracer.Tracer

Sets a custom attribute on the current span.

setAttribute(String, Object, Type) - Method in class com.judgmentlabs.judgeval.tracer.Tracer

Sets a custom attribute on the current span with a specific type.

setAttributes(Map<String, Object>) - Method in class com.judgmentlabs.judgeval.tracer.Tracer

setClassName(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer

setClassName(String) - Method in class com.judgmentlabs.judgeval.scorers.BaseScorer

setCreatedAt(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.Example

setCreatedAt(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.ExampleEvaluationRun

setCreatedAt(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.PromptScorer

setCreatedAt(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.TraceEvaluationRun

setCumulativeLlmCost(Double) - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan

setCustomScorers(List<BaseScorer>) - Method in class com.judgmentlabs.judgeval.internal.api.models.ExampleEvaluationRun

setCustomScorers(List<BaseScorer>) - Method in class com.judgmentlabs.judgeval.internal.api.models.TraceEvaluationRun

setDataObject(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScoringResult

setDuration(Integer) - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan

setError(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan

setError(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer

setError(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerData

setError(String) - Method in class com.judgmentlabs.judgeval.scorers.BaseScorer

setEvalName(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.ExampleEvaluationRun

setEvalName(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.TraceEvaluationRun

setEvaluationCost(Double) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScoringResult

setEvaluationModel(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerData

setEvents(List<Object>) - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan

setExampleId(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.Example

setExamples(List<Example>) - Method in class com.judgmentlabs.judgeval.internal.api.models.ExampleEvaluationRun

setExists(Boolean) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerExistsResponse

setExperimentRunId(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.EvalResultsFetch

setGeneralSpan() - Method in class com.judgmentlabs.judgeval.tracer.Tracer

setId(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.ExampleEvaluationRun

setId(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerData

setId(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.TraceEvaluationRun

setInput(Object) - Method in class com.judgmentlabs.judgeval.tracer.Tracer

setInput(Object, Type) - Method in class com.judgmentlabs.judgeval.tracer.Tracer

setInputs(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan

setIsOffline(Boolean) - Method in class com.judgmentlabs.judgeval.internal.api.models.TraceEvaluationRun

setIsTrace(Boolean) - Method in class com.judgmentlabs.judgeval.internal.api.models.PromptScorer

setIsTrace(Boolean) - Method in class com.judgmentlabs.judgeval.internal.api.models.SavePromptScorerRequest

setJudgmentScorers(List<ScorerConfig>) - Method in class com.judgmentlabs.judgeval.internal.api.models.ExampleEvaluationRun

setJudgmentScorers(List<ScorerConfig>) - Method in class com.judgmentlabs.judgeval.internal.api.models.TraceEvaluationRun

setKwargs(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerConfig

setLegacySpanId(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan

setLevel(Logger.Level) - Static method in class com.judgmentlabs.judgeval.utils.Logger

setLinks(List<Object>) - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan

setLLMSpan() - Method in class com.judgmentlabs.judgeval.tracer.Tracer

setMessage(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.SavePromptScorerResponse

setModel(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer

setModel(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.ExampleEvaluationRun

setModel(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.TraceEvaluationRun

setModel(String) - Method in class com.judgmentlabs.judgeval.scorers.BaseScorer

setModelClient(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer

setModelClient(Object) - Method in class com.judgmentlabs.judgeval.scorers.BaseScorer

setName(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer

setName(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.Example

setName(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.PromptScorer

setName(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.SavePromptScorerRequest

setName(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.SavePromptScorerResponse

setName(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerConfig

setName(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerData

setName(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerExistsRequest

setName(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScoringResult

setName(String) - Method in class com.judgmentlabs.judgeval.scorers.BaseScorer

setNames(List<String>) - Method in class com.judgmentlabs.judgeval.internal.api.models.FetchPromptScorersRequest

setOptions(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.PromptScorer

setOptions(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.SavePromptScorerRequest

setOptions(Map<String, Double>) - Method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.BasePromptScorer

setOrganizationId(String) - Method in class com.judgmentlabs.judgeval.data.ExampleEvaluationRun

setOrganizationId(String) - Method in class com.judgmentlabs.judgeval.data.TraceEvaluationRun

setOrganizationId(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan

setOutput(PrintStream) - Static method in class com.judgmentlabs.judgeval.utils.Logger

setOutput(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan

setOutput(Object) - Method in class com.judgmentlabs.judgeval.tracer.Tracer

setOutput(Object, Type) - Method in class com.judgmentlabs.judgeval.tracer.Tracer

setParentSpanId(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan

setProjectId(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan

setProjectId(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.ResolveProjectNameResponse

setProjectName(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.EvalResultsFetch

setProjectName(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.ExampleEvaluationRun

setProjectName(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.ResolveProjectNameRequest

setProjectName(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.TraceEvaluationRun

setPrompt(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.PromptScorer

setPrompt(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.SavePromptScorerRequest

setPrompt(String) - Method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.BasePromptScorer

setReason(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer

setReason(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerData

setReason(String) - Method in class com.judgmentlabs.judgeval.scorers.BaseScorer

setRequiredParams(List<String>) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerConfig

setRequiredParams(List<String>) - Method in class com.judgmentlabs.judgeval.scorers.APIScorer

setResourceAttributes(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan

setResults(List<ScoringResult>) - Method in class com.judgmentlabs.judgeval.internal.api.models.EvalResults

setRun(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.EvalResults

setRunDuration(Double) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScoringResult

setScore(Double) - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer

setScore(Double) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerData

setScore(Double) - Method in class com.judgmentlabs.judgeval.scorers.BaseScorer

setScoreBreakdown(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer

setScoreBreakdown(Map<String, Object>) - Method in class com.judgmentlabs.judgeval.scorers.BaseScorer

setScorers(List<PromptScorer>) - Method in class com.judgmentlabs.judgeval.internal.api.models.FetchPromptScorersResponse

setScorersData(List<ScorerData>) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScoringResult

setScoreType(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer

setScoreType(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerConfig

setScoreType(String) - Method in class com.judgmentlabs.judgeval.scorers.BaseScorer

setServerHosted(boolean) - Method in class com.judgmentlabs.judgeval.scorers.BaseScorer

setServerHosted(Boolean) - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer

setServiceName(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan

setSpanAttributes(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan

setSpanId(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan

setSpanKind(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan

setSpanKind(String) - Method in class com.judgmentlabs.judgeval.tracer.Tracer

Sets the span kind attribute on the current span.

setSpanName(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan

setStateAfter(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan

setStateBefore(Object) - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan

setStatusCode(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan

setStatusMessage(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan

setStrictMode(boolean) - Method in class com.judgmentlabs.judgeval.scorers.BaseScorer

setStrictMode(Boolean) - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer

setStrictMode(Boolean) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerConfig

setStrictMode(Boolean) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerData

setSuccess(Boolean) - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer

setSuccess(Boolean) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerData

setSuccess(Boolean) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScoringResult

setSuccess(Boolean) - Method in class com.judgmentlabs.judgeval.scorers.BaseScorer

setThreshold(double) - Method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.BasePromptScorer

setThreshold(double) - Method in class com.judgmentlabs.judgeval.scorers.APIScorer

setThreshold(double) - Method in class com.judgmentlabs.judgeval.scorers.BaseScorer

setThreshold(Double) - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer

setThreshold(Double) - Method in class com.judgmentlabs.judgeval.internal.api.models.PromptScorer

setThreshold(Double) - Method in class com.judgmentlabs.judgeval.internal.api.models.SavePromptScorerRequest

setThreshold(Double) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerConfig

setThreshold(Double) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScorerData

setTimestamp(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan

setToolSpan() - Method in class com.judgmentlabs.judgeval.tracer.Tracer

setTraceAndSpanIds(List<List<Object>>) - Method in class com.judgmentlabs.judgeval.internal.api.models.TraceEvaluationRun

setTraceId(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.ExampleEvaluationRun

setTraceId(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan

setTraceId(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.ScoringResult

setTraceSpanId(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.ExampleEvaluationRun

setTraceState(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan

setUpdatedAt(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.PromptScorer

setUseColor(boolean) - Static method in class com.judgmentlabs.judgeval.utils.Logger

setUser(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer

setUser(String) - Method in class com.judgmentlabs.judgeval.scorers.BaseScorer

setUserId(String) - Method in class com.judgmentlabs.judgeval.internal.api.models.OtelTraceSpan

setUsingNativeModel(Boolean) - Method in class com.judgmentlabs.judgeval.internal.api.models.BaseScorer

setUsingNativeModel(Boolean) - Method in class com.judgmentlabs.judgeval.scorers.BaseScorer

shutdown() - Method in class com.judgmentlabs.judgeval.tracer.exporters.JudgmentSpanExporter

shutdown() - Method in class com.judgmentlabs.judgeval.tracer.exporters.NoOpSpanExporter

strictMode(boolean) - Method in class com.judgmentlabs.judgeval.scorers.APIScorer.Builder

strictMode(Boolean) - Method in class com.judgmentlabs.judgeval.data.ScorerData.Builder

success(Boolean) - Method in class com.judgmentlabs.judgeval.data.ScorerData.Builder

success(Boolean) - Method in class com.judgmentlabs.judgeval.data.ScoringResult.Builder

successCheck() - Method in class com.judgmentlabs.judgeval.scorers.BaseScorer

T

TELEMETRY_SDK_LANGUAGE - Static variable in class com.judgmentlabs.judgeval.tracer.OpenTelemetryKeys.ResourceKeys

TELEMETRY_SDK_NAME - Static variable in class com.judgmentlabs.judgeval.tracer.OpenTelemetryKeys.ResourceKeys

TELEMETRY_SDK_VERSION - Static variable in class com.judgmentlabs.judgeval.tracer.OpenTelemetryKeys.ResourceKeys

threshold(double) - Method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.PromptScorer.Builder

threshold(double) - Method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.TracePromptScorer.Builder

threshold(double) - Method in class com.judgmentlabs.judgeval.scorers.APIScorer.Builder

threshold(Double) - Method in class com.judgmentlabs.judgeval.data.ScorerData.Builder

TOOL_DEPENDENCY - Enum constant in enum class com.judgmentlabs.judgeval.data.APIScorerType

TOOL_ORDER - Enum constant in enum class com.judgmentlabs.judgeval.data.APIScorerType

TOOLS_CALLED - Enum constant in enum class com.judgmentlabs.judgeval.data.Example.ExampleParams

toolsCalled(Object) - Method in class com.judgmentlabs.judgeval.data.Example.Builder

toString() - Method in enum class com.judgmentlabs.judgeval.data.APIScorerType

toString() - Method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.BasePromptScorer

toTransport() - Method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.PromptScorer

toTransport() - Method in class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.TracePromptScorer

toTransport() - Method in class com.judgmentlabs.judgeval.scorers.APIScorer

toTransport() - Method in class com.judgmentlabs.judgeval.scorers.BaseScorer

TRACE_PROMPT_SCORER - Enum constant in enum class com.judgmentlabs.judgeval.data.APIScorerType

traceAndSpanId(String, String) - Method in class com.judgmentlabs.judgeval.data.TraceEvaluationRun.Builder

traceAndSpanIds(List<List<String>>) - Method in class com.judgmentlabs.judgeval.data.TraceEvaluationRun.Builder

TraceEvaluationRun - Class in com.judgmentlabs.judgeval.data

TraceEvaluationRun - Class in com.judgmentlabs.judgeval.internal.api.models

TraceEvaluationRun() - Constructor for class com.judgmentlabs.judgeval.data.TraceEvaluationRun

TraceEvaluationRun() - Constructor for class com.judgmentlabs.judgeval.internal.api.models.TraceEvaluationRun

TraceEvaluationRun(String, String, List<ScorerConfig>, String, String, List<List<String>>) - Constructor for class com.judgmentlabs.judgeval.data.TraceEvaluationRun

TraceEvaluationRun.Builder - Class in com.judgmentlabs.judgeval.data

TracePromptScorer - Class in com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer

TracePromptScorer(String, String, double, Map<String, Double>) - Constructor for class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.TracePromptScorer

TracePromptScorer(String, String, double, Map<String, Double>, String, String) - Constructor for class com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer.TracePromptScorer

TracePromptScorer.Builder - Class in com.judgmentlabs.judgeval.scorers.api_scorers.prompt_scorer

Tracer - Class in com.judgmentlabs.judgeval.tracer

Main tracer class for integrating with Judgment Labs for distributed tracing and evaluation.

Tracer.TracerBuilder - Class in com.judgmentlabs.judgeval.tracer

Builder for creating Tracer instances with custom dependencies.

TracerBuilder() - Constructor for class com.judgmentlabs.judgeval.tracer.Tracer.TracerBuilder

TracerConfiguration - Class in com.judgmentlabs.judgeval.tracer

Configuration for the Judgment Tracer that controls how tracing and evaluation behave.

TracerConfiguration.Builder - Class in com.judgmentlabs.judgeval.tracer

Builder for creating TracerConfiguration instances.

V

valueOf(String) - Static method in enum class com.judgmentlabs.judgeval.data.APIScorerType

Returns the enum constant of this class with the specified name.

valueOf(String) - Static method in enum class com.judgmentlabs.judgeval.data.Example.ExampleParams

Returns the enum constant of this class with the specified name.

valueOf(String) - Static method in enum class com.judgmentlabs.judgeval.utils.Logger.Level

Returns the enum constant of this class with the specified name.

values() - Static method in enum class com.judgmentlabs.judgeval.data.APIScorerType

Returns an array containing the constants of this enum class, in the order they are declared.

values() - Static method in enum class com.judgmentlabs.judgeval.data.Example.ExampleParams

Returns an array containing the constants of this enum class, in the order they are declared.

values() - Static method in enum class com.judgmentlabs.judgeval.utils.Logger.Level

Returns an array containing the constants of this enum class, in the order they are declared.

W

warning(String) - Static method in class com.judgmentlabs.judgeval.utils.Logger

WARNING - Enum constant in enum class com.judgmentlabs.judgeval.utils.Logger.Level

A B C D E F G H I J L M N O P R S T V W
All Classes and Interfaces|All Packages|Constant Field Values|Serialized Form