Index

A B C D E F G H I J L M N O P Q R S T V
All Classes and Interfaces|All Packages|Constant Field Values|Serialized Form

A

accept(DatasetSource) - Method in class dev.dokimos.junit5.DatasetArgumentsProvider

ACTUAL_OUTPUT - Enum constant in enum class dev.dokimos.core.EvalTestCaseParam

actualOutput() - Method in record class dev.dokimos.core.EvalTestCase

Gets the primary actual output value.

actualOutput(String) - Method in class dev.dokimos.core.EvalTestCase.Builder

Sets the primary actual output value.

actualOutput(String, Object) - Method in class dev.dokimos.core.EvalTestCase.Builder

Adds an actual output with the given key and value.

actualOutputs() - Method in record class dev.dokimos.core.EvalTestCase

Returns the value of the actualOutputs record component.

actualOutputs() - Method in record class dev.dokimos.core.ItemResult

Returns the value of the actualOutputs record component.

actualOutputs(Map<String, Object>) - Method in class dev.dokimos.core.EvalTestCase.Builder

Adds all entries from the given actual outputs map.

addExample(Example) - Method in class dev.dokimos.core.Dataset.Builder

Adds an example to the dataset.

addExamples(List<Example>) - Method in class dev.dokimos.core.Dataset.Builder

Adds multiple examples to the dataset.

asJudge(ChatModel) - Static method in class dev.dokimos.langchain4j.LangChain4jSupport

Creates a JudgeLM from a LangChain4j ChatModel.

assertEval(EvalTestCase, Evaluator...) - Static method in class dev.dokimos.core.Assertions

Asserts that the test case passes all evaluators.

assertEval(EvalTestCase, List<Evaluator>) - Static method in class dev.dokimos.core.Assertions

Asserts that the test case passes all evaluators.

Assertions - Class in dev.dokimos.core

Assertion utilities for evaluation-based testing.

averageScore(String) - Method in record class dev.dokimos.core.ExperimentResult

Returns the average score for the specified evaluator across all results.

B

BaseEvaluator - Class in dev.dokimos.core

Base class for implementing concrete evaluators.

BasicEvaluationExample - Class in dev.dokimos.examples.basic

This is a basic evaluation example that demonstrates how to: - Create a Dataset programmatically - Define multiple evaluators that we want to run - Create a simple task with an actual LLM by OpenAI - Run an experiment and show the evaluation results

BasicEvaluationExample() - Constructor for class dev.dokimos.examples.basic.BasicEvaluationExample

build() - Method in class dev.dokimos.core.Dataset.Builder

Builds the dataset.

build() - Method in class dev.dokimos.core.EvalResult.Builder

Builds the result.

build() - Method in class dev.dokimos.core.EvalTestCase.Builder

Builds the test case.

build() - Method in class dev.dokimos.core.ExactMatchEvaluator.Builder

build() - Method in class dev.dokimos.core.Example.Builder

build() - Method in class dev.dokimos.core.Experiment.Builder

Builds the experiment.

build() - Method in class dev.dokimos.core.FaithfulnessEvaluator.Builder

build() - Method in class dev.dokimos.core.LLMJudgeEvaluator.Builder

Builds the evaluator.

build() - Method in class dev.dokimos.core.RegexEvaluator.Builder

Builds the evaluator.

builder() - Static method in record class dev.dokimos.core.Dataset

Creates a new builder for constructing datasets.

builder() - Static method in record class dev.dokimos.core.EvalResult

Creates a new builder for constructing results.

builder() - Static method in record class dev.dokimos.core.EvalTestCase

Creates a new builder for constructing test cases.

builder() - Static method in class dev.dokimos.core.ExactMatchEvaluator

Creates a new builder for constructing exact match evaluators.

builder() - Static method in record class dev.dokimos.core.Example

Creates a new builder for constructing examples.

builder() - Static method in class dev.dokimos.core.Experiment

builder() - Static method in class dev.dokimos.core.FaithfulnessEvaluator

Creates a new builder for constructing the faithfulness evaluator.

builder() - Static method in class dev.dokimos.core.LLMJudgeEvaluator

builder() - Static method in class dev.dokimos.core.RegexEvaluator

Builder() - Constructor for class dev.dokimos.core.Dataset.Builder

Builder() - Constructor for class dev.dokimos.core.EvalResult.Builder

Builder() - Constructor for class dev.dokimos.core.EvalTestCase.Builder

Builder() - Constructor for class dev.dokimos.core.ExactMatchEvaluator.Builder

Builder() - Constructor for class dev.dokimos.core.Example.Builder

Builder() - Constructor for class dev.dokimos.core.Experiment.Builder

Builder() - Constructor for class dev.dokimos.core.FaithfulnessEvaluator.Builder

Builder() - Constructor for class dev.dokimos.core.LLMJudgeEvaluator.Builder

Builder() - Constructor for class dev.dokimos.core.RegexEvaluator.Builder

C

ClasspathDatasetResolver - Class in dev.dokimos.core

ClasspathDatasetResolver() - Constructor for class dev.dokimos.core.ClasspathDatasetResolver

CONTEXT_KEY - Static variable in class dev.dokimos.langchain4j.LangChain4jSupport

Default key for additional context in evaluation results.

contextKey(String) - Method in class dev.dokimos.core.FaithfulnessEvaluator.Builder

Sets the context key to use.

criteria(String) - Method in class dev.dokimos.core.LLMJudgeEvaluator.Builder

Sets the evaluation criteria.

CustomEvaluatorExample - Class in dev.dokimos.examples.basic

This example shows two ways to create custom evaluators:

CustomEvaluatorExample() - Constructor for class dev.dokimos.examples.basic.CustomEvaluatorExample

customTask(Task) - Static method in class dev.dokimos.langchain4j.LangChain4jSupport

Creates a flexible Task that allows full control over output mapping.

D

dataset(Dataset) - Method in class dev.dokimos.core.Experiment.Builder

Sets the dataset.

Dataset - Record Class in dev.dokimos.core

A collection of examples for evaluation.

Dataset(String, String, List<Example>) - Constructor for record class dev.dokimos.core.Dataset

Creates an instance of a Dataset record class.

Dataset.Builder - Class in dev.dokimos.core

Builder for constructing datasets.

DatasetArgumentsProvider - Class in dev.dokimos.junit5

JUnit 5 ArgumentsProvider that loads Examples from a Dataset.

DatasetArgumentsProvider() - Constructor for class dev.dokimos.junit5.DatasetArgumentsProvider

DatasetParser - Class in dev.dokimos.core

DatasetResolutionException - Exception Class in dev.dokimos.core

Thrown when a dataset cannot be correctly resolved or loading fails.

DatasetResolutionException(String) - Constructor for exception class dev.dokimos.core.DatasetResolutionException

DatasetResolutionException(String, Throwable) - Constructor for exception class dev.dokimos.core.DatasetResolutionException

DatasetResolver - Interface in dev.dokimos.core

Resolves a dataset URI to a Dataset.

DatasetResolverRegistry - Class in dev.dokimos.core

Singleton registry for dataset resolvers.

DatasetSource - Annotation Interface in dev.dokimos.junit5

Provides Examples from a Dataset as arguments to a parameterized test.

description() - Method in record class dev.dokimos.core.Dataset

Returns the dataset's description.

description() - Method in record class dev.dokimos.core.ExperimentResult

Returns the value of the description record component.

description(String) - Method in class dev.dokimos.core.Dataset.Builder

Sets the dataset description.

description(String) - Method in class dev.dokimos.core.Experiment.Builder

Sets the description.

dev.dokimos.core - package dev.dokimos.core

dev.dokimos.examples.basic - package dev.dokimos.examples.basic

dev.dokimos.examples.junit5 - package dev.dokimos.examples.junit5

dev.dokimos.examples.langchain4j - package dev.dokimos.examples.langchain4j

dev.dokimos.junit5 - package dev.dokimos.junit5

dev.dokimos.langchain4j - package dev.dokimos.langchain4j

E

equals(Object) - Method in record class dev.dokimos.core.Dataset

Indicates whether some other object is "equal to" this one.

equals(Object) - Method in record class dev.dokimos.core.EvalResult

Indicates whether some other object is "equal to" this one.

equals(Object) - Method in record class dev.dokimos.core.EvalTestCase

Indicates whether some other object is "equal to" this one.

equals(Object) - Method in record class dev.dokimos.core.Example

Indicates whether some other object is "equal to" this one.

equals(Object) - Method in record class dev.dokimos.core.ExperimentResult

Indicates whether some other object is "equal to" this one.

equals(Object) - Method in record class dev.dokimos.core.ItemResult

Indicates whether some other object is "equal to" this one.

EvalResult - Record Class in dev.dokimos.core

The result of an evaluation.

EvalResult(String, double, boolean, String, Map<String, Object>) - Constructor for record class dev.dokimos.core.EvalResult

Creates an instance of a EvalResult record class.

EvalResult.Builder - Class in dev.dokimos.core

Builder for constructing evaluation results.

evalResults() - Method in record class dev.dokimos.core.ItemResult

Returns the value of the evalResults record component.

EvalTestCase - Record Class in dev.dokimos.core

A test case for evaluation.

EvalTestCase(Map<String, Object>, Map<String, Object>, Map<String, Object>, Map<String, Object>) - Constructor for record class dev.dokimos.core.EvalTestCase

Creates an instance of a EvalTestCase record class.

EvalTestCase.Builder - Class in dev.dokimos.core

Builder for constructing test cases with multiple inputs and outputs.

EvalTestCaseParam - Enum Class in dev.dokimos.core

evaluate(EvalTestCase) - Method in class dev.dokimos.core.BaseEvaluator

evaluate(EvalTestCase) - Method in interface dev.dokimos.core.Evaluator

Evaluates the test case and returns a scored result.

EvaluationException - Exception Class in dev.dokimos.core

Thrown when an evaluation cannot be executed successfully.

EvaluationException(String) - Constructor for exception class dev.dokimos.core.EvaluationException

EvaluationException(String, Throwable) - Constructor for exception class dev.dokimos.core.EvaluationException

evaluationParams(List<EvalTestCaseParam>) - Method in class dev.dokimos.core.ExactMatchEvaluator.Builder

Sets which test case parameters to use for the evaluation.

evaluationParams(List<EvalTestCaseParam>) - Method in class dev.dokimos.core.FaithfulnessEvaluator.Builder

Sets which test case parameters to use for the evaluation.

evaluationParams(List<EvalTestCaseParam>) - Method in class dev.dokimos.core.LLMJudgeEvaluator.Builder

Sets which test case parameters to include in the prompt.

evaluationParams(List<EvalTestCaseParam>) - Method in class dev.dokimos.core.RegexEvaluator.Builder

Sets which test case parameters to evaluate.

evaluator(Evaluator) - Method in class dev.dokimos.core.Experiment.Builder

Adds a single evaluator to the experiment.

Evaluator - Interface in dev.dokimos.core

Evaluates test cases and produces scored results.

evaluators(List<Evaluator>) - Method in class dev.dokimos.core.Experiment.Builder

Adds multiple evaluators to the experiment.

ExactMatchEvaluator - Class in dev.dokimos.core

Evaluator that checks for exact string match between actual and expected outputs.

ExactMatchEvaluator.Builder - Class in dev.dokimos.core

example() - Method in record class dev.dokimos.core.ItemResult

Returns the value of the example record component.

Example - Record Class in dev.dokimos.core

A dataset example with inputs, expected outputs, and metadata.

Example(Map<String, Object>, Map<String, Object>, Map<String, Object>) - Constructor for record class dev.dokimos.core.Example

Compact constructor that creates immutable copies of all maps.

Example.Builder - Class in dev.dokimos.core

Builder for constructing examples with multiple inputs and outputs.

examples() - Method in record class dev.dokimos.core.Dataset

Returns the examples in the dataset.

EXPECTED_OUTPUT - Enum constant in enum class dev.dokimos.core.EvalTestCaseParam

expectedOutput() - Method in record class dev.dokimos.core.EvalTestCase

Gets the primary expected output value.

expectedOutput() - Method in record class dev.dokimos.core.Example

Returns the primary expected output value.

expectedOutput(String) - Method in class dev.dokimos.core.EvalTestCase.Builder

Sets the primary expected output value.

expectedOutput(String, Object) - Method in class dev.dokimos.core.EvalTestCase.Builder

Adds an expected output with the given key and value.

expectedOutput(String, Object) - Method in class dev.dokimos.core.Example.Builder

Adds an expected output with the given key and value.

expectedOutputs() - Method in record class dev.dokimos.core.EvalTestCase

Returns the value of the expectedOutputs record component.

expectedOutputs() - Method in record class dev.dokimos.core.Example

Returns the value of the expectedOutputs record component.

expectedOutputs(Map<String, Object>) - Method in class dev.dokimos.core.EvalTestCase.Builder

Adds all entries from the given expected outputs map.

expectedOutputs(Map<String, Object>) - Method in class dev.dokimos.core.Example.Builder

Adds all entries from the given expected outputs map.

Experiment - Class in dev.dokimos.core

An evaluation experiment that runs a task against a dataset and evaluates the results.

Experiment.Builder - Class in dev.dokimos.core

ExperimentResult - Record Class in dev.dokimos.core

Aggregated results from an experiment run.

ExperimentResult(String, String, Map<String, Object>, List<ItemResult>) - Constructor for record class dev.dokimos.core.ExperimentResult

Creates an instance of a ExperimentResult record class.

extractTexts(List<Content>) - Static method in class dev.dokimos.langchain4j.LangChain4jSupport

Extracts text content from a list of LangChain4j Content objects.

extractTextsWithMetadata(List<Content>) - Static method in class dev.dokimos.langchain4j.LangChain4jSupport

Extracts text content with metadata from a list of LangChain4j Content objects.

F

failCount() - Method in record class dev.dokimos.core.ExperimentResult

Returns the number of items that failed at least one evaluation.

failure(String, double, String) - Static method in record class dev.dokimos.core.EvalResult

Creates a failed result.

FaithfulnessEvaluator - Class in dev.dokimos.core

Evaluator that uses an LLM to check how much of the actual output is backed by the given context.

FaithfulnessEvaluator.Builder - Class in dev.dokimos.core

FileDatasetResolver - Class in dev.dokimos.core

Resolves datasets from the filesystem.

FileDatasetResolver() - Constructor for class dev.dokimos.core.FileDatasetResolver

fromCsv(String, String) - Static method in record class dev.dokimos.core.Dataset

Parses a dataset from a CSV string.

fromCsv(Path) - Static method in record class dev.dokimos.core.Dataset

Loads a dataset from a CSV file.

fromJson(String) - Static method in record class dev.dokimos.core.Dataset

Parses a dataset from a JSON string.

fromJson(Path) - Static method in record class dev.dokimos.core.Dataset

Loads a dataset from a JSON file.

G

generate(String) - Method in interface dev.dokimos.core.JudgeLM

get(int) - Method in record class dev.dokimos.core.Dataset

Returns the example at the specified index.

getInstance() - Static method in class dev.dokimos.core.DatasetResolverRegistry

Returns the singleton registry instance.

H

hashCode() - Method in record class dev.dokimos.core.Dataset

Returns a hash code value for this object.

hashCode() - Method in record class dev.dokimos.core.EvalResult

Returns a hash code value for this object.

hashCode() - Method in record class dev.dokimos.core.EvalTestCase

Returns a hash code value for this object.

hashCode() - Method in record class dev.dokimos.core.Example

Returns a hash code value for this object.

hashCode() - Method in record class dev.dokimos.core.ExperimentResult

Returns a hash code value for this object.

hashCode() - Method in record class dev.dokimos.core.ItemResult

Returns a hash code value for this object.

I

ignoreCase(boolean) - Method in class dev.dokimos.core.RegexEvaluator.Builder

Sets whether to ignore case when matching.

includeReason(boolean) - Method in class dev.dokimos.core.FaithfulnessEvaluator.Builder

Sets the flag whether to provide a reason or not.

input() - Method in record class dev.dokimos.core.EvalTestCase

Gets the primary input value.

input() - Method in record class dev.dokimos.core.Example

Returns the primary input value.

input(String) - Method in class dev.dokimos.core.EvalTestCase.Builder

Sets the primary input value.

input(String, Object) - Method in class dev.dokimos.core.EvalTestCase.Builder

Adds an input with the given key and value.

input(String, Object) - Method in class dev.dokimos.core.Example.Builder

Adds an input with the given key and value.

INPUT - Enum constant in enum class dev.dokimos.core.EvalTestCaseParam

INPUT_KEY - Static variable in class dev.dokimos.langchain4j.LangChain4jSupport

Default key for reading input from dataset examples.

inputs() - Method in record class dev.dokimos.core.EvalTestCase

Returns the value of the inputs record component.

inputs() - Method in record class dev.dokimos.core.Example

Returns the value of the inputs record component.

inputs(Map<String, Object>) - Method in class dev.dokimos.core.EvalTestCase.Builder

Adds all entries from the given inputs map.

inputs(Map<String, Object>) - Method in class dev.dokimos.core.Example.Builder

Adds all entries from the given inputs map.

ItemResult - Record Class in dev.dokimos.core

ItemResult(Example, Map<String, Object>, List<EvalResult>) - Constructor for record class dev.dokimos.core.ItemResult

Creates an instance of a ItemResult record class.

itemResults() - Method in record class dev.dokimos.core.ExperimentResult

Returns the value of the itemResults record component.

iterator() - Method in record class dev.dokimos.core.Dataset

J

json() - Element in annotation interface dev.dokimos.junit5.DatasetSource

Inline JSON dataset.

judge(JudgeLM) - Method in class dev.dokimos.core.FaithfulnessEvaluator.Builder

Sets the model to use for the evaluation.

judge(JudgeLM) - Method in class dev.dokimos.core.LLMJudgeEvaluator.Builder

Sets the model to use for the evaluation.

JudgeLM - Interface in dev.dokimos.core

A language model used for evaluation.

L

LangChain4jRAGExample - Class in dev.dokimos.examples.langchain4j

Simple RAG evaluation example using LangChain4j with local embeddings.

LangChain4jRAGExample() - Constructor for class dev.dokimos.examples.langchain4j.LangChain4jRAGExample

LangChain4jSupport - Class in dev.dokimos.langchain4j

Utilities for integrating with LangChain4j.

LLMJudgeEvaluator - Class in dev.dokimos.core

Evaluator that uses an LLM to evaluate outputs based on the specified criteria.

LLMJudgeEvaluator.Builder - Class in dev.dokimos.core

M

main(String[]) - Static method in class dev.dokimos.examples.basic.BasicEvaluationExample

main(String[]) - Static method in class dev.dokimos.examples.basic.CustomEvaluatorExample

main(String[]) - Static method in class dev.dokimos.examples.langchain4j.LangChain4jRAGExample

metadata() - Method in record class dev.dokimos.core.EvalResult

Returns the value of the metadata record component.

metadata() - Method in record class dev.dokimos.core.EvalTestCase

Returns the value of the metadata record component.

metadata() - Method in record class dev.dokimos.core.Example

Returns the value of the metadata record component.

metadata() - Method in record class dev.dokimos.core.ExperimentResult

Returns the value of the metadata record component.

metadata(String, Object) - Method in class dev.dokimos.core.EvalTestCase.Builder

Adds metadata with the given key and value.

metadata(String, Object) - Method in class dev.dokimos.core.Example.Builder

Adds metadata with the given key and value.

metadata(String, Object) - Method in class dev.dokimos.core.Experiment.Builder

Adds a metadata entry to the experiment.

metadata(Map<String, Object>) - Method in class dev.dokimos.core.EvalResult.Builder

Sets the metadata.

metadata(Map<String, Object>) - Method in class dev.dokimos.core.EvalTestCase.Builder

Adds all entries from the given metadata map.

metadata(Map<String, Object>) - Method in class dev.dokimos.core.Example.Builder

Adds all entries from the given metadata map.

metadata(Map<String, Object>) - Method in class dev.dokimos.core.Experiment.Builder

Adds multiple metadata entries to the experiment.

N

name() - Method in class dev.dokimos.core.BaseEvaluator

name() - Method in record class dev.dokimos.core.Dataset

Returns the dataset's name.

name() - Method in record class dev.dokimos.core.EvalResult

Returns the value of the name record component.

name() - Method in interface dev.dokimos.core.Evaluator

Returns the evaluator name.

name() - Method in record class dev.dokimos.core.ExperimentResult

Returns the value of the name record component.

name(String) - Method in class dev.dokimos.core.Dataset.Builder

Sets the dataset name.

name(String) - Method in class dev.dokimos.core.EvalResult.Builder

Sets the evaluator name.

name(String) - Method in class dev.dokimos.core.ExactMatchEvaluator.Builder

Sets the evaluator name.

name(String) - Method in class dev.dokimos.core.Experiment.Builder

Sets the experiment name.

name(String) - Method in class dev.dokimos.core.FaithfulnessEvaluator.Builder

Sets the evaluator name.

name(String) - Method in class dev.dokimos.core.LLMJudgeEvaluator.Builder

Sets the evaluator name.

name(String) - Method in class dev.dokimos.core.RegexEvaluator.Builder

Sets the evaluator name.

O

of(String, double, double, String) - Static method in record class dev.dokimos.core.EvalResult

Creates a result by comparing the score against a threshold.

of(String, String) - Static method in record class dev.dokimos.core.EvalTestCase

Creates a test case with a single input and actual output.

of(String, String) - Static method in record class dev.dokimos.core.Example

Creates an example with a single input and expected output.

of(String, String, String) - Static method in record class dev.dokimos.core.EvalTestCase

Creates a test case with input, actual output, and expected output.

OUTPUT_KEY - Static variable in class dev.dokimos.langchain4j.LangChain4jSupport

Default key for the model output in evaluation results.

P

parseCsv(String, String) - Static method in class dev.dokimos.core.DatasetParser

parseCsv(String, String, char) - Static method in class dev.dokimos.core.DatasetParser

parseJson(String) - Static method in class dev.dokimos.core.DatasetParser

passCount() - Method in record class dev.dokimos.core.ExperimentResult

Returns the number of items that passed all evaluations.

passRate() - Method in record class dev.dokimos.core.ExperimentResult

Returns the proportion of items that passed.

pattern(String) - Method in class dev.dokimos.core.RegexEvaluator.Builder

Sets the regular expression pattern.

provideArguments(ExtensionContext) - Method in class dev.dokimos.junit5.DatasetArgumentsProvider

Q

QuestionAnsweringTest - Class in dev.dokimos.examples.junit5

QuestionAnsweringTest() - Constructor for class dev.dokimos.examples.junit5.QuestionAnsweringTest

R

RAG Evaluation - Search tag in class dev.dokimos.langchain4j.LangChain4jSupport

Section

ragTask(Function<String, Result<String>>) - Static method in class dev.dokimos.langchain4j.LangChain4jSupport

Creates a RAG evaluation Task from a function that returns Result.

ragTask(Function<String, Result<String>>, String, String, String) - Static method in class dev.dokimos.langchain4j.LangChain4jSupport

Creates a RAG evaluation Task with custom key names.

reason() - Method in record class dev.dokimos.core.EvalResult

Returns the value of the reason record component.

reason(String) - Method in class dev.dokimos.core.EvalResult.Builder

Sets the reason or explanation.

RegexEvaluator - Class in dev.dokimos.core

Evaluator that checks if the actual output matches a regular expression pattern.

RegexEvaluator.Builder - Class in dev.dokimos.core

register(DatasetResolver) - Method in class dev.dokimos.core.DatasetResolverRegistry

Registers a custom resolver with the highest priority.

resolve(String) - Method in class dev.dokimos.core.ClasspathDatasetResolver

resolve(String) - Method in interface dev.dokimos.core.DatasetResolver

Resolve the URI to a Dataset.

resolve(String) - Method in class dev.dokimos.core.DatasetResolverRegistry

Resolves a URI to a dataset using the first matching resolver.

resolve(String) - Method in class dev.dokimos.core.FileDatasetResolver

run() - Method in class dev.dokimos.core.Experiment

Runs the experiment and returns the aggregated results.

run(Example) - Method in interface dev.dokimos.core.Task

Run the task on the given Example and produce outputs.

S

score() - Method in record class dev.dokimos.core.EvalResult

Returns the value of the score record component.

score(double) - Method in class dev.dokimos.core.EvalResult.Builder

Sets the numeric score.

scoreRange(double, double) - Method in class dev.dokimos.core.LLMJudgeEvaluator.Builder

Sets the expected score range for the LLM response.

simpleTask(ChatModel) - Static method in class dev.dokimos.langchain4j.LangChain4jSupport

Creates a simple Task for Q&A evaluation.

size() - Method in record class dev.dokimos.core.Dataset

Returns the number of examples in the dataset.

success() - Method in record class dev.dokimos.core.EvalResult

Returns the value of the success record component.

success() - Method in record class dev.dokimos.core.ItemResult

success(String, double, String) - Static method in record class dev.dokimos.core.EvalResult

Creates a successful result.

supports(String) - Method in class dev.dokimos.core.ClasspathDatasetResolver

supports(String) - Method in interface dev.dokimos.core.DatasetResolver

Check if this resolver supports the given URI.

supports(String) - Method in class dev.dokimos.core.FileDatasetResolver

T

task(Task) - Method in class dev.dokimos.core.Experiment.Builder

Sets the task.

Task - Interface in dev.dokimos.core

threshold() - Method in class dev.dokimos.core.BaseEvaluator

threshold() - Method in interface dev.dokimos.core.Evaluator

Returns the minimum score threshold for success.

threshold(double) - Method in class dev.dokimos.core.EvalResult.Builder

Sets the success threshold.

threshold(double) - Method in class dev.dokimos.core.ExactMatchEvaluator.Builder

Sets the minimum score threshold for success.

threshold(double) - Method in class dev.dokimos.core.FaithfulnessEvaluator.Builder

Sets the minimum score threshold for success.

threshold(double) - Method in class dev.dokimos.core.LLMJudgeEvaluator.Builder

Sets the minimum score threshold for success.

threshold(double) - Method in class dev.dokimos.core.RegexEvaluator.Builder

Sets the minimum score threshold for success.

toString() - Method in record class dev.dokimos.core.Dataset

Returns a string representation of this record class.

toString() - Method in record class dev.dokimos.core.EvalResult

Returns a string representation of this record class.

toString() - Method in record class dev.dokimos.core.EvalTestCase

Returns a string representation of this record class.

toString() - Method in record class dev.dokimos.core.Example

Returns a string representation of this record class.

toString() - Method in record class dev.dokimos.core.ExperimentResult

Returns a string representation of this record class.

toString() - Method in record class dev.dokimos.core.ItemResult

Returns a string representation of this record class.

totalCount() - Method in record class dev.dokimos.core.ExperimentResult

Returns the total number of items evaluated.

toTestCase() - Method in record class dev.dokimos.core.ItemResult

toTestCase(String) - Method in record class dev.dokimos.core.Example

Converts this example to a test case with a single actual output.

toTestCase(Map<String, Object>) - Method in record class dev.dokimos.core.Example

Converts this example to a test case with the given actual outputs.

V

value() - Element in annotation interface dev.dokimos.junit5.DatasetSource

URI of the dataset to load.

valueOf(String) - Static method in enum class dev.dokimos.core.EvalTestCaseParam

Returns the enum constant of this class with the specified name.

values() - Static method in enum class dev.dokimos.core.EvalTestCaseParam

Returns an array containing the constants of this enum class, in the order they are declared.

A B C D E F G H I J L M N O P Q R S T V
All Classes and Interfaces|All Packages|Constant Field Values|Serialized Form