Package dev.dokimos.core

Class BaseEvaluator

java.lang.Object

dev.dokimos.core.BaseEvaluator

All Implemented Interfaces:

Evaluator

Direct Known Subclasses:

ExactMatchEvaluator, FaithfulnessEvaluator, LLMJudgeEvaluator, RegexEvaluator

public abstract class BaseEvaluator
extends Object
implements Evaluator

Base class for implementing concrete evaluators.

Method Summary

Modifier and Type	Method	Description
final EvalResult	evaluate(EvalTestCase testCase)	Evaluates the test case and returns a scored result.
String	name()	Returns the evaluator name.
double	threshold()	Returns the minimum score threshold for success.

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Details

evaluate

public final EvalResult evaluate(EvalTestCase testCase)

Description copied from interface: Evaluator

Evaluates the test case and returns a scored result.

Specified by:

evaluate in interface Evaluator

Parameters:

testCase - the test case to evaluate

Returns:

the evaluation result

name

public String name()

Description copied from interface: Evaluator

Returns the evaluator name.

Specified by:

name in interface Evaluator

Returns:

the evaluator name

threshold

public double threshold()

Description copied from interface: Evaluator

Returns the minimum score threshold for success.

Specified by:

threshold in interface Evaluator

Returns:

the threshold value