bc1d41e3a6
Adds format.py scorer supporting four validation modes: - json: validates parseable JSON - markdown: checks for headers (0.5) and lists (0.5) - length: proportional scoring against min/max token bounds - structure: JSON schema validation via jsonschema library Includes 38 passing tests covering all format types, edge cases, and async delegation.
7 lines
256 B
Python
7 lines
256 B
Python
"""Scorer framework for evaluating LLM outputs."""
|
|
|
|
from engine.scorers.base import BaseScorer
|
|
from engine.scorers.embedding import EmbeddingScorer
|
|
from engine.scorers.format import FormatScorer
|
|
|
|
__all__ = ["BaseScorer", "EmbeddingScorer", "FormatScorer"]
|