promptlooper/backend/tests
John Lightner bc1d41e3a6 MAESTRO: Implement FormatScorer with json, markdown, length, and structure format checks
Adds format.py scorer supporting four validation modes:
- json: validates parseable JSON
- markdown: checks for headers (0.5) and lists (0.5)
- length: proportional scoring against min/max token bounds
- structure: JSON schema validation via jsonschema library

Includes 38 passing tests covering all format types, edge cases, and async delegation.
2026-04-07 03:00:56 -05:00
..
__init__.py MAESTRO: Create full directory structure with placeholder files 2026-04-07 01:40:27 -05:00
test_adapters_base.py MAESTRO: Implement BaseAdapter abstract class and AdapterResponse dataclass 2026-04-07 02:32:57 -05:00
test_alembic.py MAESTRO: Set up Alembic with initial migration for all 8 ORM models 2026-04-07 01:52:03 -05:00
test_auth.py MAESTRO: Create backend/auth.py with JWT, API key auth, and first-boot setup flow 2026-04-07 01:59:24 -05:00
test_cache.py MAESTRO: Implement ResponseCache layer with SHA-256 config hashing and hit-rate tracking 2026-04-07 02:37:58 -05:00
test_config.py MAESTRO: Create backend/config.py with Pydantic Settings and SQLite/in-process fallback 2026-04-07 01:46:30 -05:00
test_main.py MAESTRO: Create backend/main.py with FastAPI app, CORS, health check, WebSocket, and router mounting 2026-04-07 01:56:40 -05:00
test_models.py MAESTRO: Create backend/models.py with all 8 SQLAlchemy ORM models from spec 2026-04-07 01:49:10 -05:00
test_openai_compat.py MAESTRO: Implement OpenAI-compatible LLM adapter with streaming, retries, and tests 2026-04-07 02:35:52 -05:00
test_routers.py MAESTRO: Scaffold all 8 router stubs in backend/routers/ with 501 placeholder endpoints 2026-04-07 02:01:11 -05:00
test_runner.py MAESTRO: Implement run execution engine with Jinja2 templating, caching, scoring, and event bus 2026-04-07 02:48:20 -05:00
test_schemas.py MAESTRO: Create backend/schemas.py with all Pydantic request/response schemas 2026-04-07 01:54:02 -05:00
test_scorer_base.py MAESTRO: Implement BaseScorer abstract class with sync/async scoring interface 2026-04-07 02:55:05 -05:00
test_scorer_embedding.py MAESTRO: Implement EmbeddingScorer with cosine similarity scoring via OpenAI-compatible embedding API 2026-04-07 02:58:00 -05:00
test_scorer_format.py MAESTRO: Implement FormatScorer with json, markdown, length, and structure format checks 2026-04-07 03:00:56 -05:00
test_stack_integration.py MAESTRO: Add entrypoint migrations, worker config, and stack integration tests 2026-04-07 02:09:56 -05:00
test_sweep.py MAESTRO: Implement sweep orchestration engine with grid, random, and guided sweep types 2026-04-07 02:53:30 -05:00
test_worker.py MAESTRO: Add entrypoint migrations, worker config, and stack integration tests 2026-04-07 02:09:56 -05:00