# M013: 

## Vision
A fully automated CLI tool that tests FYN-LLM fitness, scores pipeline output across structural, content, voice preservation, readability, and preference dimensions, generates prompt variants, and runs unattended A/B optimization loops — producing reports with winning prompts and score trajectories. Starting with stage 5 synthesis (highest user-visible impact), expanding to all pipeline stages.

## Slice Overview
| ID | Slice | Risk | Depends | Done | After this |
|----|-------|------|---------|------|------------|
| S01 | General FYN-LLM Fitness Suite | medium | — | ✅ | Run `python -m pipeline.quality fitness` — outputs pass/fail for Mandelbrot question, JSON compliance, instruction following, and diverse prompt battery against live FYN-LLM |
| S02 | Stage 5 Quality Scorer & Voice Preservation Dial | high | S01 | ✅ | Run scorer on a reference article — outputs composite score across 5 dimensions. Run same article at voice_level 0.2 vs 0.8 — voice preservation score differs meaningfully |
| S03 | Prompt Variant Generator & Automated A/B Loop | high | S02 | ✅ | Run `python -m pipeline.quality optimize --stage 5 --iterations 10` — generates prompt variants, scores each against reference articles, outputs leaderboard and score trajectory chart |
| S04 | Expand to Pipeline Stages 2-4 | medium | S03 | ✅ | Run `python -m pipeline.quality optimize --stage 3 --iterations 5` — optimizes extraction prompts with stage-appropriate scoring |
