xpltdco/chrysopedia
2
0
Fork 0
Code Issues 2 Pull requests Projects Releases Packages Wiki Activity Actions
305 commits 1 branch 0 tags 34 MiB
Commit graph

305 commits

This branch
This branch
All branches
Author SHA1 Message Date
jlightner
59491c7803 feat: Replaced meaningless '0 views' display with topic-category counts… 
- "frontend/src/pages/CreatorDetail.tsx"

GSD-Task: S03/T02
 2026-03-31 05:26:18 +00:00
jlightner
7a3db5212b feat: replace views stat with topic-category breakdown on creator detail page 2026-03-31 05:24:32 +00:00
jlightner
95b11ae5bc feat: Added key_moment_count correlated subquery to technique list API… 
- "backend/schemas.py"
- "backend/routers/techniques.py"
- "frontend/src/api/public-client.ts"
- "frontend/src/pages/Home.tsx"
- "frontend/src/App.css"

GSD-Task: S03/T01
 2026-03-31 05:23:37 +00:00
jlightner
deb060cfa3 feat: Removed yellow semantic-search-unavailable banner from search res… 
- "frontend/src/pages/SearchResults.tsx"
- "frontend/src/App.css"
- "frontend/src/components/AppFooter.tsx"
- "frontend/package.json"

GSD-Task: S02/T02
 2026-03-31 05:14:58 +00:00
jlightner
127919565a feat: Added hidden boolean column to Creator model, migration marking T… 
- "backend/models.py"
- "backend/routers/creators.py"
- "alembic/versions/009_add_creator_hidden_flag.py"

GSD-Task: S02/T01
 2026-03-31 05:13:17 +00:00
jlightner
6d4390414a feat: Key moment search results now link to parent technique page with… 
- "frontend/src/api/public-client.ts"
- "frontend/src/pages/SearchResults.tsx"
- "frontend/src/pages/TechniquePage.tsx"

GSD-Task: S01/T02
 2026-03-31 05:04:05 +00:00
jlightner
af250a6f5d feat: Added technique_page_slug to search results across Qdrant payload… 
- "backend/schemas.py"
- "backend/search_service.py"
- "backend/pipeline/stages.py"
- "backend/pipeline/qdrant_client.py"
- "backend/tests/test_search.py"

GSD-Task: S01/T01
 2026-03-31 05:02:48 +00:00
jlightner
2117687720 feat: add tooltips to Show Payload, System Prompt, User Prompt, and Response in pipeline event log 2026-03-31 03:23:30 +00:00
jlightner
5490999fd1 fix: use gear glyph for LLM call events in pipeline log 2026-03-31 02:56:50 +00:00
jlightner
dc7bb83c9d fix: swap robot emoji for diamond glyph on LLM call events 2026-03-31 02:52:25 +00:00
jlightner
7127237afe fix: drop server_default before dropping enum type in migration 008 2026-03-31 02:46:30 +00:00
jlightner
63225a3559 fix: migration 008 — use text column conversion to avoid PG enum transaction restriction 2026-03-31 02:45:54 +00:00
jlightner
35fc699098 fix: correct PG enum type name in migration 008 — processing_status not processingstatus 2026-03-31 02:45:06 +00:00
jlightner
720c2f501f feat: meaningful pipeline status lifecycle — Not Started → Queued → In Progress → Complete/Errored 
Replace stage-level statuses (pending/transcribed/extracted/published) with
user-meaningful lifecycle states (not_started/queued/processing/error/complete).

Backend:
- ProcessingStatus enum: not_started, queued, processing, error, complete
- run_pipeline sets 'processing' before dispatching Celery chain
- stage5 sets 'complete' (was 'published')
- stage3 no longer sets intermediate status (stays 'processing')
- New mark_pipeline_error task wired as link_error on chain
- _set_error_status helper marks video on permanent failure
- Ingest sets 'queued' (was 'transcribed')
- Migration 008 renames all existing values

Frontend:
- StatusFilter shows fixed-order lifecycle tabs: Not Started | Queued | In Progress | Errored | Complete
- Per-video badges show friendly labels instead of raw enum values
- Badge colors mapped to new statuses
 2026-03-31 02:43:49 +00:00
jlightner
52e7e3bbc2 feat: remove review workflow — unused gate that blocked nothing 
773 key moments sat at 'pending' with 0 approved/edited/rejected.
review_status was never checked by any public-facing query — all content
was always visible regardless of review state.

Removed:
- backend/routers/review.py (10 endpoints)
- backend/tests/test_review.py
- frontend ReviewQueue, MomentDetail pages
- frontend client.ts (review-only API client)
- frontend ModeToggle, StatusBadge components
- Review link from AdminDropdown, Moments link from pipeline rows
- ReviewStatus, PageReviewStatus enums from models
- review_mode config flag
- review_status columns (migration 007)
- ~80 lines of mode-toggle CSS

Pipeline now always sets processing_status to 'published'.
Migration 007 drops columns, enums, and migrates 'reviewed' → 'published'.
 2026-03-31 02:34:12 +00:00
jlightner
1ac3db77a1 feat: add tooltip to Debug Mode toggle explaining its purpose 2026-03-31 02:23:12 +00:00
jlightner
4151e7cd25 feat: deep-link Inspect Pipeline button — auto-expand and scroll to video 
TechniquePage's 'Inspect pipeline' button passes ?video=<id> to AdminPipeline.
Previously the query param was ignored. Now AdminPipeline reads it on mount,
auto-expands the matching video row, and smooth-scrolls it into view.
 2026-03-31 02:16:36 +00:00
jlightner
4b0914b12b fix: restore complete project tree from ub01 canonical state 
Auto-mode commit 7aa33cd accidentally deleted 78 files (14,814 lines) during M005
execution. Subsequent commits rebuilt some frontend files but backend/, alembic/,
tests/, whisper/, docker configs, and prompts were never restored in this repo.

This commit restores the full project tree by syncing from ub01's working directory,
which has all M001-M007 features running in production containers.

Restored: backend/ (config, models, routers, database, redis, search_service, worker),
alembic/ (6 migrations), docker/ (Dockerfiles, nginx, compose), prompts/ (4 stages),
tests/, whisper/, README.md, .env.example, chrysopedia-spec.md
 2026-03-31 02:10:41 +00:00
jlightner
f6dcc80dbf merge: reconcile diverged histories — ub01 working tree is source of truth 
Local auto-mode (M005-M007) and origin/main (M004 manual pushes from ub01) diverged
at e08e8d0. Commit 7aa33cd accidentally deleted 78 project files during auto-mode.
The ub01 working tree has all features running correctly.

This merge uses 'ours' strategy to record origin/main as an ancestor, then the
following commit overlays the correct file state from ub01.
 2026-03-31 02:10:31 +00:00
jlightner
7d4eddce99 chore: auto-commit after complete-milestone 
GSD-Unit: M007
 2026-03-30 19:53:11 +00:00
jlightner
2e2c89ec50 feat: Added flex-wrap, max-width, and tighter mobile gaps to prevent ho… 
- "frontend/src/App.css"

GSD-Task: S06/T01
 2026-03-30 19:48:30 +00:00
jlightner
f2cc72376c feat: Added overflow: hidden, word-break, max-width: 100%, and min-widt… 
- "frontend/src/App.css"

GSD-Task: S05/T01
 2026-03-30 19:41:41 +00:00
jlightner
9dfa568bb3 feat: Pruned dead UI, renamed view toggle to Oldest/Newest first, added… 
- "frontend/src/pages/AdminPipeline.tsx"
- "frontend/src/App.css"

GSD-Task: S04/T02
 2026-03-30 19:36:47 +00:00
jlightner
44c0df6e08 feat: Added DebugModeToggle component and StatusFilter pill bar to Admi… 
- "frontend/src/pages/AdminPipeline.tsx"
- "frontend/src/api/public-client.ts"
- "frontend/src/App.css"

GSD-Task: S04/T01
 2026-03-30 19:34:11 +00:00
jlightner
64ff263da2 docs: Rewrite README with information flow stages and updated architecture 
Replaces outdated README with streamlined version covering all 8 services,
complete API endpoints, 6-stage information flow diagram, and current
project structure.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
 2026-03-30 14:27:02 -05:00
jlightner
97b9f7234a feat: Added chrysopedia-watcher service to Docker Compose, deployed and… 
- "docker-compose.yml"
- ".gsd/milestones/M007/slices/S03/tasks/T02-SUMMARY.md"

GSD-Task: S03/T02
 2026-03-30 19:24:39 +00:00
jlightner
5e408dff5a feat: Built backend/watcher.py with PollingObserver-based folder watchi… 
- "backend/watcher.py"
- "backend/requirements.txt"

GSD-Task: S03/T01
 2026-03-30 19:17:47 +00:00
jlightner
07eaa7f309 feat: Added DebugPayloadViewer component with collapsible System Prompt… 
- "frontend/src/pages/AdminPipeline.tsx"
- "frontend/src/api/public-client.ts"
- "frontend/src/App.css"

GSD-Task: S02/T01
 2026-03-30 19:07:23 +00:00
jlightner
653c927845 feat: DebugPayloadViewer component with copy, export, collapsible sections 2026-03-30 19:01:17 +00:00
jlightner
8c89b5d94c feat: Wired debug-mode-aware LLM I/O capture into pipeline callback — _… 
- "backend/pipeline/stages.py"

GSD-Task: S01/T02
 2026-03-30 18:54:50 +00:00
jlightner
be6b2d5963 feat: Added 3 TEXT columns to pipeline_events (system_prompt_text, user… 
- "backend/models.py"
- "backend/config.py"
- "backend/schemas.py"
- "backend/routers/pipeline.py"
- "alembic/versions/006_debug_columns.py"

GSD-Task: S01/T01
 2026-03-30 18:23:38 +00:00
jlightner
e8bc3fd9a2 feat(whisper): add batch_transcribe.py and document HAL0022 transcription setup 
- batch_transcribe.py: recursive multi-creator transcription runner that
  walks nested subdirectories, attributes creator from top-level folder name,
  writes batch_manifest.json with timing and per-creator results
- README.md: updated with batch mode docs, HAL0022 environment details,
  transcript output location (C:\Users\jlightner\chrysopedia\transcripts),
  scheduled task usage, and transfer instructions for ub01 ingestion
 2026-03-30 11:46:52 -05:00
jlightner
0484c15516 chore: auto-commit after complete-milestone 
GSD-Unit: M006
 2026-03-30 12:13:09 +00:00
jlightner
2e9ef20e24 feat: Updated Dockerfile.web and docker-compose.yml on ub01 to pass VIT… 
- "docker/Dockerfile.web"
- "docker-compose.yml"

GSD-Task: S06/T02
 2026-03-30 12:05:28 +00:00
jlightner
e6ce650487 feat: Added AppFooter component displaying app version, build date, com… 
- "frontend/src/components/AppFooter.tsx"
- "frontend/vite.config.ts"
- "frontend/src/App.tsx"
- "frontend/src/App.css"
- "frontend/src/vite-env.d.ts"

GSD-Task: S06/T01
 2026-03-30 12:00:58 +00:00
jlightner
75332343cb feat: Rewrote TopicsBrowse.tsx from vertical accordion to responsive 2-… 
- "frontend/src/pages/TopicsBrowse.tsx"
- "frontend/src/App.css"

GSD-Task: S05/T02
 2026-03-30 11:48:51 +00:00
jlightner
3f3fe065f8 feat: Added Music Theory as 7th category in canonical_tags.yaml with 8… 
- "config/canonical_tags.yaml"
- "frontend/src/App.css"

GSD-Task: S05/T01
 2026-03-30 11:44:18 +00:00
jlightner
61d52d719e feat: Reordered technique page sidebar (plugins first), added prominent… 
- "frontend/src/pages/TechniquePage.tsx"
- "frontend/src/App.css"

GSD-Task: S04/T01
 2026-03-30 11:34:14 +00:00
jlightner
b4d4caeda6 feat: Added "Commit" row to version metadata panel on TechniquePage — r… 
- "frontend/src/pages/TechniquePage.tsx"

GSD-Task: S03/T02
 2026-03-30 11:25:47 +00:00
jlightner
12f9fb7334 chore: Added GIT_COMMIT_SHA build arg to Dockerfile.api, compose build… 
- "docker/Dockerfile.api"
- "docker-compose.yml"
- "backend/config.py"
- "backend/pipeline/stages.py"

GSD-Task: S03/T01
 2026-03-30 11:24:34 +00:00
jlightner
ee24731e59 feat: Added Head/Tail segmented toggle to EventLog with order param wir… 
- "frontend/src/api/public-client.ts"
- "frontend/src/pages/AdminPipeline.tsx"
- "frontend/src/App.css"

GSD-Task: S02/T02
 2026-03-30 11:15:21 +00:00
jlightner
bf126f4825 feat: Added order query parameter (asc/desc, default desc) to pipelin… 
- "backend/routers/pipeline.py"

GSD-Task: S02/T01
 2026-03-30 11:10:44 +00:00
jlightner
05c7ba3ca2 feat: Created AdminDropdown component with click-outside/Escape close,… 
- "frontend/src/components/AdminDropdown.tsx"
- "frontend/src/App.tsx"
- "frontend/src/App.css"

GSD-Task: S01/T01
 2026-03-30 11:02:23 +00:00
jlightner
08d7d19d0e fix: Nginx resolver for Docker DNS — prevent stale upstream IPs 
Use Docker embedded DNS (127.0.0.11) with 30s TTL and variable-based
proxy_pass so nginx re-resolves the API container IP after recreates
instead of caching the startup IP forever.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
 2026-03-30 05:55:42 -05:00
jlightner
c6f69019cf feat: Content hash dedup and prior-page versioning 
- Add content_hash (SHA-256 of transcript text) to source_videos (migration 005)
- 3-tier duplicate detection at ingest: exact filename, content hash,
  then normalized filename + duration (handles yt-dlp re-downloads)
- Snapshot prior technique_page_ids to Redis before pipeline dispatch
- Stage 5 matches prior pages by creator+category before slug fallback,
  enabling version snapshots on reprocessing even when LLM generates
  different slugs
- Expose content_hash in API responses and admin pipeline dashboard

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
 2026-03-30 05:55:27 -05:00
jlightner
c6c15defee feat: Dynamic token estimation for per-stage max_tokens 
- Add estimate_tokens() and estimate_max_tokens() to llm_client with
  stage-specific output ratios (0.3x segmentation, 1.2x extraction,
  0.15x classification, 1.5x synthesis)
- Add max_tokens override parameter to LLMClient.complete()
- Wire all 4 pipeline stages to estimate max_tokens from actual prompt
  content with 20% buffer and 2048 floor
- Add LLM_MAX_TOKENS_HARD_LIMIT=32768 config (dynamic estimator ceiling)
- Log token estimates alongside every LLM request

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
 2026-03-30 05:55:17 -05:00
jlightner
df33d15360 feat: Pipeline events, admin dashboard, and version switcher UI 
- Add pipeline_events table (migration 004) for structured stage logging
- Add PipelineEvent model with token usage tracking
- Admin pipeline dashboard with video list, event log, worker status,
  trigger/revoke controls, and collapsible JSON payload viewer
- Version switcher on technique pages — view historical snapshots
  with pipeline metadata (model names, prompt hashes)
- Frontend types for pipeline admin and version APIs

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
 2026-03-30 05:55:07 -05:00
jlightner
94460faf9d chore: auto-commit after complete-milestone 
GSD-Unit: M005
 2026-03-30 09:01:54 +00:00
jlightner
c6efec8363 feat: Split key moment card header into standalone h3 title and flex-ro… 
- "frontend/src/pages/TechniquePage.tsx"
- "frontend/src/App.css"

GSD-Task: S03/T01
 2026-03-30 08:55:48 +00:00
jlightner
aa71387ad5 feat: Added CSS grid layout splitting technique page into prose (left)… 
- "frontend/src/App.css"
- "frontend/src/pages/TechniquePage.tsx"

GSD-Task: S02/T01
 2026-03-30 08:47:55 +00:00