3 Commits

Author	SHA1	Message	Date
Mick	c5a4f796a0	Add unlabelled event detection, stub parser quality, Sync All, and modern UI redesign ... Key changes: - Unlabelled event banner: shows count only after Sample Events is clicked; uses broad SDL filter expression; time window synced to sync-days dropdown - Parser Quality: new "Attributes Missing" subsection listing all parsers without dataSource.name regardless of event volume - Coverage map: filter buttons (All / Complete Parser / Attributes Missing); stat card renamed to "Incomplete Parser"; stub count excluded from sync when no active sources - Sync All button: runs SDL parser sync → library sync → live sources sync in sequence - Reset now clears ActiveSource table and resets unlabelled count cache - run_powerquery: configurable max_count param (default 1000, 50M for count queries) - _DS_NAME_RE: supports both quoted and unquoted dataSource.name keys in parser files - Full modern UI redesign: slate palette, gradient cards, ring borders, pill nav, colored stat accents - Updated 7 tracked parser files synced from SDL Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>	2026-05-22 10:00:21 -04:00
marc	8dbd38f3bb	Fix Parser Test Runner JSON mode, Filter Simulator PQ syntax, dropdown source ... - backend/routers/quality.py * Add GET /api/quality/parsers (lists actual files in /app/parsers) * Support SDL JSON auto-extract parsers ($=json{parse=json}$) * Apply parser rewrite blocks with correct $0/$N backref translation * Accept single JSON / JSON array / NDJSON in test-parser body * Flatten JSON inside 'message' for Field Population coverage - backend/routers/ingest.py * Rewrite simulate-filter PowerQuery to valid SDL syntax * Correct field name: src.name -> dataSource.name - frontend/index.html * Parser dropdown loads from /api/quality/parsers * Add 'Last 7d' lookback option * Render JSON-mode test results with badges + payload counter	2026-05-20 19:40:24 +02:00
Mick	999c0f7b83	Add Parser Quality page: Live Event Sampler, Field Population Rate, Parser Test Runner ... - New /api/quality router with three endpoints: sample-events: pull raw events from a source via PowerQuery field-population: measure % of events with each SDL field populated; surfaces dataSource.name correctly (100% when filtered by it) and returns fields_seen_in_sample so you can see what IS being extracted test-parser: converts SDL \$field=pattern\$ format strings to Python named-group regex and tests against a pasted raw log line - New "Parser Quality" nav item and page with all three tools - Home page card added for Parser Quality - Field population UI shows per-field colour-coded progress bars plus a chip list of fields actually present in the sample Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>	2026-05-19 12:53:48 -04:00