3 commits

Author	SHA1	Message	Date
tobjend	592974f039	feat: structural coarsening experiment — keeps function names raw, coarsens keywords ... - coarsen_token() maps tree-sitter captures to categories (RETURN, IF, LOOP, etc.) - Function calls kept as raw text (they ARE the behavioral content) - Only ~5% structural tokens coarsened - Results: Flask coverage 17.5% -> 28.8% (+11.3%), RAGSAK unchanged (95% calls) - Cross-package shapes emerge: ('IF', 'KW', 'RETURN') in 4 Flask packages	2026-07-12 00:56:09 +02:00
tobjend	b516b2985d	feat: implement Reduce algorithm (Algorithm 4, TODS 2010) ... - bex/reduce.py: Faithful implementation of Reduce with support-weighted SOA edit distance, adjunction, iterative merging, and Minimize - experiments/context_eval.py: Multi-codebase support (RAGSAK + Flask), Reduce experiments with thresholds 0.05-0.4 - tests/test_reduce.py: 24 tests covering all Reduce components - Flask cloned to external_refs/flask for cross-validation Results: - RAGSAK: 12.0% coverage (First 3 symbols) - Flask: 10.7% coverage (First 3 symbols) - Reduce has minimal impact (1-2 merges per codebase at ε=0.3) - Coverage ceiling appears to be ~10-12% for prefix-based grouping	2026-07-12 00:11:38 +02:00
tobjend	bbdfe93679	experiments: test all context strategies on RAGSAK — behavioral grouping wins ... Key findings: - File path grouping (structural) = baseline (0.6% coverage) — no improvement - First-k-symbols grouping (behavioral) = 20× improvement (12% coverage at k=3) - Two-dimensional (path + symbols) = worse than behavioral alone - Winner: Option B k=3 — 47 SOREs, 12% coverage Smart filters make experiments fast (<1s vs minutes): - max_unique_ratio=0.85 - max_alphabet=20 - max_soa_edges=100 Preserved in experiments/results/ for future reference.	2026-07-11 23:40:21 +02:00