tobi/grammar-inference-engine
1
0
Fork 0
Code Issues Pull requests 1 Projects Releases Packages Wiki Activity Actions
grammar-inference-engine/experiments/results
History
tobjend b516b2985d feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 
- bex/reduce.py: Faithful implementation of Reduce with support-weighted
  SOA edit distance, adjunction, iterative merging, and Minimize
- experiments/context_eval.py: Multi-codebase support (RAGSAK + Flask),
  Reduce experiments with thresholds 0.05-0.4
- tests/test_reduce.py: 24 tests covering all Reduce components
- Flask cloned to external_refs/flask for cross-validation

Results:
- RAGSAK: 12.0% coverage (First 3 symbols)
- Flask: 10.7% coverage (First 3 symbols)
- Reduce has minimal impact (1-2 merges per codebase at ε=0.3)
- Coverage ceiling appears to be ~10-12% for prefix-based grouping
2026-07-12 00:11:38 +02:00
..
baseline_package.json experiments: test all context strategies on RAGSAK — behavioral grouping wins 2026-07-11 23:40:21 +02:00
file_path_k1.json experiments: test all context strategies on RAGSAK — behavioral grouping wins 2026-07-11 23:40:21 +02:00
file_path_k2.json experiments: test all context strategies on RAGSAK — behavioral grouping wins 2026-07-11 23:40:21 +02:00
file_path_k3.json experiments: test all context strategies on RAGSAK — behavioral grouping wins 2026-07-11 23:40:21 +02:00
first_k_sym_1.json experiments: test all context strategies on RAGSAK — behavioral grouping wins 2026-07-11 23:40:21 +02:00
first_k_sym_2.json experiments: test all context strategies on RAGSAK — behavioral grouping wins 2026-07-11 23:40:21 +02:00
first_k_sym_3.json experiments: test all context strategies on RAGSAK — behavioral grouping wins 2026-07-11 23:40:21 +02:00
flask_baseline_package.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_file_path_k1.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_file_path_k2.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_file_path_k3.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_first_k_sym_1.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_first_k_sym_2.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_first_k_sym_3.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_reduce_k1_e01.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_reduce_k1_e02.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_reduce_k1_e03.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_reduce_k1_e04.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_reduce_k1_e005.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_reduce_k1_e015.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_reduce_k2_e01.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_reduce_k2_e02.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_reduce_k2_e03.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_reduce_k2_e04.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_reduce_k2_e005.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_reduce_k2_e015.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_reduce_k3_e01.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_reduce_k3_e02.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_reduce_k3_e03.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_reduce_k3_e04.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_reduce_k3_e005.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_reduce_k3_e015.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_return_type_heuristic.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_summary.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_two_d_p1_s1.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_two_d_p1_s2.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_two_d_p2_s1.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_two_d_p2_s2.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_baseline_package.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_file_path_k1.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_file_path_k2.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_file_path_k3.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_first_k_sym_1.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_first_k_sym_2.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_first_k_sym_3.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_reduce_k1_e01.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_reduce_k1_e02.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_reduce_k1_e03.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_reduce_k1_e04.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_reduce_k1_e005.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_reduce_k1_e015.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_reduce_k2_e01.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_reduce_k2_e02.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_reduce_k2_e03.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_reduce_k2_e04.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_reduce_k2_e005.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_reduce_k2_e015.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_reduce_k3_e01.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_reduce_k3_e02.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_reduce_k3_e03.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_reduce_k3_e04.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_reduce_k3_e005.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_reduce_k3_e015.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_return_type_heuristic.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_summary.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_two_d_p1_s1.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_two_d_p1_s2.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_two_d_p2_s1.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_two_d_p2_s2.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
return_type_heuristic.json experiments: test all context strategies on RAGSAK — behavioral grouping wins 2026-07-11 23:40:21 +02:00
summary.json experiments: test all context strategies on RAGSAK — behavioral grouping wins 2026-07-11 23:40:21 +02:00
two_d_p1_s1.json experiments: test all context strategies on RAGSAK — behavioral grouping wins 2026-07-11 23:40:21 +02:00
two_d_p1_s2.json experiments: test all context strategies on RAGSAK — behavioral grouping wins 2026-07-11 23:40:21 +02:00
two_d_p2_s1.json experiments: test all context strategies on RAGSAK — behavioral grouping wins 2026-07-11 23:40:21 +02:00
two_d_p2_s2.json experiments: test all context strategies on RAGSAK — behavioral grouping wins 2026-07-11 23:40:21 +02:00