tobi/grammar-inference-engine
1
0
Fork 0
Code Issues Pull requests 1 Projects Releases Packages Wiki Activity Actions
grammar-inference-engine/experiments/results
History
tobjend 8460c3c862 experiments: round 20 v3 results (decompose default + cap fix) 
v3 runs for RAGSAK/fastapi/zod with decompose default-on and _COUNT_CAP
raised. Updated SUMMARY.md with before/after quality table.
2026-07-13 01:13:48 +02:00
..
round20_ast_verify experiments: round 20 v3 results (decompose default + cap fix) 2026-07-13 01:13:48 +02:00
baseline_package.json experiments: test all context strategies on RAGSAK — behavioral grouping wins 2026-07-11 23:40:21 +02:00
coarsen_coroutines.json feat: 4-codebase evaluation — conventions vs completions tradeoff 2026-07-12 01:14:09 +02:00
coarsen_fastapi.json feat: 4-codebase evaluation — conventions vs completions tradeoff 2026-07-12 01:14:09 +02:00
coarsen_flask.json feat: 4-codebase evaluation — conventions vs completions tradeoff 2026-07-12 01:14:09 +02:00
coarsen_ragsak.json feat: 4-codebase evaluation — conventions vs completions tradeoff 2026-07-12 01:14:09 +02:00
fastapi_gbnf.json feat: grammar_structure_score + min_structure filter 2026-07-12 03:02:50 +02:00
file_path_k1.json experiments: test all context strategies on RAGSAK — behavioral grouping wins 2026-07-11 23:40:21 +02:00
file_path_k2.json experiments: test all context strategies on RAGSAK — behavioral grouping wins 2026-07-11 23:40:21 +02:00
file_path_k3.json experiments: test all context strategies on RAGSAK — behavioral grouping wins 2026-07-11 23:40:21 +02:00
first_k_sym_1.json experiments: test all context strategies on RAGSAK — behavioral grouping wins 2026-07-11 23:40:21 +02:00
first_k_sym_2.json experiments: test all context strategies on RAGSAK — behavioral grouping wins 2026-07-11 23:40:21 +02:00
first_k_sym_3.json experiments: test all context strategies on RAGSAK — behavioral grouping wins 2026-07-11 23:40:21 +02:00
flask_baseline_package.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_file_path_k1.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_file_path_k2.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_file_path_k3.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_first_k_sym_1.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_first_k_sym_2.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_first_k_sym_3.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_gbnf.json feat: grammar_structure_score + min_structure filter 2026-07-12 03:02:50 +02:00
flask_reduce_k1_e01.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_reduce_k1_e02.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_reduce_k1_e03.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_reduce_k1_e04.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_reduce_k1_e005.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_reduce_k1_e015.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_reduce_k2_e01.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_reduce_k2_e02.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_reduce_k2_e03.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_reduce_k2_e04.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_reduce_k2_e005.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_reduce_k2_e015.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_reduce_k3_e01.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_reduce_k3_e02.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_reduce_k3_e03.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_reduce_k3_e04.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_reduce_k3_e005.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_reduce_k3_e015.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_return_type_heuristic.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_summary.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_two_d_p1_s1.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_two_d_p1_s2.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_two_d_p2_s1.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_two_d_p2_s2.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
freq_coroutines.json feat: frequency threshold sweep — 0.01-0.20 across 4 codebases 2026-07-12 01:26:45 +02:00
freq_fastapi.json feat: frequency threshold sweep — 0.01-0.20 across 4 codebases 2026-07-12 01:26:45 +02:00
freq_flask.json feat: frequency threshold sweep — 0.01-0.20 across 4 codebases 2026-07-12 01:26:45 +02:00
freq_ragsak.json feat: frequency threshold sweep — 0.01-0.20 across 4 codebases 2026-07-12 01:26:45 +02:00
ragsak_baseline_package.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_file_path_k1.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_file_path_k2.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_file_path_k3.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_first_k_sym_1.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_first_k_sym_2.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_first_k_sym_3.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_gbnf.json feat: grammar_structure_score + min_structure filter 2026-07-12 03:02:50 +02:00
ragsak_reduce_k1_e01.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_reduce_k1_e02.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_reduce_k1_e03.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_reduce_k1_e04.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_reduce_k1_e005.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_reduce_k1_e015.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_reduce_k2_e01.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_reduce_k2_e02.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_reduce_k2_e03.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_reduce_k2_e04.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_reduce_k2_e005.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_reduce_k2_e015.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_reduce_k3_e01.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_reduce_k3_e02.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_reduce_k3_e03.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_reduce_k3_e04.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_reduce_k3_e005.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_reduce_k3_e015.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_return_type_heuristic.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_summary.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_two_d_p1_s1.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_two_d_p1_s2.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_two_d_p2_s1.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_two_d_p2_s2.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
return_type_heuristic.json experiments: test all context strategies on RAGSAK — behavioral grouping wins 2026-07-11 23:40:21 +02:00
summary.json experiments: test all context strategies on RAGSAK — behavioral grouping wins 2026-07-11 23:40:21 +02:00
two_d_p1_s1.json experiments: test all context strategies on RAGSAK — behavioral grouping wins 2026-07-11 23:40:21 +02:00
two_d_p1_s2.json experiments: test all context strategies on RAGSAK — behavioral grouping wins 2026-07-11 23:40:21 +02:00
two_d_p2_s1.json experiments: test all context strategies on RAGSAK — behavioral grouping wins 2026-07-11 23:40:21 +02:00
two_d_p2_s2.json experiments: test all context strategies on RAGSAK — behavioral grouping wins 2026-07-11 23:40:21 +02:00