tobi/grammar-inference-engine
1
0
Fork 0
Code Issues Pull requests 1 Projects Releases Packages Wiki Activity Actions
grammar-inference-engine/experiments/results
History
Exact
tobjend becbd82c56
Some checks failed
ci/woodpecker/push/woodpecker Pipeline failed
Details
ci/woodpecker/pr/woodpecker Pipeline failed
Details
feat: add post-hoc noise filtering for grammars 
- Add filter_noise() to remove test/stdlib tokens from AST
- Add grammar_noise_ratio() to calculate noise fraction
- Integrate into _build_json_output() and _build_yaml_output()
- Precision improvement: 28-55% → 84-94% across all 3 codebases
- Grammar count unchanged (233) — filtering is post-hoc, preserves recall
2026-07-13 02:23:37 +02:00
..
round20_ast_verify feat: enable idregex_refine by default + AST rewrite of _count_optionals 2026-07-13 01:13:49 +02:00
round21_loosened_filtering feat: add post-hoc noise filtering for grammars 2026-07-13 02:23:37 +02:00
round22_noise_filtering feat: add post-hoc noise filtering for grammars 2026-07-13 02:23:37 +02:00
baseline_package.json experiments: test all context strategies on RAGSAK — behavioral grouping wins 2026-07-11 23:40:21 +02:00
coarsen_coroutines.json feat: 4-codebase evaluation — conventions vs completions tradeoff 2026-07-12 01:14:09 +02:00
coarsen_fastapi.json feat: 4-codebase evaluation — conventions vs completions tradeoff 2026-07-12 01:14:09 +02:00
coarsen_flask.json feat: 4-codebase evaluation — conventions vs completions tradeoff 2026-07-12 01:14:09 +02:00
coarsen_ragsak.json feat: 4-codebase evaluation — conventions vs completions tradeoff 2026-07-12 01:14:09 +02:00
fastapi_gbnf.json feat: grammar_structure_score + min_structure filter 2026-07-12 03:02:50 +02:00
file_path_k1.json experiments: test all context strategies on RAGSAK — behavioral grouping wins 2026-07-11 23:40:21 +02:00
file_path_k2.json experiments: test all context strategies on RAGSAK — behavioral grouping wins 2026-07-11 23:40:21 +02:00
file_path_k3.json experiments: test all context strategies on RAGSAK — behavioral grouping wins 2026-07-11 23:40:21 +02:00
first_k_sym_1.json experiments: test all context strategies on RAGSAK — behavioral grouping wins 2026-07-11 23:40:21 +02:00
first_k_sym_2.json experiments: test all context strategies on RAGSAK — behavioral grouping wins 2026-07-11 23:40:21 +02:00
first_k_sym_3.json experiments: test all context strategies on RAGSAK — behavioral grouping wins 2026-07-11 23:40:21 +02:00
flask_baseline_package.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_file_path_k1.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_file_path_k2.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_file_path_k3.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_first_k_sym_1.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_first_k_sym_2.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_first_k_sym_3.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_gbnf.json feat: grammar_structure_score + min_structure filter 2026-07-12 03:02:50 +02:00
flask_reduce_k1_e01.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_reduce_k1_e02.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_reduce_k1_e03.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_reduce_k1_e04.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_reduce_k1_e005.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_reduce_k1_e015.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_reduce_k2_e01.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_reduce_k2_e02.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_reduce_k2_e03.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_reduce_k2_e04.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_reduce_k2_e005.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_reduce_k2_e015.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_reduce_k3_e01.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_reduce_k3_e02.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_reduce_k3_e03.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_reduce_k3_e04.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_reduce_k3_e005.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_reduce_k3_e015.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_return_type_heuristic.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_summary.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_two_d_p1_s1.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_two_d_p1_s2.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_two_d_p2_s1.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
flask_two_d_p2_s2.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
freq_coroutines.json feat: frequency threshold sweep — 0.01-0.20 across 4 codebases 2026-07-12 01:26:45 +02:00
freq_fastapi.json feat: frequency threshold sweep — 0.01-0.20 across 4 codebases 2026-07-12 01:26:45 +02:00
freq_flask.json feat: frequency threshold sweep — 0.01-0.20 across 4 codebases 2026-07-12 01:26:45 +02:00
freq_ragsak.json feat: frequency threshold sweep — 0.01-0.20 across 4 codebases 2026-07-12 01:26:45 +02:00
ragsak_baseline_package.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_file_path_k1.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_file_path_k2.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_file_path_k3.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_first_k_sym_1.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_first_k_sym_2.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_first_k_sym_3.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_gbnf.json feat: grammar_structure_score + min_structure filter 2026-07-12 03:02:50 +02:00
ragsak_reduce_k1_e01.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_reduce_k1_e02.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_reduce_k1_e03.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_reduce_k1_e04.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_reduce_k1_e005.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_reduce_k1_e015.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_reduce_k2_e01.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_reduce_k2_e02.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_reduce_k2_e03.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_reduce_k2_e04.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_reduce_k2_e005.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_reduce_k2_e015.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_reduce_k3_e01.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_reduce_k3_e02.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_reduce_k3_e03.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_reduce_k3_e04.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_reduce_k3_e005.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_reduce_k3_e015.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_return_type_heuristic.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_summary.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_two_d_p1_s1.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_two_d_p1_s2.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_two_d_p2_s1.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
ragsak_two_d_p2_s2.json feat: implement Reduce algorithm (Algorithm 4, TODS 2010) 2026-07-12 00:11:38 +02:00
return_type_heuristic.json experiments: test all context strategies on RAGSAK — behavioral grouping wins 2026-07-11 23:40:21 +02:00
summary.json experiments: test all context strategies on RAGSAK — behavioral grouping wins 2026-07-11 23:40:21 +02:00
two_d_p1_s1.json experiments: test all context strategies on RAGSAK — behavioral grouping wins 2026-07-11 23:40:21 +02:00
two_d_p1_s2.json experiments: test all context strategies on RAGSAK — behavioral grouping wins 2026-07-11 23:40:21 +02:00
two_d_p2_s1.json experiments: test all context strategies on RAGSAK — behavioral grouping wins 2026-07-11 23:40:21 +02:00
two_d_p2_s2.json experiments: test all context strategies on RAGSAK — behavioral grouping wins 2026-07-11 23:40:21 +02:00