3 commits

Author	SHA1	Message	Date
tobjend	bc7d3b6ca1	perf: iDRegEx opt-in, GBNF newline fix, OverflowError fix ... - iDRegEx now opt-in via --idregex flag (was running on every group, causing 55s+ on Flask alone — src/flask/json took 55s in iDRegEx) - GBNF tokenizer strips newlines from literals (multi-line symbols) - Fix OverflowError: lang_size_score produces huge ints for large disjunctions, format as string not float - Flask: 2.7s (was 55s+), RAGSAK: 13s (was 74s)	2026-07-12 02:52:05 +02:00
tobjend	f57c302c91	fix(gbnf): handle disjunction inside parens and compound repetition ... The GBNF parser now correctly handles SORE's overloaded + operator: - + inside (a+b+c) → alternation (not repetition) - + outside parens → repetition - +? and +* compound operators → normalized to Star Also adds implicit concatenation when LPAREN follows a repetition, so a+(b+c) parses as a+ followed by (b|c). 28 tests pass (13 new disjunction/compound tests). Full suite: 212 passed.	2026-07-12 02:20:58 +02:00
tobjend	011df391c2	feat: implement SORE → GBNF converter ... - Recursive descent parser for SORE syntax (+, ?, *, |, ., parens) - AST intermediate representation (_Literal, _Concat, _Alt, _Plus, _Optional, _Star) - to_gbnf(sore) → full GBNF rule string - to_gbnf_with_rules(sore, name) → named rule for composition - 15 tests covering all SORE operators and nesting patterns	2026-07-12 00:31:47 +02:00