aboutsummaryrefslogtreecommitdiff
path: root/tests/test_tokenizer.c (follow)
Commit message (Expand)AuthorAgeFilesLines
* chore: rename projectOnur Gündüz2026-06-141-1/+1
* tests: tokenizer decode/NFC/contraction/loader-edge coverageOnur Gündüz2026-06-141-0/+213
* tests: drive the HTTP request path in-process in test_serverOnur Gündüz2026-06-141-75/+2
* tokenizer: ASCII class table for pretokenizer codepoint checksOnur Gündüz2026-06-141-0/+32
* tests: hermetic BPE tokenizer test with fast/slow path equalityOnur Gündüz2026-06-141-0/+186