aboutsummaryrefslogtreecommitdiff
path: root/tests/test_tokenizer.c (follow)
Commit message (Expand)AuthorAgeFilesLines
* tests: upgrade unit tests and add integration/parity testsOnur Gündüz2026-06-211-385/+0
* chore: move sources to src/ with proper names, drop qwen_ prefixOnur Gündüz2026-06-161-61/+61
* chore: run clang-formatOnur Gündüz2026-06-151-66/+93
* chore: rename projectOnur Gündüz2026-06-141-1/+1
* tests: tokenizer decode/NFC/contraction/loader-edge coverageOnur Gündüz2026-06-141-0/+213
* tests: drive the HTTP request path in-process in test_serverOnur Gündüz2026-06-141-75/+2
* tokenizer: ASCII class table for pretokenizer codepoint checksOnur Gündüz2026-06-141-0/+32
* tests: hermetic BPE tokenizer test with fast/slow path equalityOnur Gündüz2026-06-141-0/+186