aboutsummaryrefslogtreecommitdiff
path: root/qwen_tokenizer.c (follow)
Commit message (Expand)AuthorAgeFilesLines
* chore: move sources to src/ with proper names, drop qwen_ prefixOnur Gündüz2026-06-161-2018/+0
* chore: run clang-formatOnur Gündüz2026-06-151-368/+630
* tests: tokenizer decode/NFC/contraction/loader-edge coverageOnur Gündüz2026-06-141-13/+2
* server: resolve contextual separator from vocab, test contextual pathOnur Gündüz2026-06-141-0/+6
* tokenizer: ASCII class table for pretokenizer codepoint checksOnur Gündüz2026-06-141-9/+19
* tokenizer: integer-pair BPE merging with linked-list symbolsOnur Gündüz2026-06-141-5/+233
* kernels: drop asr_ prefix namingOnur Gündüz2026-06-141-0/+1523