aboutsummaryrefslogtreecommitdiff
Commit message (Expand)AuthorAgeFilesLines
* ci: fix the invalid filename in gh release commandv0.2.0Onur Gündüz2026-06-301-1/+1
* ci: add version label to release packagesOnur Gündüz2026-06-301-1/+1
* ci: do not include README in release packagesOnur Gündüz2026-06-301-2/+2
* ci: build and publish CUDA releaseOnur Gündüz2026-06-281-0/+19
* ci: add dry run option to workflowOnur Gündüz2026-06-281-0/+13
* ci: remove yyjson from apt install listOnur Gündüz2026-06-281-2/+0
* docs: fix heading sizeOnur Gündüz2026-06-281-1/+1
* docs: update READMEOnur Gündüz2026-06-281-13/+29
* docs: update server README to clarify GPU precision flagsOnur Gündüz2026-06-271-17/+40
* chore: update README.mdOnur Gündüz2026-06-271-11/+16
* chore: update project name in LICENSEOnur Gündüz2026-06-271-1/+1
* server: add README.mdOnur Gündüz2026-06-271-0/+219
* gitignore: add bench folders to ignore listOnur Gündüz2026-06-271-0/+4
* chore: clean up comment formatting and wordingOnur Gündüz2026-06-2796-746/+792
* cuda: skip Qwen flash softmax rescale when running max is stableOnur Gündüz2026-06-261-8/+33
* cuda: load Qwen flash V with ldmatrix.trans instead of gatherOnur Gündüz2026-06-261-35/+83
* build: vendor yyjson 0.12.0 in deps/yyjsonOnur Gündüz2026-06-2510-17/+19361
* cuda: skip O(L^2) score buffer for qwen flash path (enables 32k)Onur Gündüz2026-06-251-1/+7
* cuda: stage compact GQA K/V in qwen attention, halve the expandOnur Gündüz2026-06-251-14/+47
* chore: fix permissions for test scripts and devtoolsOnur Gündüz2026-06-259-0/+0
* chore: run clang-formatOnur Gündüz2026-06-2520-432/+380
* build: update build info and accelerator labelsOnur Gündüz2026-06-255-34/+30
* server: store the Server-Timing header inline in the jobOnur Gündüz2026-06-252-10/+11
* server: encode base64 embeddings directly into the response bufferOnur Gündüz2026-06-255-67/+97
* server: drop the throwaway buffer in the base64 float pathOnur Gündüz2026-06-251-8/+4
* server: remove the dead auth fieldOnur Gündüz2026-06-252-2/+0
* server: move the request body instead of copying itOnur Gündüz2026-06-251-2/+3
* chore: update READMEOnur Gündüz2026-06-251-13/+20
* all: migrate to yyjsonOnur Gündüz2026-06-2519-323/+354
* cuda: skip per-warp future key tiles in causal qwen attentionOnur Gündüz2026-06-251-65/+95
* cuda: double-buffer qwen flash K/V staging with cp.asyncOnur Gündüz2026-06-241-82/+228
* cuda: prefetch bert flash QK ahead of softmax to overlap the tensor coresOnur Gündüz2026-06-241-50/+99
* cuda: read bert flash K directly, drop the shared-memory transposeOnur Gündüz2026-06-241-40/+65
* cuda: broaden bert flash kv pipeline to all flash batchesOnur Gündüz2026-06-241-8/+10
* tokenizer: parse BPE vocab.json with yyjsonOnur Gündüz2026-06-241-127/+25
* api: parse model config with yyjson instead of a substring scannerOnur Gündüz2026-06-241-77/+94
* build: vendor yyjson 0.12.0 as the core JSON libraryOnur Gündüz2026-06-242-0/+6
* tests: cover CUDA reduced-precision stack and add determinism gateOnur Gündüz2026-06-241-25/+45
* cuda: fix bert reduced-precision ffn gate-up output aliasing its inputOnur Gündüz2026-06-241-129/+156
* cuda: pipeline bert flash kv stagingOnur Gündüz2026-06-241-179/+649
* cuda: widen bert flash key tile to 64, hoist q fragmentsOnur Gündüz2026-06-241-100/+146
* cuda: trim bert reduced scratchOnur Gündüz2026-06-241-73/+213
* server: bound merged batches by token budgetOnur Gündüz2026-06-242-6/+46
* server: fix tokenizer data race under concurrencyOnur Gündüz2026-06-243-22/+8
* server: make tokenize/render overlap adaptive, drop env switchesOnur Gündüz2026-06-244-146/+50
* chore: document server diagnostic env switchesOnur Gündüz2026-06-241-0/+12
* server: tokenize requests off the worker threadOnur Gündüz2026-06-243-23/+209
* server: render inline when idle, defer only under backlogOnur Gündüz2026-06-243-6/+35
* server: pack all compatible requests into token-budget batchesOnur Gündüz2026-06-241-20/+46
* server: render embedding responses off workerOnur Gündüz2026-06-236-16/+238