index
:
ffwd
master
Fastforward embedding inference engine
about
summary
refs
log
tree
commit
diff
log msg
author
committer
range
path:
root
/
libffwd
(
follow
)
Commit message (
Expand
)
Author
Age
Files
Lines
*
cuda: store bert qkv in 16-bit for flash batches
Onur Gündüz
2026-06-23
1
-40
/
+120
*
cuda: fuse bert qkv bias via cublaslt epilogue (f32 output)
Onur Gündüz
2026-06-23
1
-40
/
+59
*
cuda: cache the cublaslt gate-up matmul plan per shape
Onur Gündüz
2026-06-23
1
-77
/
+114
*
cuda: fuse bert gate-up bias+gelu via cublaslt epilogue
Onur Gündüz
2026-06-23
1
-65
/
+225
*
cuda: write bert residual delta 16-bit on the residual16 path
Onur Gündüz
2026-06-23
1
-10
/
+155
*
chore: clang-format libffwd/cuda.cu
Onur Gündüz
2026-06-23
1
-93
/
+92
*
cuda: add bert ffn16 intermediate path
Onur Gündüz
2026-06-23
3
-168
/
+905
*
cuda: auto-enable bert residual16 for long batches
Onur Gündüz
2026-06-23
1
-8
/
+12
*
cuda: gate bert bf16 residual stream
Onur Gündüz
2026-06-23
1
-33
/
+172
*
cuda: store weight dtype per context
Onur Gündüz
2026-06-22
2
-48
/
+58
*
cuda: prune attention experiments
Onur Gündüz
2026-06-22
1
-1330
/
+17
*
cuda: add opt-in BERT flash attention for head_dim 32
Onur Gündüz
2026-06-22
1
-49
/
+66
*
cuda: make bf16 BERT flash attention the default on the head_dim-64 path
Onur Gündüz
2026-06-22
1
-6
/
+9
*
cuda: add gated bf16 flash attention for the BERT shape (head_dim 64)
Onur Gündüz
2026-06-22
1
-6
/
+237
*
cuda: auto-enable bf16-activation BERT path above a token-count gate
Onur Gündüz
2026-06-22
1
-9
/
+18
*
cuda: add gated bf16-activation BERT path
Onur Gündüz
2026-06-22
1
-48
/
+142
*
cuda: prepack streaming K as bf16
Onur Gündüz
2026-06-22
1
-44
/
+65
*
cuda: promote tc3 to the default Qwen bf16 attention path
Onur Gündüz
2026-06-22
1
-16
/
+32
*
cuda: add qwen tc3 ldmatrix attention
Onur Gündüz
2026-06-22
1
-8
/
+460
*
cuda: add K/V-sharing bf16 tensor-core attention (tc2)
Onur Gündüz
2026-06-22
1
-30
/
+227
*
cuda: add qwen bf16 tensor-core flash attention
Onur Gündüz
2026-06-22
1
-4
/
+459
*
cuda: add register-resident streaming attention behind the flag
Onur Gündüz
2026-06-22
1
-4
/
+172
*
cuda: BERT bf16-compute GEMMs skip the f32 weight widen
Onur Gündüz
2026-06-21
1
-6
/
+14
*
cuda: add gated streaming attention prototype
Onur Gündüz
2026-06-21
1
-0
/
+383
*
cuda: fuse BERT elementwise kernels
Onur Gündüz
2026-06-21
1
-73
/
+96
*
cuda: fix bf16 BERT batched-attention buffer-layout mismatch
Onur Gündüz
2026-06-21
1
-4
/
+16
*
cuda: restore embed_tokens member name (build fix)
Onur Gündüz
2026-06-21
1
-6
/
+6
*
chore: clang-format cuda.cu
Onur Gündüz
2026-06-21
1
-39
/
+34
*
all: split Makefile and reorg library/tools
Onur Gündüz
2026-06-21
47
-0
/
+20990