index
:
ffwd
master
Fastforward embedding inference engine
about
summary
refs
log
tree
commit
diff
log msg
author
committer
range
path:
root
/
pplx_embed_cuda.cu
(
follow
)
Commit message (
Expand
)
Author
Age
Files
Lines
*
gitignore: track new binary and library names
Onur Gündüz
2026-06-14
1
-1204
/
+0
*
cli: rename flags, add --stream, split serving into pplx-embed-server
Onur Gündüz
2026-06-14
1
-2
/
+2
*
cuda: store BF16 activations directly in norm and SiLU kernels
Onur Gündüz
2026-06-14
1
-51
/
+114
*
cuda: add optional BF16 CUDA weight storage (--cuda-weights bf16)
Onur Gündüz
2026-06-14
1
-68
/
+131
*
cuda: unify attention on one path; drop the max_seq>=64 dispatch
Onur Gündüz
2026-06-14
1
-73
/
+8
*
cuda: add fast GEMM mode (--cuda-fast-gemm mode)
Onur Gündüz
2026-06-14
1
-17
/
+75
*
cuda: clarify comment gemm_compute
Onur Gündüz
2026-06-14
1
-2
/
+3
*
cuda: add opt-in BF16 tensor-core GEMM mode
Onur Gündüz
2026-06-14
1
-21
/
+34
*
cuda: replace long-seq attention with cuBLAS GEMM attention
Onur Gündüz
2026-06-14
1
-158
/
+124
*
cuda: replace tiled attention with warp-per-query reduction
Onur Gündüz
2026-06-14
1
-98
/
+105
*
cuda: extend tiled attention to ragged micro-batches
Onur Gündüz
2026-06-14
1
-3
/
+105
*
cuda: add tiled single attention
Onur Gündüz
2026-06-14
1
-4
/
+64
*
cuda: optimize rmsnorm reduction
Onur Gündüz
2026-06-14
1
-34
/
+29
*
cuda: add server contextual path
Onur Gündüz
2026-06-14
1
-14
/
+159
*
cuda: optimize projection path
Onur Gündüz
2026-06-14
1
-87
/
+118
*
cuda: fuse qkv projection
Onur Gündüz
2026-06-14
1
-44
/
+78
*
cuda: accumulate residual projections
Onur Gündüz
2026-06-14
1
-21
/
+18
*
cuda: optimize attention baseline
Onur Gündüz
2026-06-14
1
-44
/
+47
*
cuda: add initial CUDA embedding backend
Onur Gündüz
2026-06-14
1
-0
/
+731