aboutsummaryrefslogtreecommitdiff
path: root/devtools/convert_model_bf16.py
diff options
context:
space:
mode:
authorOnur Gündüz <ogunduz@gmail.com>2026-06-23 21:52:06 +0200
committerOnur Gündüz <ogunduz@gmail.com>2026-06-23 21:52:06 +0200
commit8b3ed6b8eeed9b5d3a3eb65fb4a379daa8fa6bc4 (patch)
treea72572fc8eaa5e76ad7b6cc17bf371a53f38d3fe /devtools/convert_model_bf16.py
parentbcf3ef1b57e47800fd4e3638655f0ee8c359bc5c (diff)
downloadffwd-8b3ed6b8eeed9b5d3a3eb65fb4a379daa8fa6bc4.tar.gz
ffwd-8b3ed6b8eeed9b5d3a3eb65fb4a379daa8fa6bc4.zip
cuda: store bert qkv in 16-bit for flash batches
Diffstat (limited to 'devtools/convert_model_bf16.py')
0 files changed, 0 insertions, 0 deletions