]>
git.djapps.eu Git - pkg/ggml/sources/ggml/commit
CUDA: Add Flash Attention Support for Head Dimension 512 (llama/20998)
* flash attention support for head dimension 512 added
* FA D=512 - match 576 configs, limit ncols2, revert vec cap
* fix HIP tile kernel build for D=512
* fix HIP tile kernel occupancy for D=512 on AMD
* Apply suggestions from code review
Co-authored-by: Johannes Gäßler <redacted>
* fix tile FA compilation
---------
Co-authored-by: Johannes Gäßler <redacted>
14 files changed:
overview / pkg / ggml / sources / ggml / commit