mirrors/ollama-for-amd
1
0
Fork 0
mirror of https://github.com/likelovewant/ollama-for-amd.git synced 2025-12-26 08:33:21 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
547132e820dcdc20c325d1de876a86a708b5744e
ollama-for-amd/llm/ext_server/server.cpp
Sam e15307fdf4 feat: add support for flash_attn (#4120) 
* feat: enable flash attention if supported

* feat: enable flash attention if supported

* feat: enable flash attention if supported

* feat: add flash_attn support
2024-05-20 13:36:03 -07:00

126 KiB
Vendored
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink