mirrors/ollama-for-amd
1
0
Fork 0
mirror of https://github.com/likelovewant/ollama-for-amd.git synced 2025-12-22 06:43:57 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
eb2c443a79cac9c9daf8f6a64c7488fe85444d92
ollama-for-amd/llm/server.go
Jeffrey Morgan a50a87a7b8 partial offloading: allow flash attention and disable mmap (#4734) 
* partial offloading: allow flash attention and disable mmap

* allow mmap with num_gpu=0
2024-05-30 16:58:01 -07:00

26 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink