mirrors/ollama-for-amd
1
0
Fork 0
mirror of https://github.com/likelovewant/ollama-for-amd.git synced 2025-12-23 07:03:57 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
dba62ff3a572af4af845711c2091b70606b06af4
ollama-for-amd/llama/patches/0030-Vulkan-MMQ-Integer-Dot-Refactor-and-K-Quant-support-.patch
Michael Yang 0796d79d19 cuda: skip large batches 
cuda panics on batches larger than 1024 so skip those and fallback to
cpu
2025-11-18 16:11:37 -08:00

96 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink