mirror of
https://github.com/likelovewant/ollama-for-amd.git
synced 2025-12-22 06:43:57 +00:00
With the new version of GGML in #12245, KV cache quantization no longer causes a fallback to CPU.
With the new version of GGML in #12245, KV cache quantization no longer causes a fallback to CPU.