mirrors/ollama-for-amd
1
0
Fork 0
mirror of https://github.com/likelovewant/ollama-for-amd.git synced 2025-12-22 14:53:56 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
9926eae01516fa3ab65d60df7dd0b51dceccdebf
ollama-for-amd/ml/backend/ggml/ggml.go
Jesse Gross 4100ed7bdd ml: Add support for quantized KV cache 
Similar to the llama engine, quantizing the KV cache requires
flash attention to be enabled through the Ollama server.
2025-03-07 18:43:39 -08:00

24 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink