mirrors/ollama-for-amd
1
0
Fork 0
mirror of https://github.com/likelovewant/ollama-for-amd.git synced 2025-12-22 06:43:57 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
c7f4ae7b9c8976b4d50c59eb87e9582ea9c5c82f
ollama-for-amd/server/create.go
Bruce MacDonald ad035ad595 convert: quantize from safetensors needs kv (#10675) 
When creating a quantized model from safetensors we
need the array KV values to be loaded.Changing this
value to -1 loads the KV values on the returned
layer to be used and saved during quantization.
2025-05-12 12:04:20 -07:00

18 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink