mirrors/ollama-for-amd
1
0
Fork 0
mirror of https://github.com/likelovewant/ollama-for-amd.git synced 2025-12-25 07:58:01 +00:00
Code Issues Packages Projects Releases Wiki Activity
4,425 Commits 1 Branch 63 Tags
25911a6e6bd5a0cf209d871c721aa7bc74f59509
Commit Graph

3 Commits

Author SHA1 Message Date
Daniel Hiltgen
25911a6e6b mac: disable bf16 on unsupported OS versions (#11585) 
Support for bf16 was added in MacOS v14+ and attempting to enable
on older versions causes runtime failures.
 2025-07-30 08:50:54 -07:00
Oliver Simons
ea85e27bbd Increase performance for Gemma3n models on NVGPUs by enabling CUDA Graph execution (#11525) 
* Enable CUDA Graphs for gemma3n.

Similar to
https://github.com/ggml-org/llama.cpp/pull/14741,
though ollama has a slightly different model graph
than llama.cpp which requires different workaround
checks.

* Remove residual check by reshaping differently in gemma3n model

This should make the heuristics more robust
 2025-07-29 12:37:06 -07:00
Michael Yang
73b642e6f3 add new gemma model (#11204) 
* update patches

* cherry pick metal mean kernel

* cherry pick cuda mean kernel

* gemma3n
 2025-06-25 21:47:09 -07:00