mirrors/ollama-for-amd
1
0
Fork 0
mirror of https://github.com/likelovewant/ollama-for-amd.git synced 2025-12-21 14:26:30 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
20aee967067ae4a57a29405e89300f879d209972
ollama-for-amd/llm
History
Jesse Gross 5317202c38 llm: Don't always evict models on CPU-only systems 
Model eviction happens when we have at least one other model
loaded and are unable to load all layers into VRAM. However, on
CPU-only systems we can never load layers into VRAM, so this
constantly triggered eviction.

Fixes #13227
2025-12-02 10:58:08 -08:00
..
llm_darwin.go
Optimize container images for startup (#6547)
2024-09-12 12:10:30 -07:00
llm_linux.go
Optimize container images for startup (#6547)
2024-09-12 12:10:30 -07:00
llm_windows.go
win: lint fix (#10571)
2025-05-05 11:08:12 -07:00
server_test.go
llm: Don't always evict models on CPU-only systems
2025-12-02 10:58:08 -08:00
server.go
llm: Don't always evict models on CPU-only systems
2025-12-02 10:58:08 -08:00
status.go
logs: catch rocm errors (#12888)
2025-10-31 09:54:25 -07:00