mirrors/ollama-for-amd
1
0
Fork 0
mirror of https://github.com/likelovewant/ollama-for-amd.git synced 2025-12-22 06:43:57 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
658e60cf7331dfd12672de1195a8c10ca1d82f08
ollama-for-amd/gpu/gpu_info_nvml.h
Daniel Hiltgen 526d4eb204 Release gpu discovery library after use 
Leaving the cudart library loaded kept ~30m of memory
pinned in the GPU in the main process.  This change ensures
we don't hold GPU resources when idle.
2024-04-01 16:48:33 -07:00

2.0 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink