Jesse Gross a807985e59 ggml: Check for OOM and return as Go errors ...

If there is a CUDA OOM, we currently don't check the return value
and will evetually segfault. This checks for the problem and generates
a Go error. At the moment, this will still result in a panic but having
the error is the first step to being able to handle it more gracefully.

2025-04-08 10:01:28 -07:00

..

ggml

ggml: Check for OOM and return as Go errors

2025-04-08 10:01:28 -07:00

backend.go

next ollama runner (#7913)

2025-02-13 16:31:21 -08:00