Jeffrey Morgan df32537312 gpu: read memory info from all cuda devices (#1802) ...

* gpu: read memory info from all cuda devices

* add `LOOKUP_SIZE` constant

* better constant name

* address comments

2024-01-05 11:25:58 -05:00

..

gpu_darwin.go

set num_gpu to 1 only by default on darwin arm64 (#1771)

2024-01-03 14:10:29 -05:00

gpu_info_cpu.c

Fix windows system memory lookup

2024-01-03 08:50:01 -08:00

gpu_info_cuda.c

gpu: read memory info from all cuda devices (#1802)

2024-01-05 11:25:58 -05:00

gpu_info_cuda.h

gpu: read memory info from all cuda devices (#1802)

2024-01-05 11:25:58 -05:00

gpu_info_rocm.c

Fix windows system memory lookup

2024-01-03 08:50:01 -08:00

gpu_info_rocm.h

Adapted rocm support to cgo based llama.cpp

2023-12-19 09:05:46 -08:00

gpu_info.h

Fix windows system memory lookup

2024-01-03 08:50:01 -08:00

gpu_test.go

Fix windows system memory lookup

2024-01-03 08:50:01 -08:00

gpu.go

Fix windows system memory lookup

2024-01-03 08:50:01 -08:00

types.go

Fix windows system memory lookup

2024-01-03 08:50:01 -08:00