Sam 1bdab9fdb1 llm: introduce k/v context quantization (vRAM improvements) (#6279)

2024-12-03 15:57:19 -08:00

..

amd_common.go

Better support for AMD multi-GPU on linux (#7212)

2024-10-26 14:04:14 -07:00

amd_hip_windows.go

Better support for AMD multi-GPU on linux (#7212)

2024-10-26 14:04:14 -07:00

amd_linux.go

Jetpack support for Go server (#7217)

2024-11-12 10:31:52 -08:00

amd_windows.go

Jetpack support for Go server (#7217)

2024-11-12 10:31:52 -08:00

cpu_common.go

Rename gpu package discover (#7143)

2024-10-16 17:45:00 -07:00

cuda_common.go

Rename gpu package discover (#7143)

2024-10-16 17:45:00 -07:00

gpu_darwin.go

Rename gpu package discover (#7143)

2024-10-16 17:45:00 -07:00

gpu_info_cudart.c

Rename gpu package discover (#7143)

2024-10-16 17:45:00 -07:00

gpu_info_cudart.h

Rename gpu package discover (#7143)

2024-10-16 17:45:00 -07:00

gpu_info_darwin.h

Rename gpu package discover (#7143)

2024-10-16 17:45:00 -07:00

gpu_info_darwin.m

Rename gpu package discover (#7143)

2024-10-16 17:45:00 -07:00

gpu_info_nvcuda.c

Debug logging for nvcuda init (#7532)

2024-11-07 14:25:53 -08:00

gpu_info_nvcuda.h

Rename gpu package discover (#7143)

2024-10-16 17:45:00 -07:00

gpu_info_nvml.c

nvidia libs have inconsistent ordering (#7473)

2024-11-02 16:35:41 -07:00

gpu_info_nvml.h

nvidia libs have inconsistent ordering (#7473)

2024-11-02 16:35:41 -07:00

gpu_info_oneapi.c

Rename gpu package discover (#7143)

2024-10-16 17:45:00 -07:00

gpu_info_oneapi.h

Rename gpu package discover (#7143)

2024-10-16 17:45:00 -07:00

gpu_info.h

Rename gpu package discover (#7143)

2024-10-16 17:45:00 -07:00

gpu_linux_test.go

Refine default thread selection for NUMA systems (#7322)

2024-10-30 15:05:45 -07:00

gpu_linux.go

Refine default thread selection for NUMA systems (#7322)

2024-10-30 15:05:45 -07:00

gpu_oneapi.go

Rename gpu package discover (#7143)

2024-10-16 17:45:00 -07:00

gpu_test.go

Rename gpu package discover (#7143)

2024-10-16 17:45:00 -07:00

gpu_windows_test.go

Rename gpu package discover (#7143)

2024-10-16 17:45:00 -07:00

gpu_windows.go

Rename gpu package discover (#7143)

2024-10-16 17:45:00 -07:00

gpu.go

Jetpack support for Go server (#7217)

2024-11-12 10:31:52 -08:00

types.go

llm: introduce k/v context quantization (vRAM improvements) (#6279)

2024-12-03 15:57:19 -08:00