Daniel Hiltgen 5d22953ba7 cuda: get driver version after props (#12707) ...

Users on Windows without GPUs are reporting errors relating to
cudaDriverGetVersion with the device set to -1.  This ensures we only grab the
driver once we're enumerating actual devices.

2025-10-20 10:57:27 -07:00

..

.gitignore

update vendored llama.cpp and ggml (#11823)

2025-08-14 14:42:58 -07:00

0001-ggml-backend-malloc-and-free-using-the-same-compiler.patch

Llama cpp bump (df1b612): granite docling / mamba2 optimizations / multimodal encoding fixes (#12552)

2025-10-13 15:26:18 -07:00

0002-pretokenizer.patch

Llama cpp bump (df1b612): granite docling / mamba2 optimizations / multimodal encoding fixes (#12552)

2025-10-13 15:26:18 -07:00

0003-clip-unicode.patch

Llama cpp bump (df1b612): granite docling / mamba2 optimizations / multimodal encoding fixes (#12552)

2025-10-13 15:26:18 -07:00

0004-solar-pro.patch

Llama cpp bump (df1b612): granite docling / mamba2 optimizations / multimodal encoding fixes (#12552)

2025-10-13 15:26:18 -07:00

0005-fix-deepseek-deseret-regex.patch

Llama cpp bump (df1b612): granite docling / mamba2 optimizations / multimodal encoding fixes (#12552)

2025-10-13 15:26:18 -07:00

0006-maintain-ordering-for-rules-for-grammar.patch

Update GGML to b6646 (#12245)

2025-10-02 14:47:10 -07:00

0007-sort-devices-by-score.patch

Update GGML to b6646 (#12245)

2025-10-02 14:47:10 -07:00

0008-add-phony-target-ggml-cpu-for-all-cpu-variants.patch

Llama cpp bump (df1b612): granite docling / mamba2 optimizations / multimodal encoding fixes (#12552)

2025-10-13 15:26:18 -07:00

0009-remove-amx.patch

Llama cpp bump (df1b612): granite docling / mamba2 optimizations / multimodal encoding fixes (#12552)

2025-10-13 15:26:18 -07:00

0010-fix-string-arr-kv-loading.patch

Llama cpp bump (df1b612): granite docling / mamba2 optimizations / multimodal encoding fixes (#12552)

2025-10-13 15:26:18 -07:00

0011-ollama-debug-tensor.patch

Llama cpp bump (df1b612): granite docling / mamba2 optimizations / multimodal encoding fixes (#12552)

2025-10-13 15:26:18 -07:00

0012-add-ollama-vocab-for-grammar-support.patch

Llama cpp bump (df1b612): granite docling / mamba2 optimizations / multimodal encoding fixes (#12552)

2025-10-13 15:26:18 -07:00

0013-add-argsort-and-cuda-copy-for-i32.patch

Llama cpp bump (df1b612): granite docling / mamba2 optimizations / multimodal encoding fixes (#12552)

2025-10-13 15:26:18 -07:00

0014-graph-memory-reporting-on-failure.patch

Llama cpp bump (df1b612): granite docling / mamba2 optimizations / multimodal encoding fixes (#12552)

2025-10-13 15:26:18 -07:00

0015-ggml-Export-GPU-UUIDs.patch

Llama cpp bump (df1b612): granite docling / mamba2 optimizations / multimodal encoding fixes (#12552)

2025-10-13 15:26:18 -07:00

0016-add-C-API-for-mtmd_input_text.patch

Llama cpp bump (df1b612): granite docling / mamba2 optimizations / multimodal encoding fixes (#12552)

2025-10-13 15:26:18 -07:00

0017-no-power-throttling-win32-with-gnuc.patch

Llama cpp bump (df1b612): granite docling / mamba2 optimizations / multimodal encoding fixes (#12552)

2025-10-13 15:26:18 -07:00

0018-BF16-macos-version-guard.patch

Update GGML to b6646 (#12245)

2025-10-02 14:47:10 -07:00

0019-Enable-CUDA-Graphs-for-gemma3n.patch

Llama cpp bump (df1b612): granite docling / mamba2 optimizations / multimodal encoding fixes (#12552)

2025-10-13 15:26:18 -07:00

0020-Disable-ggml-blas-on-macos-v13-and-older.patch

Update GGML to b6646 (#12245)

2025-10-02 14:47:10 -07:00

0021-fix-mtmd-audio.cpp-build-on-windows.patch

llm: New memory management

2025-08-14 15:24:01 -07:00

0022-ggml-No-alloc-mode.patch

Llama cpp bump (df1b612): granite docling / mamba2 optimizations / multimodal encoding fixes (#12552)

2025-10-13 15:26:18 -07:00

0023-decode-disable-output_all.patch

Llama cpp bump (df1b612): granite docling / mamba2 optimizations / multimodal encoding fixes (#12552)

2025-10-13 15:26:18 -07:00

0024-ggml-Enable-resetting-backend-devices.patch

logs: fix bogus "0 MiB free" log line (#12590)

2025-10-14 11:26:28 -07:00

0025-harden-uncaught-exception-registration.patch

harden uncaught exception registration (#12120)

2025-09-02 09:43:55 -07:00

0026-GPU-discovery-enhancements.patch

cuda: get driver version after props (#12707)

2025-10-20 10:57:27 -07:00

0027-vulkan-get-GPU-ID-ollama-v0.11.5.patch

Vulkan based on #9650 (#11835)

2025-10-14 10:59:58 -07:00

0028-vulkan-pci-and-memory.patch

vulkan: Get FilterID from Backend for Vulkan (#12655)

2025-10-16 09:07:35 -07:00

0029-NVML-fallback-for-unified-memory-GPUs.patch

ml/backend/ggml: NVML fallback for unified memory GPUs (#12619)

2025-10-15 11:40:06 -07:00

0030-CUDA-Changing-the-CUDA-scheduling-strategy-to-spin-1.patch

perf: backport cuda iGPU sched spin (#12641)

2025-10-15 11:52:14 -07:00

0031-report-LoadLibrary-failures.patch

win: more verbose load failures (#12683)

2025-10-17 17:13:16 -07:00