ollama-for-amd/server/routes.go at 2c776f07805022221e7640a643777818528d0a27

mirror of https://github.com/likelovewant/ollama-for-amd.git synced 2025-12-23 23:18:26 +00:00

Files

Jesse Gross f2e9c9aff5 server: Reduce gpt-oss context length for small VRAM GPUs

gpt-oss works best with a context length of at least 8k. However,
for GPUs with limited amount of VRAM, there is a significant
performance hit to this increased context. In these cases, we
switch to the Ollama default of 4k

2025-08-07 14:23:55 -07:00

47 KiB

Raw Blame History

View Raw

47 KiB Raw Blame History

47 KiB

Raw Blame History