mirrors/ollama-for-amd
1
0
Fork 0
mirror of https://github.com/likelovewant/ollama-for-amd.git synced 2025-12-23 15:08:27 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
d773b7d67161cba40a342e74d66b7363dfdd38d2
ollama-for-amd/model/model.go
Jesse Gross 4d4463b2bd backend: Support graph computation that does not return an output 
There are two cases where we may not have an output after computing:
 - Prompt processing where the length of the input exceeds the batch
   size
 - Internal memory management operations such as cache defrag and shift
2025-02-13 17:09:26 -08:00

5.2 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink