mirrors/ollama-for-amd
1
0
Fork 0
mirror of https://github.com/likelovewant/ollama-for-amd.git synced 2025-12-23 23:18:26 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
65b88c544f08ce3e5b1d193e82b72735095f795c
ollama-for-amd/kvcache/causal.go
Jesse Gross a8e83a7654 Disable causal attention based on batch index 
Currently we are using positions, which are relative to a
sequence and may not be unique.
2025-03-11 14:49:20 -07:00

15 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink