mirrors/ollama-for-amd
1
0
Fork 0
mirror of https://github.com/likelovewant/ollama-for-amd.git synced 2025-12-26 08:33:21 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
c3945aaa1df8baa67c026f1b76f120ef4fedcf0d
ollama-for-amd/kvcache/causal.go
Jesse Gross a8e83a7654 Disable causal attention based on batch index 
Currently we are using positions, which are relative to a
sequence and may not be unique.
2025-03-11 14:49:20 -07:00

15 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink