Devon Rifkin 463a6caad8 model: add bpe roundtripping tests

2025-08-19 22:05:48 -07:00

..

imageproc

imageproc mllama refactor (#7537)

2024-12-14 19:50:15 -08:00

input

ollamarunner: Separate text and multimodal graphs

2025-05-15 13:46:20 -07:00

models

update vendored llama.cpp and ggml (#11823)

2025-08-14 14:42:58 -07:00

testdata

gemma2 impl

2025-03-11 14:35:08 -07:00

bytepairencoding_test.go

model: add bpe roundtripping tests

2025-08-19 22:05:48 -07:00

bytepairencoding.go

model: fix boundary in bpe

2025-08-19 18:34:49 -07:00

model_test.go

update vendored llama.cpp and ggml (#11823)

2025-08-14 14:42:58 -07:00

model.go

update vendored llama.cpp and ggml (#11823)

2025-08-14 14:42:58 -07:00

sentencepiece_test.go

model: handle multiple eos tokens (#10577)

2025-05-16 13:40:23 -07:00

sentencepiece.go

model: handle multiple eos tokens (#10577)

2025-05-16 13:40:23 -07:00

textprocessor.go

model: handle multiple eos tokens (#10577)

2025-05-16 13:40:23 -07:00

vocabulary_test.go

model: treat 'user defined' tokens as special tokens (#11077)

2025-06-16 16:03:16 -07:00

vocabulary.go

model: treat 'user defined' tokens as special tokens (#11077)

2025-06-16 16:03:16 -07:00