8 Commits

Author	SHA1	Message	Date
Quinn Slack	f4432e1dba	treat stop as stop sequences, not exact tokens (#442) ... The `stop` option to the generate API is a list of sequences that should cause generation to stop. Although these are commonly called "stop tokens", they do not necessarily correspond to LLM tokens (per the LLM's tokenizer). For example, if the caller sends a generate request with `"stop":["\n"]`, then generation should stop on any token containing `\n` (and trim `\n` from the output), not just if the token exactly matches `\n`. If `stop` were interpreted strictly as LLM tokens, then it would require callers of the generate API to know the LLM's tokenizer and enumerate many tokens in the `stop` list. Fixes https://github.com/jmorganca/ollama/issues/295.	2023-08-30 11:53:42 -04:00
Michael Yang	5ca05c2e88	fix ModelType()	2023-08-18 11:23:38 -07:00
Michael Yang	a894cc792d	model and file type as strings	2023-08-17 12:08:04 -07:00
Bruce MacDonald	4b2d366c37	Update llama.go	2023-08-14 12:55:50 -03:00
Bruce MacDonald	56fd4e4ef2	log embedding eval timing	2023-08-14 12:51:31 -03:00
Jeffrey Morgan	22885aeaee	update llama.cpp to f64d44a	2023-08-12 22:47:15 -04:00
Michael Yang	6de5d032e1	implement loading ggml lora adapters through the modelfile	2023-08-10 09:23:39 -07:00
Michael Yang	fccf8d179f	partial decode ggml bin for more info	2023-08-10 09:23:10 -07:00