Michael Yang 4dc5b117dd automatically set num_keep if num_keep < 0 ...

num_keep defines how many tokens to keep in the context when truncating
inputs. if left to its default value of -1, the server will calculate
num_keep to be the left of the system instructions

2023-08-07 16:19:12 -07:00

..

client.go

use head to check heartbeat

2023-08-01 14:50:38 -04:00

types.go

automatically set num_keep if num_keep < 0

2023-08-07 16:19:12 -07:00