Wouldn’t that invalidate kv cache and you wouldn’t benefit from much cheaper cache read?
I'm frequently idle for five minutes while I review, at which point the cache has expired
[dead]
I'm frequently idle for five minutes while I review, at which point the cache has expired
[dead]