I assume if they copy pasted the same question it could have been cached? It would seem wasteful for <llm_provider> to not cache responses to exact same questions with exact same context windows (fresh session).

I'm just speculating though.