Maybe the shell or the terminal itself could do that.

Some terminals already allow you to search they buffer after commands have executed, so maybe it’s a small step away from being able to use that as a cache.