Isn't this the idea behind holographic memory? Chopping the image in half gets you the same image at half the resolution? Or so I've heard...
What you want is a context mipmap.
Then there was the Claude article describing using filesystem hierarchy to organize markdown knowledge, which apparently beats RAG.