Well if you do that then you reverse the strengths of your system. It might be best to work with the context length you can offload, like a normal person.