You can expand your context window to something like 100,000 to prevent memory loss.