GitHub › Copilot › Chat › Summarize Agent Conversation History: Enabled should do the trick I guess