You can disable this at Settings > Capabilities > Memory > Search and reference chats.