Configure Slack to only retain messages for a month or so. People will stop relying on it for such.

Can’t you do that by not paying?