This is always how it goes, first it's just "genuine concerns", and soon enough you've designated a group who are to be the scapegoats with no right to live their own lives as they see fit.