Because you didn't have the legal right to remain there in the first place?

You're confusing natural rights and civil rights. And backpedaling from "they're not being deprived of these rights" to "they deserve it". They may deserve it but you don't know that without- (please finish the sentence)