I've posted here before that this idea that we just have rights is actually problematic, not the least reason for which is that whether we have such rights or not, their mere existence has never and will never actually defend anyone from any violation of them.
Rights are just the concessions that the less powerful have extracted from the powerful by virtue and utilization of power. This perspective has the double benefit not relying on the imaginary and making it clear that if you don't fight for your rights you will not get to keep them. Rights may be God given, but God isn't going to come down and rescue you from a concentration camp if you get put there by an autocrat who doesn't like your "free speech."
All that matters is whether we will personally tolerate abuses against human beings and what we are willing to do to prevent them. If I had my way, talk of rights qua rights would be swept into the dustbin of history with other imaginary stuff like religion in favor of concrete, ideally evidence based, free human discussion about what human beings want from the universe and what we are willing to endure to get it.