It’s a completely legitimate question. It’s the same moral consideration behind whether drugs and alcohol should be legal. Banning them is good for people who can’t use them responsibly, but reduces the freedom of people who can. Given that we’ve flip flopped on the legality of alcohol, cannabis, and sports betting in the last 100ish years, it’s clear there is ambiguity about what is the best tradeoff.