I'm sure you've be entirely fine with me and a few friends placing wagers whether or not your house burns down next month. Nothing illegal of course, just hundreds of thousands of dollars wagered on whether or not your specific house burns to the ground for any reason.

Unregulated gambling has very obvious externalities. Don't insult our intelligence by suggesting it doesn't.