Hoarding land and land speculation is really the root problem.

It's not bad for society if it was used to make building to provide rentable space to industries and business or to provide homes, or quite often both, but it doesn't provide easy money to investors.

Now sitting on land and seeing it appreciate with no hard work from you? That's easy money.