No, the problem is when the markets are freer than the people.

I don't disagree with that. I think economic power getting concentrated in a relatively small number of hands is unequivocally bad.

That said, the Abundance argument for building more housing is that in many local housing markets, the pendulum has swung too far the other way in ways that are well-meaning but ultimately counterproductive. This very article makes the case that oligopolistic economic power is not the reason for unaffordable housing.