But traditionally housing was also pretty cheap and only select few properties in the right areas gained any significant value over time. Now rentseekers are and have bought up significant amounts of housing and drove both housing and land values up far faster than the low end of wages.
People were poor for different reasons but they were still poor. There's no reason to think that expensive housing and cheap food makes low birthrates but cheap housing and expensive food makes high birthrates.