Exactly. Housing is the big cost of living increase. A perfectly unregulated economy with finite land will drive land prices up to the margin of cultivation (the margin at which one would move to a less desirable piece of land). As population and productivity grows this results in ever higher land rents. In the limit rents will be exactly the edge of what people can pay.