There are plenty of smaller houses in Pompeii. Another thing to consider is that the ash covered basically the first floor of buildings, while the upper floors were either blown away by blast or pillaged by later generations. So there could have been one or two upper floors of accommodation for poorer people no longer visible. Also possible there were lower quality buildings on the town outskirts that haven't survived. Archeology understandably focuses on the larger villas.