It’s debated, but the prevailing belief is that it originated to refer to the number of stories. Hence you’ll also see “5-over-2” used fairy commonly as well.