I don’t see how this math could depend on a point of view.
You can have 100 men and 1 woman, and predicting future population will have nothing to do with how many men there are (as long as there is at least 1 fertile man).
But if you have even just 1 man, having 10 women versus 100 women makes an enormous difference in potential future population.
The only other way I can explain this is that to project population, all you need to know is the the number of women now and the rate at which women are giving birth (assuming births are 50/50 male/female). At least, those are the more direct parameters to use than the number of men or the rate at which men impregnate women.
You can have 100 men and 1 woman, and predicting future population will have nothing to do with how many men there are (as long as there is at least 1 fertile man).
But if you have even just 1 man, having 10 women versus 100 women makes an enormous difference in potential future population.