Aren't you assuming that all women were birthing and caring for children? There are many scenarios in which women are either too young, too old, un-partnered, or infertile to birth babies. Also, how do we know that a few women didn't feed and care for infants while other women hunted? In addition, older men and young boys could have gathered and not hunted. There's room for a lot of fluidity and flexibility here.