Not at all. Few prehistoric people lived in caves, and those that did, most likely temporarily, left frequently to get food and other supplies. Caves preserve things for later people (now archaeologists and palaeontologists) to find, so long ago ignorant people jumped to conclusions. Same with "cave bears", "cave lions", etc.