That was the point: I also wouldn't say that about neanderthals.
The evidence on the ground is of course, limited. But it's a fairly common view among anthropologists/archaeologists that our perspective on ancient societies is immensely limited by the material record, hence the generally positive reception to Dawn of Everything despite its sketchy details and interpretations.