I wonder how much of that is scale rather than danger. Really large objects can feel unsettling even when you know they're harmless. VR seems especially good at triggering that response.