I got downvoted for saying this last time the topic came up but constraints focus a project. It’s best to start work with as few variables as possible, and only add new ones when absolutely necessary.
I'm working on a similar problem in computer vision and we're quickly approaching the point where our pure vision work is better than our Lidar supported track because we've had to deal with the constraints instead of having a crutch to lean on.
I agree, but these are also the exact constraints that lead to an early leader getting overtaken by a longer term, yet better set of plans. Not saying that's the case here, but given how much success Waymo has had so far, over really everything Tesla has produced, says quite a bit about the likelihood of the approach, even if it's not yet there.