I don’t think coming up with novel situations is all that hard. LLMs already do it in text form all the time.

How big is the space of possible things a car can encounter?

It’s practically infinite, your domain is 3D space and time

You can’t just generate every possible scenario

That would be a combinatorially insane amount of data