I have dreamed about a pipeline that can take elevation data, building data, maps, and streetview imagery to process a city into all the components you would need to build a proper map for one of the GTA engines, including all the other objects like trees, fire hydrants, signs, light posts, traffic lights, etc.
The building textures could be recreated from the low-res streetview imagery using a pipeline to scale / relight them using image-to-image models. Building shapes could be rebuilt using generative models for 3d mesh components. Road & sidewalk quality (how clean, how faded lines are, etc) could be inferred from imagery as well to be applied to the map.
Super cool project, hoping it continues to evolve!
GTA games require a lot of effort outside of this, but the concept of mass-producing a GTA style open world game for any given environment is very compelling. Probably frightening to Rockstar themselves but such is the course of technological development.
I feel like the closest we've gotten to that so far has been the flight sims.
I'd prefer something like The Crew but whatever game it ends up in, it would still be awesome!