We need an open version (as OpenStreetMap is to Google Maps).
Mapillary (https://www.mapillary.com/) has surprisingly good coverage in some places, but the experience is lacking, partly because most of the images (where I've looked) aren't 360 views.
Mapillary is of course owned by Meta these days.
Panoramax[0] is another, perhaps more open option, though it is currently primarily used in Europe.
[0] panoramax.openstreetmap.fr/
Is this actually open source? The few datasets I found on there are under non-commercial licenses.