Kim Stanley Robinson appears to me to be doing this. Even Arthur Clarke was, if the ultimate outcome was sometimes a bit messianic, the pathway to the end was the "best of all possible worlds" -which in some ways is what you are evoking.
We've been on this pathway since the Lisbon Earthquake of 1755.
I, too, immediately thought of his <The Ministry for the Future>. However, considering that the future depicted in the book is one where humanity only begins to pay proper attention to the climate crisis following a truly horrific event, it isn't exactly an optimistic future.
I think when you write a story set a planetary scale, it's necessary to translate what to an eponymous hero is a skinned knee falling off a bicycle, in planetary terms is 100m climate refugees dying in the relocation.
And lest anyone think "couldn't happen" a reminder that a significant percentage of the world like 40% or so live within 150km of coastal regions even if not at risk of inundation, for a mix of reasons, that total inundantion risk of most coastal regions less than 5m above mean sea level in the 50-100 year timeframe is high, that at least 150m people live in these regions, and that 'transmigrasi' actually happened: Indonesia decided that for the good of the state, entire cities of people would move. The government owns to 5.5m, the scientists argue up to 8m -they don't own to stats on what is euphemistically called "surplus mortalities" I think.
> We've been on this pathway since the Lisbon Earthquake of 1755.
What an intriguing thing to say :)
What are you referencing?
it's the root of "best of all possible worlds" -the secular humanists bootstrapped thinking around doing the best we can here and now, instead of some belief in a future paradise, from the skepticism of gods magninimity which emerged from the Lisbon earthquake: "If god is so good, why did he allow this to happen" blossomed into a range of branching paths amonst the european savants.
The pathways are all there in search. You won't need AI to find them. It's often mentioned in histories of philosophy from Lebnitz onward, he was the last great religious optimist in some ways. Not that there aren't any, but they don't exactly come to mind the way Kant, Voltaire & Rousseau do.