> "If that's the game we want to play, against an opponent that is self improving... that doesn't strike me as an excellent strategy. We should probably pick a different one."
> "If the market doesn't reward our continued existence, then we should probably have a conversation about that at some point"
---
There is a lot of "we should probably" carrying the point here.
The incentives are made by the market, and it happens to be an incentive that this discussion, or any action for that manner does not happen. Given the current status quo, and the foreseeable future given the incentives, how do you suggest that we even get to a time where symbiosis is on the table?
Incentives are for Losers:
https://www.experimental-history.com/p/incentives-are-for-lo...
Well, our best bet is that we succeed in making the machines be less stupid than we are, and hope that they figure it out.
So the machines should create the human-machine symbiosis for some reason, interesting... If I was the machine I would maximally want about the same symbiosis with humans as humans have with cows.