> The multi-trillion dollar question is: What is the objective reward that would induce AI models like LLMs to behave like AGI
No, the reward for finding the right objective function is a good future for all of humanity, given that we already have an algorithm for AGI.
The objective function to acquire trillions of dollars is trivial: it’s the same minimization of cross-entropy that we already use for sequence prediction. What’s missing is a better algorithm, which is probably a good thing at the moment, because otherwise someone could trivially drain all value from the stock market.
You misunderstand.
The phrase "the multi-trillion dollar question" has nothing to do with acquiring trillions of dollars.
The phrase is idiomatic, indicating a crucial question, like "the $64,000 question," but implying much bigger stakes.[a]
---
[a] https://idioms.thefreedictionary.com/The+%2464%2c000+Questio...
Ah, I see. Apologies.
Thank you.
By the way, I agree with you that "a good future for all of humanity" would be a fantastic goal :-)
The multi-trillion dollar question is: How do you specify that goal as an objective function?