> Great, tell me again who put the Transformer into LLMs?
Google did, as they already said.
OpenAI was better at marketing and a lot more willing to cannibalize the search market as a newcomer. So Google blew their lead in research by not recognizing the product value quickly enough, or failing to win an internal political war on it anyway
Yeah, you're right, maybe needlessly harsh, sorry for that. I guess I'm tired of the same argument that Google somehow had a lead in LLM development because Transformer comes from researchers who worked at Google, yet somehow what comes before/after Transformer doesn't count, coming from Google's researchers (BERT) or others (GPT), or going even earlier so, hence the whole "we stand on the shoulders of giants".
We can go round and round about all this but I think it's pretty clear that google did at one point have a large AI lead in the lead up to covid. They had models that far surpassed the competition from 2018-2022. But they were facing an innovators dilemma, didnt want to cannibalize their search revenue so they sat on LLMs which ended up creating openAI and anthropic.
Great, tell me again who put the Transformer into LLMs?
Also, if we're going backwards, who invented neural networks, does that mean that person also then "had LLMs before OpenAI existed"?
> who put the Transformer into LLMs?
Google?
> who invented neural networks
People like Geoffrey Hinton, who was notably at Google Brain from 2013 to 2023?
The people who say Google was ahead were paying attention long before you were.
Google didn’t invent neural networks, neural networks existed before Google was founded.
> Great, tell me again who put the Transformer into LLMs?
Google did, as they already said.
OpenAI was better at marketing and a lot more willing to cannibalize the search market as a newcomer. So Google blew their lead in research by not recognizing the product value quickly enough, or failing to win an internal political war on it anyway
The tone on this could be improved. They literally answered your question "What lead?" and you seem dismissive.
Yeah, you're right, maybe needlessly harsh, sorry for that. I guess I'm tired of the same argument that Google somehow had a lead in LLM development because Transformer comes from researchers who worked at Google, yet somehow what comes before/after Transformer doesn't count, coming from Google's researchers (BERT) or others (GPT), or going even earlier so, hence the whole "we stand on the shoulders of giants".
We can go round and round about all this but I think it's pretty clear that google did at one point have a large AI lead in the lead up to covid. They had models that far surpassed the competition from 2018-2022. But they were facing an innovators dilemma, didnt want to cannibalize their search revenue so they sat on LLMs which ended up creating openAI and anthropic.