Apart from transformer architecture, pretty much every other discovery that makes large language models viable today happened in universities.