LLMs were invented by AI2, before Transformers were a thing - with RNN-based ELMO.