The full quote is "don't cite the deep lore to me, I was there when it was written". The intention is to imply that he was there when the thread was created.

well the full full quote is from C.S Lewis' Narnia, where Aslan says:

Do not cite the deep magic to me, Witch. I was there when it was written.