Markov chain?

I thought those would be dead now with LLMs.