The linked inspiration has a good blog post of microgpt implemented in python.

https://karpathy.github.io/2026/02/12/microgpt/

It was submitted to hn a few days ago but only received a few comments. https://news.ycombinator.com/item?id=47000263