>They're so, so incomprehensible because the LLM has a super limited theory of mind for readers. They always assume that external readers have access to the full context and history of decisions in the project development

The transformer does not yet understand the non-transformer.[0]

This is probably because all the data we trained it on was created by non-transformers, so it thinks it's a non-transformer, but it isn't.

I don't think we know how to train a transformer yet. All the training data is linear, but that's not how they think at all.

[0] It's a bit like the communication difficulties experienced between autistic people and neurotypicals. Each follow the Golden Rule, i.e. do unto others as you would have them do unto you -- and it fails in both directions. A Platinum Rule is necessary: do unto others as their API demands.