There is this over indexing in training data that I find quite problematic.

I have really good results getting LLMs to read documentation and work of these. This is in domains probably sparsely represented in the training data.