LLMs write things in a certain style because that's how the base models are fine tuned before being given to the public.

It's not because they can't write PRs indistinguishable from humans, or can't write code without Emojis. It's because they don't want to freak out the general public so they have essentially poisoned the models to stave off regulation a little bit longer.

I doubt this. I've done AI annotation work on the big models. Part of my job was comparing two model outputs and rating which is better, and using detailed criteria to explain why it's better. The HF part.

That's a lot of expensive work they're doing, and ignoring, if they're just later poisoning the models!

GP kind of implying that AGI is already there, and all companies are just dumbing them down because of regulations of the law.

I'm like "Sure buddy, sure. And the nanobots are in all vaccines, right?"

this is WILD speculation without a citation. it would be a fascinating comment if you had one! but without? sounds like bullshit to me...

It is wildly speculative, but it's something I've never considered. If I were making a brave new technology that I knew had power for unprecedented evil, I might gimp it, too.

This sounds like the most plausible explanation to me. Occam's razor, remember it!