You can also edit binary distributions of models with means besides changing their weights. See "LLM Neuroanatomy: How I Topped the LLM Leaderboard Without Changing a Single Weight."

On the spectrum of:

  careful engineering--hacking--mad science

This kind of thing falls far towards the mad science end of the scale, but has proven effective.

https://dnhkng.github.io/posts/rys/