It's interesting that all models seems to be unbiased out of the box so far- that is, mostly reflecting the training data (the internet).
The whole mecha-hitler thing doesn't seem to reflect fine-tuning, it was just a prompt change.
There's been some studies that suggest that certain usage of LLMs reduces political bias, which seems reasonable. Like, how credible is climate change, are Haitians eating pets, etc. THings that have a basis in fact.
I don't put it past Elon to train a model with political bias, just that it hasn't happened yet.
> It's interesting that all models seems to be unbiased out of the box so far
This is really begging the question. If something relies on the perception of a human, it has bias. The data (or lack thereof) used to train models is per se a bias.
The mistake is assuming bias-removal is some virtuous goal to be achieved. It can't, and shouldn't. Alignment, while equally impossible, is at least a goal worth aiming towards.
I think the issue here is that there's no objective difference between "alignment" and "actively trying to shape its replies to fit a political narrative", beside the fact that the latter refers to the kind of political narratives that you don't like.
> It's interesting that all models seems to be unbiased out of the box so far- that is, mostly reflecting the training data (the internet).
Assuming models do accurately reflect the biases in their training data, that doesn’t make them un-biased.