The idea of them purposefully wasting my time by having the model act dumber and me having to argue with it without knowing if it’s the prompt or the model was just such an idiotic product decision I can’t believe they shipped that without getting any feedback from users first.
it's not a product decision, it's a safety decision. if you understood what they think they are building and the culture inside of anthropic you would understand why they did it.
Safety from what? Competitors? That sounds like a product decision. They're puking on any requests that could be used to create LLMs or competitive products.
To prevent their models from doing harm in dual-use contexts including CBRN or by accelerating research in authoritarian-backed AI labs.
I would guess prevention of using Claude as a pentesting or hacking platform. This could mean that every script kiddie out there would be a massive risk.
I think you can sympathize with the safety motives while still thinking this was a dumb implementation to degrade silently? I actually have faith in them getting the guardrail triggers pretty good, but consensus seems like they’re not yet there yet.
I think it is clear given the stakes why you would not want to make your guardrails probe-able/invertable.
The road to hell is paved with "good" intentions.
Are you seriously stupid? They need to jack up revenues vs cost to deliver higher gross profits and operating profits. This is pure strategic manipulation.
God, how naive do you have to be? They are a business fighting for survival given they are money losing.
You are just completely wrong about what the driving motives are and an asshole to boot.
[flagged]
How does degrading responses to a cheaper tier jack up revenues?
> if you understood what they think they are building and the culture inside of anthropic you would understand why they did it.
This seems like a cult with extra steps.
Related: I interviewed for Anthropic a few months ago and in place of the usual HR call they have one where they have someone with a suspiciously relevant degree grill you about how committed you are to the 'mission'!
I probably came off as being skeptical, and then, hilariously, I was strongly encouraged to read the book published by the CEO to 'form accurate opinions' on AI safety.
We do understand why they did it, and the reason is dark and cynical.
Don't buy it. It is actively deceiving the customer and charging them for the privilige of being lied to.
They did it to make more money as you waste more time burning tokens with bad responses.