Claude is absurdly sensitive to anything that touches cyber, and threatens bans if it gets a whiff of a pentest going on. it wouldnt surprise me if openai had a similar approach.
Yesterday I joked that claude gave me a cyber stop for asking how to make the anime girl video for an exploit, but it was a thing that happened. Meanwhile im trying to convince people around me that having grok nudify people isnt "fine" just because grok says it is. Its wild where the lines a drawn.
I'm in the new CVP, and even Mythos gave me a cyber stop just for creating an MCP server that can remotely connect to my Steam Frame to run commands. It must've thought I was trying to create a centralized malware or something.
Not even sure why Mythos even still exists when it's identical to Fable in every way, including refusing to do stuff that looks like it could ever be repurposed into unapproved use cases.
[dead]
Tastelessness aside, this seems perfectly rational to me. Unlike reverse engineering for the purpose of developing security exploits, "nudification" doesn't meaningfully expand the capabilities of malicious actors with access to free online porn and Photoshop.
Actually violating one person is fine, but doing anything associated with a specific industry that has applications for harm and help is not?
That's like saying it's fine to beat someone up and take their lunch, but it's not fine to learn how locks work.
It's fine to imagine what your lunch looks like, even if that makes you feel that your dietary privacy has been violated.
You don't need Grok to imagine anything.
Well, maybe _you_ do.
That's one of the weirdest takes on here in a while.
I can develop security exploits myself just fine without the use of AI. Many people don't have the capability to use Photoshop and free online porn to deepfake someone else they might or might not personally know into a realistic video...
> I can develop security exploits myself just fine without the use of AI.
Are you seriously claiming that the untrained masses can start developing exploits on their devices?
Honestly as someone with faily little experience in pentesting or photoshop but who has dabbled in both back in highschool. I think they would both take a similar amount of practice and skill to develop those abilities. They are complete opposites so i suspect the kind of person who is naturally good at photoshop to be bad at pentesting and vis versa. But if your going to dedicate a few hours of every day to learning a skill i dont think it matters which one you choose, a bit of time, practice, and natural interest and you will be able to do the kind of work that people ask these llms to do.
The major difference being that it usually takes longer to study code because projects can be massive but at the same time the llms are looking for everything and anything while a real attacker is usually looking for specific vulnerabilities in common libraries and such so i wouldnt exactly call the amateur hacker on par with an llm but i would say they could do a similar amount of damage without llm assistance. And photoshop is basically the same. Spend a few hours every day dedicated to one thing and you will learn how to do it.