I think this really depends on what is interesting to you, personally. Something that you can have fun while doing, without breaking laws.
For example, I'm a privacy nerd, so I like reverse engineering proprietary software to figure out how it works and what data it collects.
I also like getting full access to the hardware I own - like a robot vacuum (bonus point: you'll also learn soldering, probably, which might come in handy if robots take over). Or my Mac studio that imposes some limitations on me on how many active user sessions I can have.
These kinds of things have put me on a path where I've learned how hardware or networking works on deepest levels, what goes through these pipes, how I can place myself in the middle, how I can enter places someone didn't want me to enter.
And once you know how to do these things, you know how to apply this knowledge in defence.
Essentially: always be curious and always try to say "but I want to" when something that doesn't cross the boundary of your physical property says no to you (legally).
Yes, models like Mythos may find vulnerabilities, but your knowledge will make it possible to point it in the right direction, and understand where it's mistaken, or to understand the output when it's right, and what is the right course of action.
Ah, the “I am an expert so I can guide it argument”. Not sure if you are right or wrong. I do know this is the argument that many software engineers claim as well.
Yea, I don’t know if it will hold up. I hope so. It could. I don’t know if it would or wouldn’t.
Get any model, any reasoning level, ask it to tackle a challenge, have it come up with a plan. Then ask it "are you sure? This feels wrong", and it will now think it's wrong. Do that again in a loop and you'll see how unnecessary human judgment actually is.
Or alternatively, have fable write some complex code. Then ask it to do an adversarial review of that code in a clean session. You'll find that it will find issues in the code that it just wrote.
Now imagine you're a layperson who doesn't know which one is true.
Human expertise is never going to become irrelevant.
Yea fair. I have that when I ask an LLM to prove the Riemann hypothesis. I am not mathematically mature. So I can’t see if it approaches it in any way that might yield some insight.