The situation you’re outlining is trivial though.

Yea, there’s some grunt work involved but in terms of learned ability all of that is obvious to someone who knew only a little bit about LLMs.

We are going to have to disagree on this one.

I don’t really see how it’s different than how you’d setup someone really junior to have a playground of sorts.

It’s not exactly a groundbreaking line of reasoning that leads one to the conclusion of “I shouldn’t let this non-deterministic system access production servers.”

Now, setting up an LLM so that they can iterate without a human in the loop is a learned skill, but not a huge one.