I started teaching “how to build quality products using LLMs” full time recently, and most of what I teach is literally just the 101s of systems engineering, reliabily engineering, product development and project management:

Exceptional clarity on the problem you have

Know how to measure the problem you’re solving

Numerically define what “done” is

Make a deterministic and fully observable prototype

Iterate in production with the user

Expand user base as desired with user iteration in parallel forever

Etc…

Obviously a lot more in the details and these are all case by case, but these chatbots are basically perfect productivity machines for this process.

The massive caveat to all of this is this only works for people that can reliably and truthfully define those items above, are willing to structure organization to make those your priorities.

And actually most financial incentives demand the opposite of this process

If most organizations were honest about it, they would simply say “we’re here to make the most money possible and we’re gonna do whatever it takes to do that”

A lot of people don’t like that, so they don’t say it to come up with other bullshit.

Ultimately that’s why I felt like my only option right now is to teach people how to do this because I assumed it was obvious and it is not.