I think the ideas worth pursuing still require substantial time and motivation, even with LLMs. Otherwise you just end up with a half-baked sloppy artifact that nobody will ever use or study, for a net negative benefit to humanity.

Yes this is true to some extent. I've been using LLMs to run some computer vision tests, and I've certainly noticed myself running into the trap of "just one more AI experiment", or "just one more change" while neglecting to actually properly integrate the learnings into my mental model.

However, without an agent running its own experiments on a cloud GPU, would I realistically have invested my limited work hours and tried evaluating 10 different models, each with 10 different tuned parameters, to solve my specific use case?

Or would I have tried 1-2 models and spent my time trying to optimize those models?

I think there is some merit to the spray and pray approach when one is in the exploration phase of the solution space.

Also, on more than one occasion now, I have had fable halve the inference latency of a model simply because the original implementation from an academic included unnecessary GPU-to-CPU-to-GPU transfers or similarly inefficient operations. Those optimizations came at essentially 0 time cost to me and I can verify that the outputs are byte-identical. Pretty sweet!

Well, I’m happy just to make half baked slop for myself. Highly personalized software that is poorly implemented and yet yields the result I desire.

E.g. software that generates these models that I can print

https://wiki.roshangeorge.dev/w/Blog/2026-06-30/Modeling_a_W...

https://wiki.roshangeorge.dev/w/Blog/2025-12-01/Grounding_Yo...

Or blog post authoring software

https://wiki.roshangeorge.dev/w/Blog/2026-04-25/The_rise_of_...

There were so many things that no one will ever study and won’t give humanity any benefit but I use everyday to make my life better. That’s enough. The value far exceeds $200/mo. I’m getting it for cheap and now that I have my GPUs and my models they can’t even take it from me in the future if they wanted, haha!

LLMs allow for human flourishing on a massive scale. One of the best inventions to occur in my life. Up there with the Internet/Web. Truly a marvelous time.

> There were so many things that no one will ever study and won’t give humanity any benefit but I use everyday to make my life better

Agreed. I haven’t been this excited by computers since I got broadband DSL in 1998.