Yes, and the technology to improve the interface you described is already available to run hundreds of concurrent instances on a 1U server. The barrier to entry is getting the people who manage those systems to care enough to implement something better.

Fact. My company's largest partner is CoreWeave, and convincing leadership that we could run it ourselves on partner discounted hardware for a lot less money has gone nowhere.

Maybe you need to walk into the office with a $1000 server running a hundred instances of whatever your code does.

We got rid of all our offices, whole company is remote now.