If your spend is less than a few thousand per month, using cloud services is a no-brainer. For most startups starting up, their spend is minimal, so launching on the cloud is the default (and correct!) option.
Migrating to lower cost options thereafter when scaling is prudent, but you "build one to throw away", as it were.