Actual models do usually start as speculation and hand waving. As others have pointed out, it seems like the LCDM models actually never STOPPED being speculation and hand waving. Lots of math can hide the fact that a theory is literally just handwaving (LCDM) and a lack of math can indicate a robust theory is in its infancy and needs more math people working on it (blowtorch).