Michael Spivak's Physics for Mathematicians has a lot of arguments like the one in the top answer here, answering questions about why the math of classical mechanics is the way it is.