Very similar arguments date back to at least Plato. Ancient Greek math was based in geometry and Plato argued one could never demonstrate incommensurable lengths of rope due to physical constraints. And yet incommensurable lengths exist in math. So he said the two realms are forever divided.

I think it’s modern science’s use of math that made people forget this.