To be fair, in some fields I've seen arguments between "a widget should be defined as ABC" vs. "a widget should be defined as XYZ", to the point that I wonder how they're able to read papers about widgets at all. (If I had to guess, likely by focusing on the 'happy path' where the relevant properties hold, filling in arguments according to their favored viewpoint, and tacitly cutting out edge cases where the definitions differ.)
So if many mathematicians can go without fixed definitions, then they can certainly go without fixed foundations, and try to 'fix everything up' if something ever goes wrong.
In my experience those debates are usually between experts who deeply understand the difference between ABC and XYZ widgets (the example I'm thinking of in my head is whether manifolds should be paracompact). The decision between the two is usually an aesthetic one. For example, certain theorems might be streamlined if you use the ABC definition instead of the XYZ one, at the cost of generality.
But the key is that proponents of both definitions can convert freely between the two in their understandings.