If we used ascii delimited values none of this would be a problem. The amount of effort spent on csv must be close to a million man years and all because we want to edit the files with a text editor without a special mode.

The files are CSV-adjacent, I should say. The issue here isn't the delimiter in fact, it's the fact that the format differs slightly between files, even within the same project. That, and the mismatch with the SQL DB format I want.

With the predefined ascii delimiters there is no difference between formats, because you can't choose anything but the dimiters ascii gives you.

After rereading the post I realize that the op was talking about the schema of the files rather than the adhoc nature of trying to decode escape characters.

Ascii delimiters will not save you there.