Inadvertent touching is fixable, ARM for example did it with the S bit (though on AArch64 it's slightly more complicated).
I regard it as a mistake of RISC-V. The flag register was invented for good reasons, and dropping it is a trade-off I personally do not think is worth the downside.