You’d have to reinstall the su binary itself I guess

It just changes the page cache for the su binary, a reboot will revert it.

No need to reboot:

sync && echo 3 >/proc/sys/vm/drop_caches