You can `jj file untrack` instead of that mv bit.

Oh neat, thanks! I (clearly) did not know that command.