I've been trying voxtype (using whisper models) lately, and to my surprise all my ums are filtered out. It's really good now actually!