I'm always worried about the "Midas effect" with something like that. Having to be careful not to trigger actions you don't want to.

Yep, and IMHO that's why eye tracking even though is amazing when it does work is still very limited. We do a lot of small things without even realizing and stopping to do movements we are not aware of is very very hard.