Where would the control come from? Software installed on the client's computer, or software installed connecting to an AI agent, or something else, something more external, something more interactive?

Yes, we install a small piece of software on their computers because we also separately control GUI of legacy windows apps. But we also need to control web based apps as well.