Cool idea! Does this work with electron apps? I tried automating some apps and the problem was that a lot of stuff was never reachable, only via screenshot + click
Cool idea! Does this work with electron apps? I tried automating some apps and the problem was that a lot of stuff was never reachable, only via screenshot + click
Yes, electron apps expose a reasonable accessibility tree through Chromium's UIA/AT-SPI bridge. We've tested with Spotify (Electron/CEF), VS Code, Slack, and Chrome itself.
The tree is shallower than native Win32/WPF apps, but key interactive elements (buttons, inputs, lists) are usually exposed. You can check what's available with: