> Cool, but how does it work if you have multiple windows in one app?

You switch to the app, then use macOS's native window-switching keybind (command+backtick) or App Exposé or etc.