At least for the last three or four windows, I would want strict LRU behavior, because that’s automatic muscle memory. I could see a “smart” heuristic be potentially useful for less recently used windows, although I have a hard time imagining how that could be significantly predicted from prior use.

This.

I wonder, OP, what is it that you dont like about how it just uses your most recent windows in order of last opened?

This actually works fine a lot of the time. There are just cases where that isn't the window I want to switch to. I wanted to find a solution that would cover more of these cases. One example is when my computer starts I have a some applications that automatically run. I don't want to tab through the Alt + Tab list to get it in the right order, I want it to be ready to go.