Try running plain sh / ash interactively without readline, and notice how much pain it is.

But I agree that having multiple windows, etc is a whole new step; it's just a limited GUI accessible easily via SSH. Could involve sixel graphics as well.