the xserver implementation itself is only part of the problem. the other part is the X11 protocol is just bad, and IMHO can't be solved by subsetting.

this might make a good alternative to Xwayland though, which can be exciting.