it's all just driver/options crap if I were to take a guess.

there are a lot of usb options that matter, and tp-link ships lots of realtek chipsets that require very special driver incantations that a lot of the linux drivers simply don't replicate.

two+ layers of bad options will surely add 4ms quick.