I wonder if there's a form-factor that looks like an ATX expansion slot (perhaps dual slot) type system with PoE powering it and all the electronics on a PCI-card form-factor. Then the whole thing can all fit on the case neatly, and we just have to plug in from the case to the case and run two Ethernet instead of one.
EDIT: Anything I can think of, China has already built https://wiki.sipeed.com/hardware/en/kvm/NanoKVM_PCIe/introdu...
Amazing