Or they could fix cross compilation and then compile it on a normal x86_64 server

Fixing cross compilation is a huge undertaking. So much software needs to be patched to be properly cross-compilable.