Very interesting. Is this compatible with MoE architectures? I'm not too familiar with how this works.

It is compatible, and Qwen3.8 Flash Next is MoE