It could be a much bigger MoE model

Then it would be slower.