Check out relatively recent Google TPU paper where they used an optical switch to connect neighboring TPUs
https://arxiv.org/pdf/2304.01433