FYI something in that region happened last august/September. Some inference bug triggered worse performance on TPUs vs GPU.