Distributed training has been on their to do list for a good long while iirc