Interesting, Amazon doing the same for AWS Trainium.

https://github.com/aws-neuron/torch-neuronx

Pytorch conference is happening today for explaining the coincidental timing

That explains the 5x speed increases huggingface mentioned for Mac using metal.

Link?