Side note, was that a recent transition? When did it become transformer-based?

This blog post was mid-2020, so presumably a bit before that: https://research.google/blog/recent-advances-in-google-trans...