There are several [replications and comments from reviewers](https://transformer-circuits.pub/2022/toy_model/index.html#c...), so yes, it is.