The problem is that there are just so many planets. Sure, another planet could be 500My slower, but with a billion planets, some of them should be 500My faster instead.
It's possible we are absolutely one-in-a-billion uniquely lucky - after all, someone has to be the first and the luckiest. But every year we find indications that our planet is completely typical.