How much of this ability to replicate is down to the openness of the science community and the paper on transformers being accessible by anyone?

Even if the transformer paper wasnt published, the info would have diffused out eventually.

Its not that wild of an idea. It's not like e.g. chipmaking where even just knowing how things are done doesnt mean you can copy it.