I'd like to add to this that in the recent Y combinator podcast with Anthropic head of pretraining the bugs issue is brought up as a major issue[1].

It is so easy to have good ideas broken by random bugs everywhere...

[1] https://youtu.be/YFeb3yAxtjE?t=2919