Heh I’ve been doing almost the same - back testing against PR comments - and opus 5.5 matched fable 5.1. About $24 for 10 PRs.

I was surprised how much worse Astra did on correctness; I stopped testing with it. Gonna try sol and Luna but low confidence