AA has dramatically altered their methodology twice in just a few weeks. I really don’t see the utility in their composite scoring anymore - it’s basically the US News college rankings of LLMs.
For the time being, LiveBench seems to provide a better calibrated signal.
More than twice. They have done it every time openai fell behind.