The thing you have to remember with that $165k spend on tokens is that token prices are going to keep rising, and models may not get much better. I wouldn't be surprised if doing this same migration in 6 months time would end up costing $250k+
The thing you have to remember with that $165k spend on tokens is that token prices are going to keep rising, and models may not get much better. I wouldn't be surprised if doing this same migration in 6 months time would end up costing $250k+
For sota perhaps but not convinced token price will shoot up if capability is held steady
do you think price per task completed will rise as well?
Isn't that equivalent? The task here was port Bun from Zig to Rust. He's saying that task will cost more.
That's not the direction of LLM progress these past 2 years. Cost has always decreased per unit intelligence. Open weight models with lower parameters beat gpt4 that we were so impressed by.