AWS Bedrock doesn’t even try to stay on top of new open source models or their API capabilities. We’ve also run into also kinds of frustrating issues rate limiting and slowness issues. GCP is probably the best alternative now that they have actual spending caps, I believe a lot of Openrouter models are run on GCP.

The other popular option is something like LiteLLM, which just has a major vulnerability that left a lot of big corps exposed. After spending a year trying to fight this battle, I’ve decided OpenRouter is worth their cut (and maybe more but don’t tell them).