> Ollama's default context length is frustratingly short in the era of 100k+ context windows.

Nobody uses Ollama as is. It's a model server. In clients you can specify the proper context lengths. This has never been a problem.

For sure, though it's tripped me up a few times for clients that don't pass in a reasonable context length with each call.