Someone tell this man about vLLM!
they did rebuild their serving layer from fastapi to some rust thing so...
they did rebuild their serving layer from fastapi to some rust thing so...