new | ask | show | jobs
stingraycharles 7 days ago  [ - ]

What latency? How much is it compared to LLM inference speed?

storus 7 days ago  [ - ]

See the Redpanda comment/link here.