We use the ONNX runtime for small models in the browser https://github.com/microsoft/onnxruntime
And ONNX is what Transformers.js uses as well, at least for the moment.
Yeah ONNX runtime or Burn-rs are great because they compile to wasm
And ONNX is what Transformers.js uses as well, at least for the moment.
Yeah ONNX runtime or Burn-rs are great because they compile to wasm