> We are using mistral-common internally for tokenization and want the community to use it to unlock full capacities of our models. As mistral-common is a Python library, we have opened a PR to add a REST API via FastAPI to make it easier for users who are not in the Python ecosystem.
A cpp binary depending on a python server is a bit sad.
I hope this is a stopgap measure and someone port it to C++ eventually:https://github.com/mistralai/mistral-common/blob/main/src/mi...
Isn’t llama.cpp already depending on Python anyways for the templating?
It uses a cpp implementation of jinja https://github.com/google/minja