there are already projects like Petals https://github.com/bigscience-workshop/petals