I get what you are saying, but have you tried Clickup? For a glorified todo app, it manages to be so slow that Figma feels like a breeze.
I also happen to use Linux + Firefox and so I have to agree that it is definitely not a joy to use Figma, even for small projects.