I've seen people say this a lot, and I have the exact opposite takeaway. Figma is one of the slowest and laggiest applications I've ever used and a shining example to me of why we need to stop building rich software experiences in web browsers.
On Linux + Firefox, basic navigation, like panning and zooming around in a file, is painfully laggy. In FigJam, try using the marker to draw any curved line--it updates at like 2 frames per second, which makes it completely unusable for handwriting text or drawing diagrams. Excalidraw, on the other hand, in the same browser, is perfectly lag-free.
Every time a designer sends me a Figma I just ask for exported images because using the website is an exercise in frustration. And don't even get me started on the impossible, spaghetti-on-an-infinite-canvas UX requiring endless zooming and dragging...
I use Figma every single day for work, and have virtually no performance issues, even with projects with 100s of frames.
I just tried using the marker in Figjam, and it works perfectly fine for me. I think you may be running into an incompatibility between your browser or settings and Figma.
As for the infinite canvas, this is very handy as a designer, it makes it much easier to work across multiple frames at once, such as quickly zooming out to look at the flow or building a prototype, all the while zooming in to fix issues.
I get what you are saying, but have you tried Clickup? For a glorified todo app, it manages to be so slow that Figma feels like a breeze.
I also happen to use Linux + Firefox and so I have to agree that it is definitely not a joy to use Figma, even for small projects.
Why don’t you use a different browser to work with Figma files if yours can’t run it properly?