Even when the drivers are open source, it's far from easy. I'm thinking about these old Linux 4.2 touch screen drivers, they are there, fully open-source and despite that, almost none of them are in modern mainline.