This is super great. The biggest pain point of Asahi Linux is how it doesn't have GPU acceleration on M3 and newer, especially now that M6 is out!
However, Asahi Linux has a strictly no-AI policy [1]. So this great work can't be upstreamed. I expect to see a bunch of AI-assisted forks that get things working smoothly on newer hardware to dominate as most people just care about getting stuff working, while only a handful of purists stick to the non-AI version running on ancient hardware.
:) I think we have a surprise in store here. Asahi don't have a monopoly over Linux for Apple Silicon, and upstream Linux absolutely does *NOT* ban LLMs.
i install proprietary modules for nvidia all the time, i'm not going to care if i have to do it for something else that i own
Nvidia's kernel module is open source these days, it's the usermode stack that's still closed.
Even though the kernel module is open-source (sort of, development still happens behind closed doors), it's still an out-of-tree module, rather than being built into the kernel, which would give you as smooth an experience as with AMD or Intel, who's GPUs literally do just work on any distro with no fuss.
It’s never gonna be a smooth experience with Linux on Macs, because of installation, but also firmware upgrades etc. there’s always some manual steps involved and nothing will change unless Apple itself starts supporting Linux natively
Can't wait for someone to point an LLM at that and "open it up" ;-)
Asahi's long term goal is to get everything possible merged into the (actually) upstream projects anyways so any distro can just work. It'd be nice to see that continue rather than have forks on forks for the sake of singular differences (and it looks like proper upstreaming is what they are going after per the Remaining Work section).
> upstream projects anyways so any distro can just work
This may never end up working like that, considering how complicated installation is, comparatively speaking, and how macOS is still pretty much required to be installed.
You can make the Linux installation on Apple Sillicon Macs pretty painless nowadays. One terminal command on macOS, reboot to Linux, run one script - voila.
Yeah, but it's unlikely such installers will be officially supported by the distributions, which was my point regarding upstreaming.
I imagine either they or others can take their discoveries and write a real driver now, though. The hard part was always the reversing the black box system.