Asahi Linux doesn't support the M3 or M4. That said, I'd be curious why OP doesn't consider Asahi on M2 to be a good option. AFAIK the only thing missing at this point is Thunderbolt and USB-C display output (HDMI out works fine).

There are a few draw backs. dnf for arm linux doesn't support Tor Browser yet!! Power saving was quite bad when I tried a few month back. When on sleep mode, it drains more battery than on MacOS sleep mode.

There are a few other compile/transpile bugs here and there.... but I'm rooting for the it!!! Hopefully they can get sorted out soon.