The user-facing software is not included in the kernel, but you need that to configure wireguard.

Is that true? I thought wg-quick etc were just convenience functions and that it's relatively trivial to use iproute2 to configure a VPN link

You don't need wg-quick. You do need the "wg" command.