It's very easy to do this with LXC containers in Proxmox now, as passing devices to a container is now possible from the UI.

Just as easy with VMs, just have to pass the device to the VM