Now many mini-PCs and desktops are able to read simultaneously from 1 PCIe 5.0 SSD and 1 PCIe 4.0 SSD. This can ensure a reading throughput around 20 GB/s, i.e. 20 times faster than on author's system.

With only 1 PCIe 5.0 SSD, the reading throughput is still significantly more than 10 times faster than on author's system.

So it is likely that inference speeds around 1 token/s are achievable on something like a NUC mini-PC.