It depends on the type of quantum computer. In some a physical qubit is a single atom, but then to make it reliable they need to add error correction resulting in logical qubits consisting of at least 100 or so physical qubits.

Another type of quantum computer uses qubits consisting of "quantum circuits" which are actually huge macroscopic constructions (> 1mm).