How do you do that, by default? Can you tell an IMAP client to work like POP3 and download everything?

In Thunderbird you can "Select this folder for offline use".

Some you can