Yet I can't drag and drop a plain old HTML file without putting it in a folder or a ZIP file first.

You can, the file just has to be named "index.html".