Not the best analogy because coffee has massive quality differences that anyone can tell in a real comparison. Brewing at home is also cheaper and requires nothing more than a $20 French press.

I have personally administered double blind taste tests to four unrelated coffee drinkers who believed their current coffee (Keurig, Nespresso, pre ground) was good. They all thought the actual good coffee was much better in the blind tasting, to the extent that they all permanently stopped drinking their previous coffee. Exclamations of shock occurred.

Coffee is a commodity only out of ignorance. It should be treated as fresh produce of numerous varietals.

Have there been any such "tastings" of LLMs?