I think the font is just "different" enough that it sets off something in people.

Ironically, it's also the default font used by Excalidraw (Virgil IIRC), and people seem to generally like the style + legibility of Excalidraw-drawn diagrams.