I’m not arguing for changing the behavior, but for changing the label. Safari uses “Download Linked File”, which makes much more sense.

And I'm arguing that this term is used in exactly that meaning everywhere and is the expected use of the word "link".