Indeed, and for a layman like me it even sounds quite plausible that this could be what is making people go "mad as a hatter": https://en.wikipedia.org/wiki/Erethism
Add to that that the routes of administration preferred by heaver users (smoking and injection) are also those that maximize the harms of mercury exposure.