"something weird"

There's nothing weird about pm.me

> I tried using my own domain at a bank once and they started questioning whether it was a fake email or something.

So just say "Yes, that is my actual email" and the issue is solved.