Yes, this is a valid point, mnemonics are totally valid when you are new to a concept.

I'm learning Turkish right now for example, and the dative forms for me/you (bana/sana) perfectly fit the accusative conjugation pattern in my native Polish. So my mnemonic is explicitly "the opposite of what you feel it is".