You need a VPS, correct? Are there any concerns about hardening your VPS from attackers? I worry about my ability to harden a public - facing service that is handling something so critical for myself.

Don't make it public facing! Put it behind a VPN!!

Use a host that takes care of this for you.

My host has prebuilds for Vaultwarden.