The problem is, just like with Bitcoin, when you need to use it someone could steal it

That's a problem with everything (apart from firearms perhaps). I think backyard gold is a solid idea, just make sure no one's watching you dig.