I love the story of him tying his horse to a pole in the snow at night only to wake up and look up to see all the snow has melted and his horse is hanging from the roof cross of a church.

Are you thinking of Baron Munchausen? That is not an Andersen story.

Didn't know that, but then the book I read was definitely mistitled.