Friction. Work isn't just about height.

Holding that block stationary at arms length then. 0 work.