Actually, I got both:

- Cheap VPS is nice for electric & network reliability (mail servers, public facing website or webapp)

- local hosting is nice for price/control/internal tools (some git and maven, different tools)