Vpsdime is pretty nice. IIRC they provide linux servers for $7 per month.

Have used them for years. I don't use them anymore but that is because I no longer have a requirement.