There are certainly a few of the cheaper places that I avoid like the plague after a few bad experiences with clients using awful hosting.

I rate Crystaltech.com quite highly for smaller sites that can live on shared hosting. Not as cheap as they used to be with the changing exchange rate, but good servers and excellent support.

Most of the stuff I work on these days tends to be on dedicated boxes, and I recommend Rackspace highly. They really aren’t cheap, but you certainly get what you pay for, service and support is top notch.