I think it is probably worth the extra cost. I use another "premium" VPS vendor (RimuHosting) to host all of my Clojure web apps and the extra quality of service is worth it.

I think you do make a good point if you are saying that for some projects the cheapest possible hosting makes sense.