I always like to look at their support, uptime and usability. They can have all of the features in the world but if they don't support you or keep your site up it doesn't matter.