How to select a web hosting service

So you’ve decided it’s time you got your own web hosting account.  Congratulations!  Once you start researching various hosts, it can be a scary thing though.  So many options and choices, where do you even begin?