No real marina in Bath, so you'd want a house on water with dock. Lovely place though for sure. Especially if you long to "get away from it all". One consideration for Little Washington is that for more sophisticated shopping and especially medical care, you have to go to New Bern or Greenville. Likewise to see a movie. One reason our friends here in New Bern who have businesses in Little Washington commute. Beaufort County has traditionally been pretty aggressive with incentives to people bringing new businesses in.
Another issue, for us at least, is that it is something of a haul to get to cruising grounds from there (or New Bern to a certain degree as well, which is why we moved the boats to Morehead City). But all of these issues are personal preferences and perceptions and choices.