When I've been on the other side of this -- ie, as a candidate rejecting a decent offer -- I've made a point of writing a personal non-boilerplate "letter" (email, but tone and format of a traditional letter) -- thanking those on the hiring side and giving some context for my decision. Relationship-building and mutual respect are only ever full of win.