Would also highly recommend the HousingWorks Bookshop in Soho - they have a really incredible selection of both fiction and nonfiction, as well as art books. I am a fan of Book Thug Nation in Williamsburg, Molasses Books in Bushwick, and Mercer St. Books right near Washington Square Park.