Did you sign an offer letter? If so, you've probably burned that bridge and several adjacent.

If not, it's touchy and tender, but not necessarily a mark against you.