After two weeks I was panicking over things like customer Hipchat meetings in which participants were using other channels to mock the customers (not shared with the customers, of course) with porn clips.
I noped out of there after two weeks. They gave me puppydog eyes and made all sorts of promises but...nope. Just, nope.
What really did it for me was when we all went out for someone's "birthday" (it wasn't their birthday, the team had put cards in at a few restaurants with different dates for their birthdays to get free stuff, whatever, the restaurants don't care, but it was just weird) and most of the team berated a guy who was trying not to drink so he didn't order a beer. You could tell the guy was uncomfortable, and they just kept goading him for the entire 2hr lunch.
After a week and a half I called back a company I had turned down for this one and asked if they would still take me. Started there the next Monday. That was 10yrs and 2 jobs ago, and easily the best decision I had made for my career.
I could see that in the best case, I would be there long enough to get up to speed on my position, just in time to leave. That wouldn't do a service to the company, so I gave my notice after 6 weeks.
To my boss' credit, he offered that I could stick around for a while until I found my next gig. Looking back, I guess this served his interests also — it would have been hard for him to recruit for this position if a newly-arrived team member left so quickly, following on the heels of several other departures.