Not just design work though, but also content and features work, which pulls in product development and sometimes, infrastructure people. Responsive/mobile design necessarily makes content disappear or moved around, which can substantially change the function of the site.
For example, in Adioso's implementation:
http://adioso.com/us/new-york-new-york-to-rome-it-next-month...
...resizing to the mobile width hides the "Lock Flight" buttons that are normally placed in the far right. So someone had to agree/argue that hiding those buttons was a worthwhile compromise (as opposed to stacking them on the bottom).
The story of my life! In my entire career as a web developer, the hardest non-technical task I've ever faced is convincing management that we need a designer. I guess they think all they do is come up with some colors or something, because there is never any value given to having someone on-hand that actually knows what they're doing. So frustrating.