You can't be a good designer without knowing your format. And working with those would seem like hell, I guess.
That's the issue though, you can't really learn the format without doing work in it.
There needs to be a "Oh, pushback, let me listen then change things" that many people lack when they're not experts in the area.
That said, there are people who listen exceedingly well when they're not experts and are a pleasure to work with.
I do professional iOS development all the time, and have had the pleasure of working with some really good design teams while working, who are there the entire process, but I've also had the occasion when a design is handed down by "god" and they won't do a damn thing to adjust to what's actually possible or doable.
The communication style of designers also irks the hell out of developers. There is argument by emotion, argument by reputation and argument by logical reasoning. Most devs do the latter as a default thing. Many (I'd probably not say most) designers shoot at repuational argument overly quickly, relying on inchoate notions of things they can't really verbalize well.
The fact one side is saying "Trust me, look at all the stuff I've done" and the other is saying "But this is that way and that is this way" leads to a horrid clash of communication style. This is only exacerbated via email, which is how much OSS gets done, as email is exceedingly logic based.