.net has TPL, and most languages with locking constructs has similar libraries. Even if you have to roll it by hand, it's the hard part is, for embarrassingly parallel problems, not more difficult than other problems programming professionals encounters. In my experience anyway.