High-skilled labor often depends on low-skilled labor, though. If you want a chip factory, you'll first have to find someone to pour the concrete. There is no reason that being "below the average" has to imply being a net negative, both high-skilled and low-skilled labor are essential for a well-functioning economy.