Language is another huge barrier to trade, especially in labor markets. In an alternate, culture-less dimension this problem is solvable by having high skilled workers move to Germany and low skilled workers move to Greece.
The labor markets are as fluid as I've seen them since I was born here, there are lots of Polish, Romanian and Czech workers in more western countries, but comparatively few people from western countries moving to the east.
I'm more concerned with 'border regions' between countries anyway, and for instance, between the Netherlands and Belgium and the Netherlands and Germany there is a lot of cross-border commuting going on, but relatively little cross border trade between companies in the 5-20 employees range.
Language is not as much of a problem here because there are two things helping, the Belgians and the Dutch in the border region speak the same language, and the Germans and the Dutch in their border region have a common dialect (you can speak that all the way from Aachen to Denmark and have a reasonable expectation of being understood).
The local tax entities are paranoid about potentially missing out on some VAT and the rules for getting your VAT back border on the insane, effectively this causes businesses to prefer to do business with others in the same region.
Paperwork can be a very effective barrier to trade. So because only the larger companies are used to dealing with the paperwork the smaller companies which could 'knit' together the member states at the borders are not engaged, which in turn stops the market from really working well and homogenizing the economies to the point where it no longer matters where you do business.