I do think names are very important. There's a naturalness with which Normals say "do you have a Facebook?" that they don't seem likely (to me) to have with "Diaspora".
I think that an admirable trait of nerds/geeks/whatever is that many can easily separate symbols from their cultural meanings/connotations. We can treat "diaspora" independently, understanding its subtly ironic meaning (most of us don't think the Facebook diaspora is nearly as significant as other historical diasporas, but we don't take a site's usage of this name to diminish this history, either) but many would interpret such a 'flippant' use as mocking their cultural heritage and the struggles of their forebears.
One has to know one's customers. And ain't nothin' offensive about "Facebook".
It's true that the value of membership in something like Facebook depends heavily on the network effect (allowing you to easily find all your friends there), and without a large community a project like Diaspora is unlikely to acquire sufficient utility to be more than a curiosity. But I really don't think the name will be a major barrier, either to ease of communication or due to semantic association. I stopped worrying about this after we got past questions like 'shouldn't it be W-W-W period com?' and 'what about people who are afraid of spiders?' etc.