The prevalence in crust doesn't really matter, what matters is how much is actually in recoverable ores. Rare earth elements, despite their names, are actually reasonably common: about as common as tin or cadmium. Hell, cerium is more common than copper. They're called rare earth elements in part because it's hard to find a high enough concentration to extract and in part because they're so hard to separate from each other.