Being dependent as a fall-back seems like that's the right solution: Provide your own index, but vector in the default if you don't get it right.

That way users get tailored search without losing scale.