The problem is that veganism is inherently a no-compromise position, the explicit goal is no harm to animals, which makes issues like this a glaring inconsistency.

Other diets such as vegetarianism are much more clearly harm minimization based, which makes it easier to deal with issues like this.