> Those specific users won't use it anyway even if you add it

These users often understand what features are missing because they rely on them in other products. At that point your product is already dead to them.