> Because amazon doesn't add seller stickers/labels it's nearly impossible for them to even determine the seller if it's "Fulfilled by Amazon"

You are referring to mingled inventory which the seller has to opt into explicitly when they decide how to sell their product.

This is not the default, and in my experience, very few sellers choose this option. Most of the inventory is labeled with Amazon-proprietary bar codes that identify the seller.