Externalities are a separate thing. They have a cost, but internalizing them also has a cost in overhead and enforcement etc. For large externalities that's worth it, for small and diffuse ones it often isn't because the cure is worse than the disease. It does you no good to spend $100 to prevent $50 in harm.