In europe, with organic foods you have a very clear list of which fertilizers are authorized. And those authorized are not poison, they are not harmful for the organism.

For dirt, you can just wash it. Dirt is not harmful and doesn't penetrate the fruit.

About chemicals, a large part stays in the skin of fruits / vegetables, so it's always better to remove it when you're eating non organic food.