If you don't know why the fence was there, how do you know that it's not still useful for that original purpose, outside of you playing soccer.

The point is to never tear down fences, because you can never quite know why it was put up. You can know that a fence isn't useful to what you want to do, but Chesterton's fence just doesn't apply