What's the point of minimalism if not
    to reduce one's impact on the world? Am
    I understanding this "movement" incorrectly?

It is very similar to agile. Don't optimize prematurely. "You aren't going to need it"