There’s a clear ethical distinction between not actively helping someone and actively harming them. I don’t have to lend my neighbor my lawnmower, but I definitely shouldn’t shit on his grass