The problem is non-linearity. Moderate increases in temperatures can have catastrophic effects. While warming can be moderate at the planetary level, changes can be dramatic locally. Droughts and failing crops lead to massive migration (which we're already witnessing). Changing climate has brought tropical diseases to temperate climates.