It all factors in. SpaceX has performed grasshopper tests on windy days that would be a problem for a parachute landing. There is also the issue that parachutes sufficient to slow down the stage to a soft land-landing would be far too heavy.