Because people and, perhaps, objects that can't be readily distinguished from people stand on sidewalks and at curbs all the time without an intent to walk into the street. There's a fine line between defensive driving and driving so conservatively that you're constantly applying brakes because "something" might happen.