Yeah, that's not how it goes. If it does go that way (some people for example might have mental issues and go into the street, or be disoriented etc), it's not usually held up to the driver if they are hit, except if it's shown that they could have realistically prevented it.