Different levels of physical affection often make it clear. Put another way: you can't always rule out wife. You can often rule out daughter. But we also don't particularly care about being accurate all the time.