I think you are referring to this type of law: https://en.wikipedia.org/wiki/Freedom_to_roam

However, it is common in Sweden to respect unwritten laws and social conventions. Many neighbourhoods also have neighbourhood watch and such things. I haven't lived there for over ten years but I'd imagine not taking shortcuts through neighbourhoods with children would be a convention most swedes will respect.