In Japan sexually explicit comics are strictly 18+, clearly marked as such, and are sold as you would sell liquor or cigarettes. Making sure children don't have access to these is a matter of public awareness and parental guidance — it seems to work pretty well there.
> I know people who have been messed up when they were very young and found it.
Messed up from lolicon (i.e., Japanese comics featuring minors in sexually evocative situations) or messed from access to porn in general (or even actual child pornography)?
Violence, hate speech, gore, (adult) porn; even written fantasies containing content that may stimulate forms of destructive behaviour — the list is endless! Either you shield children from all of it (which is sensible for young children, but not tenable for teenagers) or you educate, guide, train, and accompany your child as they learn to handle an ever increasing amount of freedom. Parenting and education are key here, not banning everything that may harm a child's mind.
When everyone else is either judging you or trying too hard to pretend that nothing happened, you internalize a sort of guilt or shame that can haunt you for life. People who have seen terrible shit in their childhood but turned out okay, on the other hand, often report that they had someone to help them understand what was happening without rushing to a judgment.
Children usually want to tell everyone about what they saw. If they keep it to themselves, it's often because they understand that someone else would judge them, punish them, get angry at them, feel disappointed at them, etc. for seeing it. Their friends might have told them that it's taboo. Their parents might have acted really awkwardly around similar content in the past. Or a predator might have said that what happened in the shed is a cute little secret between them.
Whatever reasons they have for trying to hide it, it's a symptom of a society that discourages talking frankly and objectively about certain kinds of things.
Adults looking at it is of course harmless, but don't make it easily available on the internet. If you do I'd say you're acting immorally and I support legal repercussions. I know people who have been messed up when they were very young and found it.