That's one factor, the other is the culture around youth appeal through drawings. Mangas were filled with teenage erotism. So lolicon is not a huge stretch from there.