I've experienced the latter (cosmic horror from ego death) and it was the worst experience of my life. From drugs, though, not meditation. But it was pretty similar in character to the "dark night of the soul" that I've heard some people have experienced from meditation.