Second time was at a very small psytrance festival with my wife and her parents. I trust them completely and they are both very nice, and there were not any scary people about.
I would say that a festival (even small and friendly) is possibly not the ideal place to take psychedelics, unless you're very experienced. If you are particularly prone to paranoia, it can surface with psychedelics (even Cannabis) even in good settings.
[0] https://en.wikipedia.org/wiki/Motion_sickness#Defense_agains...
I went on to have a wonderful & memorable experience, feeling closeness & positivity with every human interaction for hours. The worst part after I got over the initial freakout was coming back down. I've heard people talk about such early-stage freakouts happening on other psychedelics, too, but I don't have much experience there.