Jitsi's end-to-end encryption passwords would be a reasonable choice (if your clients are capable) and you would need to memorize those separately from a room name since Jitsi's servers don't do anything with the encryption
(If you join a Jitsi call with say, four other participants using a password you don't know, your copies of their four audio and video streams are nonsense, chances are your decoders will give you silence and a black rectangle, although weird glitched blocky nonsense video is also possible and I guess it's conceivable you'd likewise get weird audio nonsense)
Doing it this way also lets you turn off authentication if you decide you don't need it and lets you use the same password if you need multiple conference rooms. This is the best solution in my opinion.
> If you join a Jitsi call with say, four other participants using a password you don't know, your copies of their four audio and video streams are nonsense
Not in my experience. Jitsi won't let me enter the room at all if I enter an invalid password.