If you don't have a Princeton ID, you aren't going to be allowed into their libraries. You _might_ be able to attend lectures, but basically everything else will be off limits. Good luck joining a study group.

If you are genuinely capable of learning everything alone, just from lectures, there's no need to move to NJ. It's all online anyways.