I absconded from all my moderator positions a while back. I was nervous about it, leading up, but it felt so freeing afterwards.

I highly recommend it. Once you've stepped away, you'll wonder at how you could ever have felt so deeply invested in it.