I'm fine with a few friends (who I also interact with solely remotely as they live a few hundred miles from me), working remotely and just seeing my wife daily. I love it and have never been happier with a job or my living situation.

As with anything. YMMV. I've never been an ambitious person though, and my job to me is just a 'do what is needed, and no more' type of thing. I'm never out there trying to network or dig up leads on new opportunities either though, so if I wanted to do those things or were more ambitious I guess I could see the appeal of going into the office.

We (my wife and I) do get out quite a bit though, although we're eachother's best friend so we're not out socializing with out couples in our off time (thankfully).