Working remotely is an awesome experience for me as well, but I work for myself so it might be different if you work in a regular job that lets you work from home. I have the ability to ignore customers who are being overly pushy/demanding/rude, and I can take time off whenever I like. I tend to take a lot of breaks during the day to watch TV, do exercise, etc. I'm married, so that is sufficient social interaction for me. For work communication, I find email/skype to be more efficient than being in an office and having "status" meetings every day.

However, I can see that if you work for someone else, there could be a lot of pressure if things aren't going well or if you have a demanding boss, and you might feel trapped being at home and not having anywhere else to escape to.