I work from home with a 3 year old and ~6 month old (and my wife) in the house. It's not a problem. The three year old knows that when I'm in basement it's off limits and she respects that. It's great to be able to go up and have lunch/coffee break with them!

A nice set of headphones is mandatory though ;)