The value for being in the office for me was in the spontaneous connections with folks that weren't in my immediate work unit. Those connections have lead to every job I have had. The best kinds of jobs are the ones that come to you and you don't have to interview for; and you just aren't going to get anywhere near the numbers of those opportunities without "pressing the flesh".

If that's not a concern for you then have at it. But if you are at the start or mid way through your career, are motivated and still hungry for advancement I'd be VERY careful of spending too much time full time remote.