I've worked in organizations that were from ~20% remote to ~90% remote (for the teams I worked with), and while I've never been the boss - never had more than a couple of people reporting to me - I observed that somehow the bosses' work was getting done, and the organization has not descended into chaos any more than usual. I have to conclude from that that there are ways to run a remote engineering org, with results no worse than for a meatspace-local one. Maybe you're just about to discover them.