It depends on your needs. You may recoup the perceived investment losses via tax savings or other factors.

Also, when you get into aging family members and generational wealth issues, you want to have controls to reduce your immediate control. Decades of accumulated returns can be wiped out by a bad decision.

If I had billions to worry about, I’d want to make sure I had assets that were more diversified than what Vanguard offers.