Every company I know that has a design system the developers actually use based their first version on an open source library. Companies do exactly what you're suggesting. Their design system is usually little more than a config file for the library they've based it on, with some custom components for the bits that don't come by default.