How secure or insecure a device is is unrelated to whether its source code is public.
Disclosure: I might be biased on this, as I'm a reverse engineer.
So you'd still need some mechanism to force-update devices in response to vulnerabilities found in open-source end-of-support firmware.
So this would be bad for manufacturers releasing secure well designed devices without security vulnerabilities.... But if you think about it for a second, isn't this good? As long as there is no known vulnerability, the manufacturer can say the device is still supported, and it costs them nothing, as they have no reason to release an update. And well, if there is a security issue, then it might be better to have the source and keys after all?
Also, there are instances of hardware security that totally rely on obscurity, like secure enclaves or the iPhone passcode unlock.
The vulnerabilities exist and will be exploited either way. But with source available, we now have the possibility of a whitehat group springing up to patch them.
Would you rather have no chance of ever patching exploits or giving people the ability to patch them?