The problem isn’t the performance of the battery but the safety. A dead battery for this always-connected use case is probably a non-issue. A swollen battery that could explode or catch fire is definitely an issue.

You could take it out but many phones won’t work without a battery so you need to find a way to trick them into thinking one is installed.