With the way our society is set up to tie a large number of benefits necessary to live to employment, then yes you are actually harming someone by ending their employment.

Severance might outweigh that harm, but it depends on the amount, if any is given. Also I want to point out that the vast majority of companies give 0 severance. I’ve gotten it once in my life and I’m fairly certain it was “shut the fuck up” money as they had done some shady shenanigans to a bonus I was entitled to.