I agree with you. The feeling that grass is greener might play a role here, as I've already seen the 'ugly' side of DS, but not of SWE

But I thought I could easily come back to ML if I want to after SWE jobs given my prev experience. From inside the industry, I see that companies really want Data Scientists who know how to code properly