If said this way he was a jerk. So good on em for making a joke.
"Why would this take so long?" would be better.
Could mean "I didn't know you had so much stuff on your plate that takes precedence". You're giving 0 benefit of doubt to a PM who in my opinion was right to push back because for a non-technical person it's not easy to grasp why drag and drop should be so much harder than other similar impact features.
Ah and there's the rub. A PM in a software project should not be a non-technical person (because tbh what's even the point, how would a 'non-technical' person even be able to evaluate technical decisions and their implementation?)
Would you fly in a plane, or drive over a bridge that was built under supervision of a 'non-technical' PM?
The head of a space program doesn't need to be an astronaut. An admiral doesn't have to know how to swim. A PM doesn't have to know all the various engineering disciplines the project may touch.
The comment was derisive, and therefore poor leadership. Period.