I'm not sure if that distinction makes much of a difference since the vast majority of debit card theft is not via the physical card, but through skimming.

Debit cards do have the disadvantage of your money being gone until the bank makes you whole. But I'm not sure if the liability is really any different (unless physically stolen and not reported, I guess).