> If I pay with cash, then fraud amounts to getting actually robbed.

Getting robbed cash in your wallet you are 100% out of the money. But fraud on a debit card must be made whole by the bank within 30-60 days per “Regulation E”, which offers similar protections to debit cards that credit cards receive under “Regulation Z”