IANAL but if their delivery guy commits a crime, it’s on him. If it becomes known that Amazon knowingly contributed to their delivery personnel committing crimes, or in some way covered them up, or is in some related way defrauding customers, they carry a legal risk beyond what arbitration covers. Everything is a trade off.

Sure, but your contract is with Amazon, they have a subcontractor, that person steals something, Amazon cuts ties with them, You lost something, Amazon is home free, and you may or may not get your stuff back, but you can't go after Amazon whom you have a contract with.

I doubt there's a scenario in which you can claim Amazon did anything criminal. But IANAL either.

OTOH you can file a claim with insurance, and I bet that arbitration clause does not permit your insurance company from going after Amazon or their contractor to recoup damages.