The problem is that many wifi adapters require loading a binary blob at initialization time. "Burnt-in" firmware is practically the same as hardware, which you already trust since you bought it.

Not so much for the firmware blobs the vendor maintains in the "linux-firmware" kernel.org repository and that are absolutely required for the device to function.