Hardware crypto has an incredibly low gate count, and essentially all network communication requires crypto. Without it, you waste the (much more power and die-space intensive) CPU on AES.