They keep all recordings because they train their voice recognition off them. GOOG-411 kept all recordings too, for the same reason, as do hundreds of other services, but I don't recall anyone caring about them.

Google gives you a UI to view and delete your recordings and suddenly they're monsters.