Many don't do this because they don't feel the need. I've spent about a decade in the US as a green card holder, and the only cases I ever been asked for it is either crossing the border or being hired. And I never heard about anyone being fined (let alone going to prison) for failure to carry the green card on them. Yes, the law says that, but I don't think anybody paid much attention to that, at least until now.