The point is that 'society' is not something distinct from us that we can blame. Society is only the average result of each and all of us individually, like the big, bad 'market' is.

What Thatcher said:

"There are individual men and women and there are families and no government can do anything except through people and people look to themselves first."

Which touches the crux of the matter here.