Is the city center doing well, or decaying? I know some cities have vibrant cores but decaying inner peripheries. (i.e. between downtown and newer suburbs)
The big reason I wanted to visit was the history, and also (this might seem silly) because Bill Cosby is from there.
It's also notable that they stopped doing those events at all because booing of new comedians was a general problem everywhere.
Philly does have a lot of problems, but it annoys me that we have a reputation as particularly bad crowds at sporting events etc based on a few notable incidents. If you look at basically any other city where large crowds of drunk obnoxious people congregate they have similar incidents.
Philly really isn't that bad... though I suspect many HNers who are used to the shinier west coast cities would experience a bit of culture shock.