There definitely is a difference between behavior that has a direct adverse impact on society, and pedantic attempts at portraying non-disruptive behavior as antisocial. A skateboard rolling down the street at night and waking people up is causing direct adverse impact, someone reading in their home does not.
Is it practical to stop reading because a tree gets cut or your ereader needs charging? Probably not, but that's why change doesn't happen until it's forced by the circumstances.
Regardless, it's still a false equivalency to try and equate directly antisocial behavior like making loud noises that disrupt people's healthy sleep and the sustainability of producing paper, some of which is used for printing novels that people read in their homes.
With that definition, we could classify just about anything as antisocial.