Oh, it's not gone, but as you say it's small and getting smaller. About half of my regular haunts (the ones that still exist, anyway) have withdrawn from the public web in the last couple of years and gone behind login walls in order to protect against crawlers. That's why I suspect this is the direction things are going to go.