I think a lot of that has to do with changes in the google search algorithm. Years goneby forum posts and discussion boards were frequently featured at the top of many searches. Nowadays you have to give google a hint as you suggest. I don’t know why it was changed, but I suspect that the reason is that very few forums have ads on them and google would prefer to send you to ad rich sites.