I expect it's mostly a reflection on the learning data in language processing. Almost any corpus of text you can easily find for experimenting is close to standard English. Dialects very rarely appear in published texts unless it's just to point out that a specific person being quoted uses that dialect.

Choose a student of any colour. When they need a text corpus for research, do you think they'll reach for a different, known, large text collection that matches their background?