Re:A.I. Systems Echo Biases They’re Fed, Putting Scientists ...
by YeGoblynQueenne on Wednesday November 13, 2019 @03:27PM
(#21529132)
Well, a language model is supposed to model the way that language works, not the way that language is used.
It might be a subtle difference, but "My mom is a doctor" is as correct grammatically as "My dad is a doctor". If a language model is assigning a much lower probability to the former, then it's modelling language _use_ but not language _structure_.
So it's not doing the job it's supposed to be doing.
It might be a subtle difference, but "My mom is a doctor" is as correct grammatically as "My dad is a doctor". If a language model is assigning a much lower probability to the former, then it's modelling language _use_ but not language _structure_.
So it's not doing the job it's supposed to be doing.