Re:The Illustrated BERT: How NLP Cracked Transfer Learning
by nl on Monday December 24, 2018 @04:15PM
(#18754301)
I build commercial applications built on the FastAI language model (similar to this) in a legal domain.
It’s a per sentence matching task, and it increased the accuracy ~5% (!!) over a tuned FastText classifier, which in turn was much better than a traditional n-gram based classifier.
The accuracy is now good enough (and human like enough) that trained humans generally disagree with each other when trying to correct its “errors”.
It’s a per sentence matching task, and it increased the accuracy ~5% (!!) over a tuned FastText classifier, which in turn was much better than a traditional n-gram based classifier.
The accuracy is now good enough (and human like enough) that trained humans generally disagree with each other when trying to correct its “errors”.
Training set size was ~1000 labeled examples.