News for hackers. Stuff that matters.
Re:Datasets for Machine Learning by laichzeit0 on Thursday June 14, 2018 @07:15AM (#17310778)
I'm not an expert, but I feel that:

Unsupervised techniques work really well for language modelling.

There is also weakly supervised and distant-supervision, where the labels are "noisy" or not exactly what you want.

You're right in that strong supervision, where you basically trust your class label, works really well, because it's probably the easiest case.

Combining unsupervised (e.g. pre-trained language models) with a very small set of strongly labeled data, or a larger set of weakly labeled data, seems to work pretty well too.

There are no comments on this comment yet.