Re:A better way to build ML: Why you should be using Active ...
by rocauc on Thursday February 04, 2021 @04:22PM
(#26029959)
Makes a lot of sense, thanks. I'll need to dig deeper into Bayesian active learning techniques.
Re:A better way to build ML: Why you should be using Active ...
by pgao on Thursday February 04, 2021 @06:39PM
(#26031123)
Here's a great paper to get started with! https://arxiv.org/abs/1703.04977
Entropy selection for pool based methods looks at the output probability for each prediction of the model in the unlabelled data-set. Then it calculates the entropy of the distributions. (in classification this is a bit like looking for the most uniform predictive distributions) and prioritises those.
Entropy based active learning works ok but doesnt distinguish uncertainty that comes from a lack of knowledge (epistemic uncertainty) from noise. Techniques like Bayesian Active Learning by disagreement can do better. :)