Re:Snorkel AI: Putting Data First in ML Development
by ajratner on Thursday July 16, 2020 @05:14PM
(#23863891)
Yup! The LFs can also actually be correlated- just not too correlated (roughly, think of needing at least three mostly uncorrelated cliques, to be precise).
Part of the high level description, though, is that a lot of different parts and lines of work are integrated into Snorkel Flow beyond just this original programmatic labeling idea. So also programmatic operators for data augmentation, "slicing" or partitioning of data, and the overall end-to-end platform (UI + SDK) supporting iterative development of ML models via this paradigm of programmatic training data.
Re:Snorkel AI: Putting Data First in ML Development
by jacques_chester on Thursday July 16, 2020 @12:22PM
(#23860526)
The description reminds me a bit of learning classifier systems.
Edit: and a bit of fuzzy rule systems. Which just goes to suggest that I am probably well out of my depth.
1. Generate many different nosiy labels for your data by writing functions. These don't need to be correct, but they should make uncorrelated errors. They are basically domain knowledge you have of your data.
2. Snorkel takes the output of these functions, and based on their (dis)agreement, builds a generative probabilistic model to uncorrelate your labels, which may have had some overlap in the errors.
3. You train your final discriminative model on the output of that probabilistic model.
So, the main idea is to create many noisy labels instead of relying on a single high-quality label and Snorkel does the hard work of figuring out how to smartly combine these labels so you can train on something clean.