Re:Snorkel AI: Putting Data First in ML Development
by woeirua on Thursday July 16, 2020 @03:26PM
(#23862831)
Does it work for semantic segmentation? That's really where I'm struggling to see how this could work.
Re:Snorkel AI: Putting Data First in ML Development
by ajratner on Thursday July 16, 2020 @05:18PM
(#23863934)
More advanced structured prediction tasks are still definitely on the cutting edge- mainly IMO down to defining the semantics of the programmatic user input like labeling functions for these kinds of tasks. Some recent work (http://cs.brown.edu/people/sbach/files/safranchik-aaai20.pdf) has extended these semantics for sequence tagging, as an example- so some exciting moves in this direction!
- As you imply, a lot has to do with the available sources of input signal- whether labeling functions, or 'transformation functions' for data augmentation, or other ops we've worked on... the input is obviously key.
- For data modalities like image, video, etc: Often the most successful approach is to (A) rely on some pre-processed features or "primitives" and write labeling functions over these- as my co-founder Paroma in particular has published about over the years- and/or (B) use metadata
- External models are definitely expressable as labeling functions, and we've worked on exactly that problem of modeling (local) biases and correlations!