Re:Dataturks – ML data annotations and labeling doesn't need...
by gajju3588 on Thursday April 19, 2018 @04:24AM
(#16874230)
Hey, Thanks for checking us out and the inputs. API access is getting ready to launch as I am typing this.
Agree that rater reliability is a very important thing which will matter here, ultimately it converts to dataset quality. Over the period of time, we would show dataset quality in some form using feedbacks from dataset users.
One of the things I'd look for in a product like this is easily doing rater reliability & interrater reliability.
Optimally I'd love to see a project also allow for easy semi-supervised labeling. I don't see an API for grabbing data points for a model you are training to label and put them back.