Launch HN: Lightly (YC S21): Label only the data which improves your ML model

Re:Launch HN: Lightly (YC S21): Label only the data which im... by dest on Tuesday August 10, 2021 @01:46AM (#28125500)

If the dataset mostly contains edge cases, model performance on the dataset is going to be poor, but it's not an issue I think.

But how could the real-world accuracy be computed? Is a separate dataset needed for that purpose?

[ Parent | on HN ]

Re:Launch HN: Lightly (YC S21): Label only the data which im... by isusmelj on Tuesday August 10, 2021 @03:53AM (#28126185)

When learning ML at university one assumes that the data you have well represents the environment. We do the famous train/validation/test split and train our model.

However, in practice we see that it is very hard to collect a good dataset. There is a great twitter thread from Abubakar(CEO Gradio) about this topic: https://twitter.com/abidlabs/status/1423067498862219267

[ Parent | on HN ]

Re:Launch HN: Lightly (YC S21): Label only the data which im... by dest on Tuesday August 10, 2021 @03:59AM (#28126214)

Thanks for your answer. I'm seeing a tweet, but not a thread. Is it expected?

[ Parent | on HN ]

Re:Launch HN: Lightly (YC S21): Label only the data which im... by isusmelj on Tuesday August 10, 2021 @03:19PM (#28132999)

Yes, sorry. I meant he started a good conversation with his tweet.

[ Parent | on HN ]