News for hackers. Stuff that matters.
Re:Visual Introduction to Self Supervised Learning by ivalm on Saturday February 29, 2020 @02:06AM (#22449384)
Two main things you can do:

1) Transfer learning -- start with self supervised model and either fine tune parameters or freeze parameters + add another layer to train your task (with way fewer params/necessary labels since you already learned about the input distribution)

2) Nearest neighbor/clustering -- no need to label all classes, simply fetch similar examples (eg find semantically similar sentences in a corpus).

There are no comments on this comment yet.