News for hackers. Stuff that matters.
Re:Few-Shot Learning in Practice: GPT-Neo & 'HuggingFace' Ac... by spywaregorilla on Friday June 04, 2021 @04:11PM (#27398556)
Hmm I don't work in this space too often, but wouldn't the maximum likelihood estimator of a oneshot example, saying telling it king => queen, hoping to learn male to female transitions... wouldn't that just be the simple linear transformation between the two embeddings?

I'm sure a few shot model can be a little more nuanced but I'm not sure I have any intuition about what that transformation looks like.

There are no comments on this comment yet.