News for hackers. Stuff that matters.
Re:Can LLMs learn from a single example? by armatav on Thursday September 07, 2023 @07:57PM (#37427376)
That's super interesting, I wonder if dropout applied in a certain pattern of segregation could induce more neuron dependence, instead of less. Or do some anti-dropout where a dedicated portion of the model is used. Not sure why you'd want that, but it might be interesting to explore.

There are no comments on this comment yet.