News for hackers. Stuff that matters.
Re:How to tackle unreliability of coding assistants by spadufed on Thursday November 30, 2023 @07:17PM (#38481185)
This is the way forward imo. Particularly as we've started to flesh out the relationship between model size and true context reliability. We've found that raw context-window size is not representative of what the model can actually consistently recall, but we've also found the recall is consistently reliable out to a point. I suspect more robust theoretical models around superposition will move us a long way towards understanding the limits of context reliability rather than what would currently be an experimental approach.

There are no comments on this comment yet.