JediCat

Is Unlimited Context Length really possible? At what cost?Amanda Bertsch, author of 2023 NeurIPS paper Unlimiformer, will describe the architecture and take questions at this Friday's Oxen.ai Paper Club.Greg Schoeninger u/FallMindless3563, Oxen CEO and Master of Plain Speak, will help interp the concept and relate it to other papers we have reviewed.Call: https://oxen.ai/communityThe trick...

Arxiv paper first author Zhengxuan Wu will join Greg Schoeninger on today's 10:00 AM Pacific Time Oxen.AI Paper Club. Topic: How editing representations can be better than Parameter-efficient finetuning (PEFT) methods. https://lu.ma/oxenReFT: Representation Finetuning for Language Models.Greg, 3 questions, 1 comment from reading just the abstract.What exactly is meant by a "representation"?...