News for hackers. Stuff that matters.
Re:Natural language instructions induce generalization in ne... by cs702 on Tuesday March 19, 2024 @04:02PM (#39759702)
TL;DR: The authors embed task instructions in a vector space with a language model, and train a sensorimotor-controlling model on top to perform tasks given the instruction embeddings. The authors find that the models generalize to previously unseen tasks. Moreover, the embeddings are shown represent task subcomponents, enabling generalization.
Re:Natural language instructions induce generalization in ne... by ShamelessC on Tuesday March 19, 2024 @07:09PM (#39761270)
What is the language model pretrained on? Wouldn’t the far more robust LLM’s priors impact ability to generalize to “unseen” tasks?