News for hackers. Stuff that matters.
Re:Generative Agents: Interactive Simulacra of Human Behavio... by HanClinto on Thursday August 10, 2023 @08:25AM (#37075312)
Agreed -- now that the repository is open-source, it feels ripe for adapting to a smaller local model. Is it too much dreaming to imagine that if we can perhaps fine-tune a small LLaMa2 model to perform well in this context, we might even be able to get this small enough to run on consumer hardware in an actual "Sims" type game...?
Re:Generative Agents: Interactive Simulacra of Human Behavio... by krautt on Thursday August 10, 2023 @10:29AM (#37076609)
there is no technical reason why you couldn't unbolt openai interface and bolt in llama. Moreover, once you have this, you need only load the model into memory once. emulating different agents would be handled exclusively through the context window sizes that llm's expect. each agent would just have its own evolving context window. roundrobin the submissions. repeat

what's crazy to think about is what new things will become possible as the context window sizes creep up.

Re:Generative Agents: Interactive Simulacra of Human Behavio... by dogcomplex on Thursday August 10, 2023 @04:27PM (#37081312)
Or as the model is able to be trained (integrated with new information) on the fly, making a somewhat limitless context window
Re:Generative Agents: Interactive Simulacra of Human Behavio... by __loam on Thursday August 10, 2023 @05:11PM (#37081857)
I think there are actual technical problems in doing this.
Re:Generative Agents: Interactive Simulacra of Human Behavio... by dogcomplex on Saturday August 12, 2023 @05:25AM (#37098465)
Well, cost prohibitive on big models obviously. But even just things like DreamBooth training extra associations to sets of new data images is tuning the model as you go
Re:Generative Agents: Interactive Simulacra of Human Behavio... by gabereiser on Thursday August 10, 2023 @03:03PM (#37080361)
My dwarves in DF would be much more predictable. I’m all for it. So long as the model is safely trained and constraints are in place to prevent Actor A from doing something shockingly bad to Actor B in a way that wasn’t designed.