News for hackers. Stuff that matters.
Re:Gato – A Generalist Agent by izzygonzalez on Tuesday May 17, 2022 @06:09PM (#31416883)
I made some concept maps of the first parts of the paper. It might help with clarifying some of it.

https://twitter.com/izzyz/status/1525099159925116928

Re:Gato – A Generalist Agent by moffkalast on Tuesday May 17, 2022 @07:51PM (#31417600)
Hmm 1.2B params... that's what, roughly 5 GB of VRAM? Surprisingly compact.
Re:Gato – A Generalist Agent by abel_ on Tuesday May 17, 2022 @08:28PM (#31417850)
This was done so that the IRL robot manipulation tasks could be done fast enough. In the future, we may always need small models mixed with large models for some tasks (e.g., for slow long term planning and fast short term planning), though compute does have a tendency to improve exponentially...
Re:Gato – A Generalist Agent by aaaaaaaaaaab on Tuesday May 17, 2022 @07:55PM (#31417628)
Aha, ok