News for hackers. Stuff that matters.
Re:ViperGPT: A Python Framework That Combines Vision and Lan... by woeirua on Friday March 17, 2023 @01:25PM (#35200091)
It's only a matter of time now before someone uses GPT to directly control a humanoid like robot. I see no reason why you couldn't do that with some kind of translation layer that goes from text instructions like: "walk forward 10 steps" to actual instructions to motors/servos.
Re:ViperGPT: A Python Framework That Combines Vision and Lan... by vladf on Friday March 17, 2023 @01:26PM (#35200111)
Re:ViperGPT: A Python Framework That Combines Vision and Lan... by jah242 on Friday March 17, 2023 @01:29PM (#35200143)
Google actually recently went some steps further and combined the PaLM LLM (bigger than GPT-3.5) with a 22 billion parameter Vision Transformer to do this -

https://palm-e.github.io

Re:ViperGPT: A Python Framework That Combines Vision and Lan... by good_boy on Friday March 17, 2023 @04:04PM (#35202159)
there were reports from Microsoft recently as well. If I remember correctly their version of ChatGPT given a task in plain English generated actions script for a robot.

So, we are getting closer to AI 'Goblin'. Almost generic, sub-human, embodied AI

Re:ViperGPT: A Python Framework That Combines Vision and Lan... by shirkey on Friday March 17, 2023 @08:19PM (#35204652)
Re:ViperGPT: A Python Framework That Combines Vision and Lan... by aitchnyu on Friday March 17, 2023 @02:21PM (#35200872)
Previous editions of Automate the Boring Stuff Using Python worked only in the domain of files existing on a computer. The next one will have a chapter on weeding a lawn throughout the night.