News for hackers. Stuff that matters.
Re:Geoffrey Hinton leaves Google and can now speak freely ab... by srslack on Monday May 01, 2023 @11:17AM (#35773994)
GPT-4 can barely operate a real web browser (not the summarizing web browser crap that like langchain and auto-gpt provide) without fumbling. I know, because I make it use one. Also, auto-gpt has no guardrails to remove. It just runs prompts in a loop. You're playing with a text predictor. It's useful for NLP and certain tasks, but it's not autonomous. It won't even be able keep a "goal" + the knowledge of the existence of agents it will "copy" + the knowledge of how to use the tools you gave it, because it's limited to 8192 tokens, and 32k at great expense. Even then, there's no proof that the 32k version is any better at using things in its context.

When your supposed super intelligent "AGI" can be completely overwritten by spamming it with nonsense that overwrites its context window, like a dog chases after a squirrel, maybe it's not actually intelligent, and is just predicting text.

Re:Geoffrey Hinton leaves Google and can now speak freely ab... by ilaksh on Monday May 01, 2023 @04:41PM (#35778844)
I didn't say GPT-4 was superintelligent. This is about further improvements.
Re:Geoffrey Hinton leaves Google and can now speak freely ab... by almost on Monday May 01, 2023 @04:44PM (#35778892)
When you say future improvements do you mean bigger GPTs? Improved LLM architectures? Different architectures entirely? Are you sure you're not just imagining a thing that would be scary and then saying "what if it was that?".