BlenderBot 3: A 175B parameter, publicly available chatbot

Re:BlenderBot 3: A 175B parameter, publicly available chatbot by tmjdev on Friday August 05, 2022 @02:27PM (#32359951)

This is something I have noticed with a lot of models. I'm not sure what the technical term for it is, but when there is a repeated sequence of human input with model generation following (like a chatbot) it seems to be unable to focus. When you prod it to regain focus and come back to the topic being discussed it starts making up lies.

If you use GPT3 for a large amount of content generation the issue of focus doesn't seem to be so prevalent, but it has zero guarantee of truth.

[ Parent | on HN ]

Re:BlenderBot 3: A 175B parameter, publicly available chatbot by throwaway675309 on Friday August 05, 2022 @04:10PM (#32361396)

It's unable to focus because you can only feedback so much of the ongoing transcript before it exceeds the prompt input size limitations.

So having a conversation with even some of the best GPT models is going to be like having a conversation with the protagonist from Momento.

[ Parent | on HN ]

Re:BlenderBot 3: A 175B parameter, publicly available chatbot by simonelnahas on Thursday August 11, 2022 @03:07PM (#32430296)

Interestingly the source code for the frontend has Chinese comments all over.

[ Parent | on HN ]

Re:BlenderBot 3: A 175B parameter, publicly available chatbot by croes on Friday August 05, 2022 @04:38PM (#32361711)

Did Blake Lemoine try this with LaMDA?

[ Parent | on HN ]

Re:BlenderBot 3: A 175B parameter, publicly available chatbot by ASalazarMX on Friday August 05, 2022 @05:12PM (#32362041)

Difficult not to run into this issue, he even admitted the chat logs were not verbatim.

[ Parent | on HN ]