News for hackers. Stuff that matters.
Re:Oops! We Automated Bullshit by willis936 on Friday November 17, 2023 @08:12AM (#38302991)
There was always a loop-closing method on the table with Wikipedia. Where is the loop-closing method to bullshit on LLMs not being efficient lie generators?
Re:Oops! We Automated Bullshit by ben_w on Friday November 17, 2023 @08:22AM (#38303137)
What is loop closing? (Google didn't help, my results were SLAM and DIY). It sounds like citogenesis which is the opposite of the rest of your comment?

https://en.wikipedia.org/wiki/Circular_reporting

Re:Oops! We Automated Bullshit by airstrike on Friday November 17, 2023 @09:05AM (#38303686)
Have you tried asking ChatGPT?
Re:Oops! We Automated Bullshit by ben_w on Friday November 17, 2023 @10:53AM (#38305246)
"""ChatGPT

In this context, "loop closing" likely refers to a method of addressing or resolving issues or gaps in a process or system. The speaker seems to be expressing frustration about a perceived lack of a method to counter misinformation or falsehoods when it comes to Language Model (LLMs) efficiency."""

So, same inference I made from the context (alone it sounds like citogenesis but the context suggests the opposite), and same lack of specific detail.

"A method". Yes, great, what is it?

Re:Oops! We Automated Bullshit by flyval on Friday November 17, 2023 @11:24PM (#38315150)
Did you ask ChatGPT that?

Me: why did the commenter use the term “loop-closing”?

ChatGPT: The commenter used the term "loop-closing" to emphasize the concept of a feedback mechanism that corrects or validates information. In systems theory and engineering, a "closed loop" system is one where the output is continually fed back into the system as input for self-correction and optimization. This term is metaphorically applied here to describe a process where information is constantly reviewed and corrected, forming a self-regulating cycle.

In the context of Wikipedia, this loop-closing happens through community edits and oversight, where incorrect information is often quickly corrected by other users. The commenter is highlighting the absence of a similar, effective mechanism in Large Language Models (LLMs) to automatically correct or verify the information they produce. This comparison underscores a concern about the potential for LLMs to disseminate incorrect or misleading information without an inherent system for checking and correcting it. The choice of "loop-closing" as a term is to draw attention to this systematic difference in information validation between platforms like Wikipedia and LLMs.

Re:Oops! We Automated Bullshit by ben_w on Saturday November 18, 2023 @03:49AM (#38317068)
> Did you ask ChatGPT that?

That's why I used triple quotes around the block: https://chat.openai.com/share/cd5c8e5e-5925-46f8-8873-6e75c5...

Re:Oops! We Automated Bullshit by willis936 on Friday November 17, 2023 @05:20PM (#38311270)
It's a control systems term. Saying a loop should be closed means feedback should be used to track error.

https://en.wikipedia.org/wiki/Open-loop_controller

https://en.m.wikipedia.org/wiki/Closed-loop_controller

Re:Oops! We Automated Bullshit by ben_w on Friday November 17, 2023 @07:50PM (#38313257)
Thanks! :)

As it happens, I just watched some of the OpenAI developer day videos, and they do talk about connecting the models with more traditional search engines/databases/API calls to a similar end.