Re:ResearchAgent: Iterative Research Idea Generation Using LLMs
by bongodongobob on Monday April 15, 2024 @10:56PM
(#40047952)
Assume free-associations = hallucinations. Assume hallucinations are exactly what makes LLMs useful and your question can be rephrased as "Can you list some examples where LLMs were useful to you?"
[ Parent
| on HN ]
Re:ResearchAgent: Iterative Research Idea Generation Using LLMs
by ec109685 on Tuesday April 16, 2024 @12:51AM
(#40048483)
Hallucinations are lies. So not the same thing.
Re:ResearchAgent: Iterative Research Idea Generation Using LLMs
by Teleoflexuous on Tuesday April 16, 2024 @03:28AM
(#40049250)
For LLM to lie it would need to know the truth. That's an incredible level of anthropomorphization.
Re:ResearchAgent: Iterative Research Idea Generation Using LLMs
by malux85 on Tuesday April 16, 2024 @02:07AM
(#40048831)
Hallucinations are not always lies, they are more like a transformation in the abstraction space.
Re:ResearchAgent: Iterative Research Idea Generation Using LLMs
by throwup238 on Tuesday April 16, 2024 @08:33AM
(#40051146)
That is some weapons grade spin :-)
Re:ResearchAgent: Iterative Research Idea Generation Using LLMs
by littlestymaar on Tuesday April 16, 2024 @01:10AM
(#40048559)
All lies aren't useless, some can be insightful even when blatantly wrong in themselves (for instance: taken literally every scientific model is a lie). I can definitely see how an LLM hallucinating can helps fostering creativity (the same way psychedelics can), even if all they say is bullshit.
Re:ResearchAgent: Iterative Research Idea Generation Using LLMs
by bongodongobob on Tuesday April 16, 2024 @01:09AM
(#40048557)
I'm using hallucination to mean "not exactly the thing", not outright lying. So maybe the "truth" is "My socks are wet." A hallucination could be "My socks are damp."
Re:ResearchAgent: Iterative Research Idea Generation Using LLMs
by HeatrayEnjoyer on Tuesday April 16, 2024 @11:22AM
(#40053170)
Lies require intent. I can ask a model to lie and it will provide info it knows is inaccurate, and can provide the true statement if requested.
Hallucinations are inaccuracies it doesn't realize are inaccurate.
Re:ResearchAgent: Iterative Research Idea Generation Using LLMs
by firewolf34 on Tuesday April 16, 2024 @03:56AM
(#40049446)
Is not the purpose of a model to interpolate between two points? This is the underlying basis of "hallucinations" (when that works out /not/ in our favour) or "prediction" (when it does). So it's a matter of semantics and a bit of overuse of the term "hallucination". But the model would be useless as nothing more than a search engine if it were to just regurgitate it's training data verbatim.