News for hackers. Stuff that matters.

A comment on GPT-5 Thinking in ChatGPT (a.k.a. Research Goblin) is shockingly good at search. Parent comment

Re:GPT-5 Thinking in ChatGPT (a.k.a. Research Goblin) is sho... by losvedir on Sunday September 07, 2025 @08:04PM (#45163444)
I dunno, I use Deep Research from Claude, ChatGPT, and Gemini, and Gemini is the only one that ignores my requests and always produces the most inane high school student wannabe management consultant "report" with introduction and restatement of the problem and background and all that. Its "voice" (the prose, I mean, not text to speech) is so irritating I've stopped using it.

The other ones will do the thing I want: search a bunch, digest the results, and give me a quick summary table or something.

[ Parent | on HN ]
Re:GPT-5 Thinking in ChatGPT (a.k.a. Research Goblin) is sho... by bitexploder on Sunday September 07, 2025 @10:57PM (#45164280)
Suppose it depends. I think of it like this article suggests. It is very good at searching and scraping a lot of websites fast. And then summarizing that some.
[ Parent | on HN ]
Re:GPT-5 Thinking in ChatGPT (a.k.a. Research Goblin) is sho... by astrange on Sunday September 07, 2025 @11:02PM (#45164297)
I like Gemini Deep Research because ChatGPT's has very low limits, but it is extremely on rails. Yesterday as an experiment I asked it to do a bunch of math rather than write a report, and it did the math but then wrote a report scolding me for not appreciating the beauty of the humanities.
[ Parent | on HN ]
Re:GPT-5 Thinking in ChatGPT (a.k.a. Research Goblin) is sho... by bluecalm on Monday September 08, 2025 @03:36AM (#45165554)
Gemini is high on hallucination. When I ask it about my own software it not only changes my own name to a similar one common in my language but also makes up stuff about our team saying some stranger works with us (he works in the same niche but that's about it).

It's annoying when it's so confident making up nonsense.

Imo Chat GPT is just a league above when it comes to reliability.

[ Parent | on HN ]
Re:GPT-5 Thinking in ChatGPT (a.k.a. Research Goblin) is sho... by Moosdijk on Monday September 08, 2025 @03:51AM (#45165641)
>Imo Chat GPT is just a league above when it comes to reliability.

Which is in my option, the #1 metric an LLM should strive for. It can take quite some time to get anything out of an LLM. If the model turns out to be unreliable/untrustworthy, the value of its output is lost.

It's weird that modern society (in general) so blindly buys in to all of the marketing speak. AI has a very disruptive effect on society, only because we let it happen.

[ Parent | on HN ]
Re:GPT-5 Thinking in ChatGPT (a.k.a. Research Goblin) is sho... by bitexploder on Monday September 08, 2025 @11:17AM (#45169380)
I just end up using both for research type things. They both end up doing better on certain topics or types of work. For $20/mo why not both :)

I like ChatGPT as a product more, but Gemini does well on many things that ChatGPT struggles with a little more. Just my anecdotes.

[ Parent | on HN ]