News for hackers. Stuff that matters.

A comment on Artificial intelligence is losing hype. Parent comment

Re:Artificial intelligence is losing hype by meroes on Tuesday August 20, 2024 @09:12PM (#41305786)
I’ve been doing RLHF and adjacent work for 6 months. The model responses across a wide array of subject matter are surface level. Logical reasoning, mathematics, step by step, summarization, extraction, generation. It’s the kind of output the average C student is doing.

We specifically don’t do programming prompts/responses nor advanced college to PHD level stuff, but it’s really mediocre at this level and these subject areas. Programming might be another story, I can’t speak to that.

All I can go off is my experience but it’s not been great. I’m willing to be wrong.

[ Parent | on HN ]
Re:Artificial intelligence is losing hype by roenxi on Tuesday August 20, 2024 @11:01PM (#41306390)
> It’s the kind of output the average C student is doing.

Is the output of average C students not commercially valuable in the listed fields? If AI is competing reliably with students then we've already hit AGI.

[ Parent | on HN ]