News for hackers. Stuff that matters.
Re:Sal Khan is pioneering innovation in education again by Kye on Wednesday May 22, 2024 @12:26PM (#40442820)
>> "Three, what if the AI is just wrong and starts confusing the student? Even GPT-4 fabricates things all the time."

It was bad enough when the text was wrong because of shoddy editing.

Re:Sal Khan is pioneering innovation in education again by neuralnetes-COO on Wednesday May 22, 2024 @12:40PM (#40443009)
This is the purpose of LLMOps. To provide guardrails for precise output to prevent hallucination.
Re:Sal Khan is pioneering innovation in education again by dotinvoke on Wednesday May 22, 2024 @01:35PM (#40443709)
This is the first I'm hearing of LLMOps, please elaborate a bit on what it entails. How does it provide guardrails?
Re:Sal Khan is pioneering innovation in education again by neuralnetes-COO on Wednesday May 22, 2024 @03:05PM (#40444864)
Basically, do you want a pipeline/process that utilizes LLMs and provides exactly the output you want? How do you formalize a human expert workflow using LLMs? With LLMOps. It is new, there is no standard or predefined resource that I'm aware of. At neuralnetes we are creating all of our methods ad hoc and use tight feedback loops to ensure ideal, precise output.
Re:Sal Khan is pioneering innovation in education again by Kye on Wednesday May 22, 2024 @03:12PM (#40444957)
That sounds like technical editing but for LLM output instead of technical writers.
Re:Sal Khan is pioneering innovation in education again by neuralnetes-COO on Wednesday May 22, 2024 @11:51PM (#40450280)
It's mostly software engineering.
Re:Sal Khan is pioneering innovation in education again by sfn42 on Thursday May 23, 2024 @03:36AM (#40451663)
Sounds like it's mostly air unless you can point to an LLM that doesn't confabulate.
Re:Sal Khan is pioneering innovation in education again by hiAndrewQuinn on Thursday May 23, 2024 @04:18AM (#40451984)
No need to set impossible standards here, the correct thing to ask is whether the guardrailed LLM confabulates less than its competitors. That sounds like a useful job to have.
Re:Sal Khan is pioneering innovation in education again by sfn42 on Thursday May 23, 2024 @04:45AM (#40452184)
I'm not setting the standards, the person I replied to did. Anyone can make up imaginary tech that does amazing imaginary things.
Re:Sal Khan is pioneering innovation in education again by neuralnetes-COO on Thursday May 23, 2024 @11:20PM (#40462505)
It's not imaginary if it works.
Re:Sal Khan is pioneering innovation in education again by sfn42 on Friday May 24, 2024 @02:25AM (#40463401)
All I'm saying is prove it.