Sal Khan is pioneering innovation in education again

Re:Sal Khan is pioneering innovation in education again by MajimasEyepatch on Wednesday May 22, 2024 @11:38AM (#40442305)

I can ask ChatGPT to write code and assess myself whether it's correct or not. (It's frequently not, but it can still be useful for certain tasks.) I can ask it to explain something about the industry I work in or adjacent fields and have a pretty good sense of whether it's leading me in the right direction. But if I asked it to teach me about, say, Chinese history, I would have very little ability to assess whether it's telling me the truth or sprinkling little falsehoods into things. I would only be able to catch the most blatant mistakes; the rest would require more detailed independent research.

Now imagine you're a kid who's still learning reading comprehension and hasn't yet developed a functional BS detector. You're not going to have much of an ability to separate truth from fiction, but you're likely going to trust this thing that sounds authoritative.

[ Parent | on HN ]

Re:Sal Khan is pioneering innovation in education again by welshwelsh on Wednesday May 22, 2024 @11:51AM (#40442442)

While these are all valid concerns, they also apply to human teachers. Humans spew bullshit all the time.

But that's OK. A teacher's knowledge doesn't need to be perfect, it just needs to be better than the student's.

If ChatGPT explains Chinese history in a way that is 80% accurate, to a student whose understanding of Chinese history is 10% accurate, the student will walk away with a better understanding of Chinese history.

[ Parent | on HN ]

Re:Sal Khan is pioneering innovation in education again by camdenreslink on Wednesday May 22, 2024 @12:17PM (#40442737)

This seems very incorrect to me. Human teachers make mistakes, or understand details of something incorrectly sometimes, but it doesn't come up in every lesson. It only happens occasionally, and sometimes a student will correct them/challenge them on it.

ChatGPT makes mistakes literally every time I use it (in a domain that I'm knowledgable in). How is that the same thing? Being given incorrect information is worse than not having the knowledge at all IMO.

[ Parent | on HN ]

Re:Sal Khan is pioneering innovation in education again by nopinsight on Wednesday May 22, 2024 @01:59PM (#40443990)

Do you mean GPT-3.5 (free) or GPT-4 (paid)? Their performance and hallucination rates are very different.

GPT-4o (the best current model) is now becoming available to free, registered users now. What do you think of it?

Unless your domain is very specialized, I think GPT-4T, GPT-4o, and Claude 3 Opus for example are quite good.

[ Parent | on HN ]

Re:Sal Khan is pioneering innovation in education again by camdenreslink on Wednesday May 22, 2024 @02:17PM (#40444196)

I use GPT 4, and it still constantly invents things and presents them to me with authority. I haven’t tried GPT-4o yet.

[ Parent | on HN ]

Re:Sal Khan is pioneering innovation in education again by nopinsight on Wednesday May 22, 2024 @03:16PM (#40445009)

I do find that current LLMs are quite bad at design problems and answering very specific questions for which they may lack sufficient training data. I like them for general Q&A though.

A different architecture or an additional component might be needed for them to generalize better for out-of-training-distribution questions.

[ Parent | on HN ]

Re:Sal Khan is pioneering innovation in education again by Myrmornis on Thursday May 23, 2024 @03:56AM (#40451822)

Yes, that's fair, but I think we can do better in our education revolution than just plonking kids down in a classroom with ChatGPT! If we take a fairly constrained subject like high school algebra, we should be able to, for example, study its BS rate by having knowledgeable testers converse with it at length, and thus perhaps produce AIs suitably calibrated and QA'd for classroom usage. But I should go read Sal's book, it sounds promising.

[ Parent | on HN ]