Re:Talking About Large Language Models
by wespiser_2018 on Sunday December 11, 2022 @12:00AM
(#33940271)
This was my experience when I asked it questions about database or distributed systems. I wouldn't consider my an expert in these fields, but I do have more than a passing interest in them.
All the answers looked good, used several of the correct terms, and one even referenced the project I worked on, but they just contained flat out wrong information.
You reach a point, where when you ask a ML model to generate text given the internet as a corpus, where there just isn't enough text to make something that is both true and convincing. In niche fields, this is just where we are at.
I asked it a series of questions about my area of expertise and they were wrong but looked perfectly fine to my wife.
It even confidently “solved” the 2 generals problem with a solution that looks completely plausible if you don’t already know that it won’t work.