Re:90% of My Skills Are Now Worth $0
by StrangeDoctor on Wednesday April 19, 2023 @05:44PM
(#35633688)
But it seems like they aren’t just storing the majority opinion, or that opinions couldn’t be influenced from other related areas. I am assuming it’s a harder problem to only select for the majority at the exclusion of else vs sampling it all.
With prompting maybe we could tease out the minority views, but I could also see it just confidently making shit up to a higher degree.
That's inherent in the approach. Large language models reflect the majority opinion of the training set. If there's not enough source material in an area that the same thing hasn't been covered in a few different ways, the thing gets lost.
This is well known. What's being done about it?