News for hackers. Stuff that matters.

A comment on Large language models reduce public knowledge sharing on online Q&A platforms. Parent comment

Re:Large language models reduce public knowledge sharing on ... by jneagu on Sunday October 13, 2024 @11:58AM (#41829080)
Interesting - I actually think they perform quite well on code, considering that code has a set of correct answers (unlike most other tasks we use LLMs for on a daily basis). GitHub Copilot had a 30%+ acceptance rate (https://github.blog/news-insights/research/research-quantify...). How often does one accept the first answer that ChatGPT returns?

To answer your first question: new content is still being created in an LLM-assisted way, and a lot of it can be quite good. The rate of that happening is a lot lower than that of LLM-generated spam - this is the concerning part.

[ Parent | on HN ]
Re:Large language models reduce public knowledge sharing on ... by generic92034 on Sunday October 13, 2024 @12:10PM (#41829165)
The OP has qualified "code" with bad availability of samples online. My experience with LLMs on a proprietary language with little online presence confirms their statement. It is not even worth trying, in many cases.
[ Parent | on HN ]
Re:Large language models reduce public knowledge sharing on ... by jneagu on Sunday October 13, 2024 @12:18PM (#41829234)
Fair point - I actually had parsed OP's sentence differently. I'll edit my comment.

I agree, LLMs performance for coding tasks is super biased in favor of well-represented languages. I think this is what GitHub is trying to solve with custom private models for Copilot, but I expect that to be enterprise only.

[ Parent | on HN ]