News for hackers. Stuff that matters.

A comment on Forget ChatGPT: why researchers now run small AIs on their laptops. Parent comment

Re:Forget ChatGPT: why researchers now run small AIs on thei... by fsmv on Saturday September 21, 2024 @12:02PM (#41610786)
A small model necessarily is missing many facts. The large model is the one that has memorized the whole internet, the small one is just trained to mimic the big one.

You simply cannot compress the whole internet under 10gb without throwing out a lot of information.

Please be careful about what you take as fact coming from the local model output. Small models are better suited to summarization.

[ Parent | on HN ]
Re:Forget ChatGPT: why researchers now run small AIs on thei... by albertgoeswoof on Saturday September 21, 2024 @02:44PM (#41611827)
I don’t trust anything as fact coming out of these models. I ask it for how to structure solutions, with examples. Then I read the output and research the specifics before using anything further.

I wouldn’t copy and paste from even the smartest minds, nevermind a model output.

[ Parent | on HN ]
Re:Forget ChatGPT: why researchers now run small AIs on thei... by beernet on Sunday September 22, 2024 @08:35AM (#41616602)
> The large model is the one that has memorized the whole internet

This is totally wrong and a potentially dangerous way to think about LLMs. They have no clue about what's factual knowledge and what is not, per design.

[ Parent | on HN ]