News for hackers. Stuff that matters.
Re:Forget ChatGPT: why researchers now run small AIs on thei... by moffkalast on Saturday September 21, 2024 @10:30AM (#41610213)
As others point out, it's essentially distillation of a larger model to a smaller one. But you're right, it doesn't work very well. Phi's performance is high on benchmarks but not nearly as good in actual real world usage. It is extremely overfit on a narrow range of topics in a narrow format.

There are no comments on this comment yet.