Re:Phi-3 Technical Report
by viraptor on Tuesday April 23, 2024 @03:02AM
(#40129308)
On par in some categories. Phi was intended for reasoning, not storing data, due to small size. I mean, it's still great, but the smaller it gets, the more facts from outside of the prompts context will not be known at all.
[ Parent
| on HN ]
Re:Phi-3 Technical Report
by candiodari on Tuesday April 23, 2024 @07:39AM
(#40130720)
I wonder if that's a positive or negative. How does it affect hallucinations?
It depends what you want to do. If you want a chat bot that can replace most Google queries, you want as much learned data as possible and the whole Wikipedia consumed. If you want a RAG style system, you want good reasoning about the context and minimal-or-no references to extra information. It's neither positive nor negative without a specific use case.