Re:Reflection 70B, the top open-source model
by phs318u on Thursday September 05, 2024 @10:17PM
(#41462269)
I wouldn't say that PhD's aren't relevant. Remember a lot of this subsequent "bumps, steps and leaps" advancement has come _after_ the initial work by the OpenAI's etc. "Standing on the shoulders of giants" is a thing.
Re:Reflection 70B, the top open-source model
by sabbaticaldev on Friday September 06, 2024 @11:49PM
(#41471318)
and these phds used some tools developed by teenager hackers. Standing on the shoulders of giants, indeed
And with fine tuning, there's zero math needed, it's a bit of common sense, and a lot's of data optimization.