News for hackers. Stuff that matters.
Re:Reflection 70B, the top open-source model by winddude on Thursday September 05, 2024 @05:13PM (#41460454)
PhDs aren't relevant. It's more just a certificate that you can learn to learn and stay committed to hard and challenging things. It does give bonus points to VCs, because it's seems to be easier to market to other VCs, same applies for hedge funds.

And with fine tuning, there's zero math needed, it's a bit of common sense, and a lot's of data optimization.

Re:Reflection 70B, the top open-source model by phs318u on Thursday September 05, 2024 @10:17PM (#41462269)
I wouldn't say that PhD's aren't relevant. Remember a lot of this subsequent "bumps, steps and leaps" advancement has come _after_ the initial work by the OpenAI's etc. "Standing on the shoulders of giants" is a thing.
Re:Reflection 70B, the top open-source model by sabbaticaldev on Friday September 06, 2024 @11:49PM (#41471318)
and these phds used some tools developed by teenager hackers. Standing on the shoulders of giants, indeed