News for hackers. Stuff that matters.
Re:Llama3 implemented from scratch by cal85 on Sunday May 19, 2024 @04:48PM (#40409641)
Their moat atm is being 6 months ahead of everyone else on model quality. Plus the ‘startup’ advantage over their corporate competitors. Oh and they can hoard a lot of the best talent because it’s an extremely high status place to work.

Their task now is to maintain and exploit those advantages as best they can while they build up a more stable long term moat: lots of companies having their tech deeply integrated into their operations.

Re:Llama3 implemented from scratch by andy99 on Sunday May 19, 2024 @05:06PM (#40409750)
Just to add, they don't have the baggage of google or Meta so they can do more without worrying how it impacts the rest of the company. And of the big players they seem the most aware of how important good data is and have paid for lots of high quality curated fine tuning data in order to build a proper product instead of doing a research project. That mindset and the commercial difference it makes shouldn't be underestimated.
Re:Llama3 implemented from scratch by myko on Sunday May 19, 2024 @10:22PM (#40411522)
> Their moat atm is being 6 months ahead of everyone else on model quality

Really? Most of our testing now has Gemini Pro on par or better (though we haven't tested omni/Ultra)

It really seems like the major models have all topped out / are comparable