News for hackers. Stuff that matters.
Re:"King of the Cannibals": How Sam Altman Took over Silicon... by api on Saturday December 23, 2023 @11:46AM (#38745562)
For hosted models I’ve noticed that Bard has been quietly improving. Was awful at first but now seems to be closing in.

Actually-open AI with open weights and open source is innovating rapidly too, especially when it comes to making models more efficient on smaller hardware. We have fast local mixtures of experts now. Rumor is that Llama3 is training as well, and that it may be some kind of MoE.

I feel like focusing on efficiency first for local models rather than shooting to beat GPT-4 is the right approach, because without major efficiency improvements a shot for simple dominance will just yield a model only wealthier people can afford the hardware to run.

OpenAI still seems in the lead but it’s shrinking.

Re:"King of the Cannibals": How Sam Altman Took over Silicon... by nox100 on Saturday December 23, 2023 @12:07PM (#38745784)
I've definitely seen Bard beat ChatGPT once in a while. I don't use bard much but when ChatGPT gives me an answer I know is wrong I go see if Bard did any better and yes, sometimes Bard is better, not often enough for me to switch ... yet?
Re:"King of the Cannibals": How Sam Altman Took over Silicon... by ignoramous on Saturday December 23, 2023 @03:39PM (#38747984)
I increasingly find myself using pplx.ai, phind, and bard; never chatgpt.
Re:"King of the Cannibals": How Sam Altman Took over Silicon... by dwaltrip on Saturday December 23, 2023 @08:05PM (#38750021)
Gpt-3.5 or 4?
Re:"King of the Cannibals": How Sam Altman Took over Silicon... by nox100 on Sunday December 24, 2023 @01:39AM (#38751645)
4
Re:"King of the Cannibals": How Sam Altman Took over Silicon... by aubanel on Saturday December 23, 2023 @03:41PM (#38748005)
If you have the most powerful model by far like they have, it's a radical adantage over competitors: your model can perform automatizations that they cannot do.

OpenAI's lead is phenomenal: remember that they managed to put GPT4 on top of the leaderboard for one year and counting, while all others (except maybe Anthropic) struggle to have their model in the top3 for more than a few months.