News for hackers. Stuff that matters.
Re:Gemini: Google's most capable AI model yet by logicchains on Wednesday December 06, 2023 @10:25AM (#38545056)
There are some 7B weight models that look competitive with GPT4 on benchmarks, because they were trained on the benchmark data. Presumably Google would know better than to train on the benchmark data, but you never know. The benchmarks also fail to capture things such as Bard refusing to tell you how to kill a process on Linux because it's unethical.
Re:Gemini: Google's most capable AI model yet by ghaff on Wednesday December 06, 2023 @10:42AM (#38545304)
>Bard refusing to tell you how to kill a process on Linux because it's unethical.

Gives me what a quick scan looks like a pretty good answer.

Re:Gemini: Google's most capable AI model yet by mrkramer on Wednesday December 06, 2023 @11:55AM (#38546396)
>The benchmarks also fail to capture things such as Bard refusing to tell you how to kill a process on Linux because it's unethical.

When I used Bard, I had to negotiate with it what is ethical and what is not[0]. For example when I was researching WW2(Stalin and Hitler), I asked: "When did Hitler go to sleep?" and Bard thought that this information can be used to promote violence an hatred and then I told to it....this information can not be used to promote violence in any way and it gave in! I laughed at that.

[0] https://i.imgur.com/hIpnII8.png