Re:Gemini Ultra Released
by LightMachine on Thursday February 08, 2024 @11:30AM
(#39303964)
ERRATA: I just noticed GPT-4 mixed up `h` and `f`, so it also got it wrong. This is a draw. Both AIs (and, apparently, myself) are terrible at reasoning. Guess we're not curing cancer with computers anytime soon :')
[ Parent
| on HN ]
Kudos for the correction, but you should really put this, by far the most important context, in your original post.
Re:Gemini Ultra Released
by LightMachine on Thursday February 08, 2024 @01:56PM
(#39305987)
I would love to, if YCombinator allowed me. The "edit" button is missing. I've edited on Reddit and other places where I posted this test.
Re:Gemini Ultra Released
by jaymzcampbell on Thursday February 08, 2024 @12:56PM
(#39305164)
I've been using GPT-4 to help me understand my MSc mathematics course and I've noticed this sort of stuff more and more as I start to look at the answers, always confidently written, in detail.
Way back when GPT was just fresh on the scene I had terrible anxiety about "what is the point of my whole career or even learning any more" but these days I'm much less concerned. I'll ask it something relatively simple, like "make a sentence out of words 'a', 'b', & 'c'" for it to reply with "'a' 'b' 'd' 'e'" for me to then correct it with "oh, you didn't use c" for it to then respond "sorry, here - 'a', 'c', 'd', 'f'" etc.
Definitely an amazing complimentary tool but when they say "can make mistakes, check important..." that's essential.
This sort of issue holds with all kinds of prompts, on both platforms. I most recently (to test Bard's image generation capabilities) was asking Bard/Gemini to generate home designs using highly specific prompts -- layout of the house, materials for the facade, window placement and style, etc -- and it was shocking how frequently it would just ignore critical pieces of the prompt, and then continue to ignore when corrected.