News for hackers. Stuff that matters.
Re:Gemini 2.0: our new AI model for the agentic era by internet_points on Thursday December 12, 2024 @05:13AM (#42397893)
I got so hopefuly by your comment I showed it my current bug that I'm working on, I even prepared everything first with my github issue, the relevant code, the terminal with the failing tests, and I pasted it the full contents of the file and explained carefully what I wanted to achieve. As I was doing this, it repeated back to me everything I said, saying things like "if I understand correctly you're showing me a file called foo dot see see pee" and "I see you have a github issue open called extraneous spaces in frobnicator issue number sixty six" and "I see you have shared some extensive code" and after some more of this "validation"-speak it started repeating the full contents of the file like "backquote backquote backquote forward slash star .. import ess tee dee colon colon .." and so on.

Not quite up to excited junior-level programmer standards yet. But maybe good for other things who knows.

Re:Gemini 2.0: our new AI model for the agentic era by nolist_policy on Thursday December 12, 2024 @06:50AM (#42398406)
You just rediscovered that LLMs become much stupider when using images as input. I think that has been already shown for gpt-4 as well.
Re:Gemini 2.0: our new AI model for the agentic era by dtquad on Thursday December 12, 2024 @07:17AM (#42398539)
Even when using the web search tool GPT-4 becomes stupider.

Do they use a dumber model for tool/vision?

Re:Gemini 2.0: our new AI model for the agentic era by dwaltrip on Thursday December 12, 2024 @03:26PM (#42403019)
I’m guessing that it’s just a much harder problem. Images often contain more information but it is far less structured and refined than language.

The transformation process that occurs when people speak and write is incredibly rich and complex. Compared to images which are essentially just the outputs of cameras or screen captures — there isn’t an “intelligent” transformation process occurring.

Re:Gemini 2.0: our new AI model for the agentic era by justsid on Thursday December 12, 2024 @08:27PM (#42405177)
I think images also have much higher information density than words, or at least they can. There is a reason a picture is worth 1000 words.
Re:Gemini 2.0: our new AI model for the agentic era by tbruckner on Thursday December 12, 2024 @09:33AM (#42399428)
This is news to me. Any good examples of this outside of the above?
Re:Gemini 2.0: our new AI model for the agentic era by nolist_policy on Thursday December 12, 2024 @10:28AM (#42399943)
Vision language models are blind (192 comments) https://news.ycombinator.com/item?id=40926734
Re:Gemini 2.0: our new AI model for the agentic era by fnordpiglet on Thursday December 12, 2024 @12:19PM (#42401113)
On the other hand if I take pictures of circuits, boards, electronic components, etc GPT4o is pretty reliably able to explain the me the pinouts, the board layouts, reference material in the data sheets, and provide pretty reasonable advice about how to use it (I.e., where to put resistors and why, what pins to use for the component on an esp32, etc). As a beginner in electronics this is fabulously helpful. Its ability to pass vision tests seems like a pretty dumb utility metric when most people judge utility by how useful things are.
Re:Gemini 2.0: our new AI model for the agentic era by jug on Thursday December 12, 2024 @09:36AM (#42399456)
Not sure this is an AI limitation. I think you'd be better off here with the Gemini Code Assist plugin in VS Code rather than that. Sounds like the AI is provided with unstructured information compared to an actual code base.
Re:Gemini 2.0: our new AI model for the agentic era by zamadatix on Thursday December 12, 2024 @09:40AM (#42399488)
> foo dot see see pee

Well there's your problem!

Re:Gemini 2.0: our new AI model for the agentic era by nuancebydefault on Thursday December 12, 2024 @02:11PM (#42402284)
The ccp extension is just another c++ flavour /i
Re:Gemini 2.0: our new AI model for the agentic era by lovasoa on Thursday December 12, 2024 @04:36PM (#42403632)
ccp is the Chinese version of c++. Or maybe they meant ссср, the Soviet version.