News for hackers. Stuff that matters.
Re:Sharing Screen with GPT 4 vision by dartos on Thursday November 09, 2023 @08:43AM (#38204853)
Am I going insane? That cube never became a sphere?
Re:Sharing Screen with GPT 4 vision by cl1nk on Thursday November 09, 2023 @10:37AM (#38206346)
You are not, and this demo is total fail. Not only the cube didn't became a sphere, the AI took ages to reply, the instructions were wrong and the result was a total mess.

I assume most people in these comments don't understand 3d modeling, or they are seriously optimistic about THE IDEA of vision assistant AIs, but this demo is not exciting at all. In fact is detrimental to showcase real utility

Re:Sharing Screen with GPT 4 vision by fudged71 on Thursday November 09, 2023 @11:13AM (#38206906)
Classic HN response.

This is just an early taste of a potentially powerful use case.

I understand the vision API doesn’t have memory, so each screenshot it takes is like an entire new context. If the script/application is able to send WHAT application it’s in, and has some RAG database in the backend to pull knowledge from, this would be incredibly useful.

Of course it’s slow now. If you’re legitimately stuck, a couple seconds for a personalized answer is a perfect trade off. It will get better.

Re:Sharing Screen with GPT 4 vision by _factor on Thursday November 09, 2023 @11:58AM (#38207530)
I couldn’t hear it perfectly, but I’m pretty sure the instructions it provided were to transform the vertices of the cube to make the sphere. It’s like using MS Frontpage. It may look right, but it’s a convoluted mess underneath.
Re:Sharing Screen with GPT 4 vision by passion__desire on Thursday November 09, 2023 @01:02PM (#38208432)
I think every UI application should start logging actions the user takes so that AI could learn the mappings from actions to visual output. It would be amazing form of data.
Re:Sharing Screen with GPT 4 vision by low_tech_love on Friday November 10, 2023 @10:07AM (#38219743)
I could say your comment is a classic 2023 HN comment..? There is no reason to be overly optimistic anbout other people’s products. Plus, nobody said “oh wow this will never work”, it’s just currently quite bad.
Re:Sharing Screen with GPT 4 vision by bluecrab on Thursday November 09, 2023 @12:50PM (#38208275)
Have mercy on him. Remember this is the worst version it would ever be
Re:Sharing Screen with GPT 4 vision by low_tech_love on Friday November 10, 2023 @10:03AM (#38219697)
I thought the post was a sarcastic/joke submission, but after reading the comments I’m confused. I mean sure nice the idea is cool and I’m sure it’ll work better soon, but right now it’s hilariously bad. And we’re talking about a really simple operation.

There seems to be a trend in HN in general I’ve noticed of “it’s cool to be optimistic” and I don’t really like it. I mean sure I’m optimistic when it comes to human beings around me but when discussing technology and people who are out there to make money (or not) I don’t feel the need to be overly optimistic. Plus, competition is the very foundation of innovation and harsh honest feedback is a very important piece of the puzzle.