News for hackers. Stuff that matters.
Re:First Impressions with GPT-4V(ision) by wilg on Wednesday September 27, 2023 @08:18PM (#37683478)
There’s no reason chatbots have to be the interface to an LLM. Imagine dynamically generated interfaces redesigning themselves to your needs as you work through a task.
Re:First Impressions with GPT-4V(ision) by artursapek on Wednesday September 27, 2023 @08:37PM (#37683635)
Exactly. Chat is just the first, most general purpose UI. Like a terminal was for computers.
Re:First Impressions with GPT-4V(ision) by theK on Wednesday September 27, 2023 @08:47PM (#37683712)
Agreed but lets keep in mind that graphical UIs involve significantly more effort than CLIs. In the case where you shoerhorn an ai to be your primary UI I would bet this is as hard if not harder since you typically have to code around significant limitations of current llms
Re:First Impressions with GPT-4V(ision) by fragmede on Wednesday September 27, 2023 @11:41PM (#37684961)
http://gitwit.dev shows us that LLMs can generate various GUIs just fine, when prompted.
Re:First Impressions with GPT-4V(ision) by theK on Friday September 29, 2023 @02:09AM (#37699864)
This is not what I said. Sure you can use such tools or even just classical boilerplate scripts (like we used for a decade now) to get started with react fast. But building out a system that fails well when the underlying llm starts behaving erratically or not at all is a completely different league of engineering as executing a boilerplate script.
Re:First Impressions with GPT-4V(ision) by fragmede on Friday September 29, 2023 @04:15AM (#37700754)
Sorry for misinterpreting you. So the underlying LLM starts misbehaving, and the difficulty you see, is that the system as a whole should fail gracefully. What would that look like, in your eyes? A proctor LLM/whatever that observes the output and decides that it has gone awry and decides to take over?
Re:First Impressions with GPT-4V(ision) by dumpsterdiver on Wednesday September 27, 2023 @09:54PM (#37684228)
So to your point, I do think it would be nice to have an AI assistant suggest to make changes to the view mode of an application. For instance, if I navigate to a certain area the AI might suggest that I make that option visible in my menu. I might say no, because I prefer to use the hotkey. Aside from that, I'm going to have to absolutely side with the parent commenter on this one - When I'm doing serious work I want a familiar interface that I know how to move around efficiently in. I don't want any surprises.

Suggestions to improve workflow sound great. But nullifying hard earned knowledge of an interface... I can't see that helping me.

The shining example in my mind is audio/video/graphics applications, where there are good reasons to routinely switch between different views. Knowing your way around those views (which might be custom, but still static), and being able to navigate through them quickly is very valuable.

Re:First Impressions with GPT-4V(ision) by wilg on Wednesday September 27, 2023 @11:11PM (#37684737)
I think there’s room for an AI-native interface that knows the full context of the project you’re working on and can make extremely intelligent suggestions or tailor the interface for a specific task. Or you could just literally describe the interface you want for something and it redesigns it for you immediately.
Re:First Impressions with GPT-4V(ision) by dumpsterdiver on Wednesday September 27, 2023 @11:59PM (#37685089)
There is room, absolutely. Perhaps I took too hard of a line. I do recognize that a compromise can be made between a user retaining their knowledge of a system, and that system evolving to accommodate user requirements. It's easy to be fearful of the rug being pulled right from under you, but I suppose the reality might be closer to earnestly asking to place things upon the rug. In other words, the things that are familiar will probably remain familiar and accessible, but AI will help us arrange them in a way that optimizes our workflow.
Re:First Impressions with GPT-4V(ision) by JHonaker on Thursday September 28, 2023 @12:55PM (#37692376)
I would hate that. An interface is useful when you can anticipate and remember what things are available and where they are. It doesn't matter if it's a visual UI or keyboard shortcuts. If you start moving stuff around on us, we revolt. (See every UI update on an MS Office product ever.)
Re:First Impressions with GPT-4V(ision) by wilg on Thursday September 28, 2023 @03:08PM (#37694179)
Well you have to make it useful obviously. Keep an open mind!
Re:First Impressions with GPT-4V(ision) by freilanzer on Friday September 29, 2023 @03:41AM (#37700486)
So, an interface that keeps changing randomly? That sounds like hell, no thanks.