Re:Computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku
by quantadev on Tuesday October 22, 2024 @02:54PM
(#41917442)
Yep. I agree. The "auto-click" thing would be optional. Should be able to turn it on and off. With auto-click off it would just position the mouse and say "click here".
Re:Computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku
by HappMacDonald on Tuesday October 22, 2024 @08:23PM
(#41920200)
Cluade scans page and decides which button to click before the screen layout is finished.
By the time user authorizes the click, layout has shifted and your click lands on malware advertisements.
Re:Computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku
by quantadev on Tuesday October 22, 2024 @10:23PM
(#41921132)
lol. If any website ever did that to me it would be the last time I ever went to it. Not a big concern for me.
Re:Computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku
by HappMacDonald on Wednesday October 23, 2024 @03:53AM
(#41922813)
Youtube constantly moves it's layout seconds after the page begins to paint, so I try to click on fullscreen or whatever and then the viewer shifts to the side and I wound up clicking a link to some other video.
Probably would have been an ad there if I didn't block those, though.
It could be very empowering for users with disabilities to regain access computers. But it would also be very powerful to be able to ask "use Photoshop to remove the power lines from this photo" and have the model complete the task and drop off a few samples in a folder somewhere.