News for hackers. Stuff that matters.

iiJDSii

Re:R1 Computer Use on Thursday February 06, 2025 @04:47PM (#42966820)
Such as? Are they able to recognize arbitrary GUI elements from various desktop programs, web browsers, etc?
Re:R1 Computer Use on Thursday February 06, 2025 @04:24PM (#42966640)
What does your perception look like, are you using raw screenshots? GUI snapshots? Vision is very difficult for these, and snapshots are incomplete, is what I've found in some earlier experiments.
What are some truly valuable companies that would be accurately described as just "UIs around Postgres"?

I think it's a non-sequitur - either companies are much more than just UIs around a DB, or those companies just aren't very valuable (in which case, who cares).

I've heard this idea echoed quite a few times.

But can anybody name a wrapper company as/more valuable than foundation model companies like OpenAI, DeepSeek, Anthropic, Mistral, etc?

Only one that comes to mind is Perplexity, but they're a bit more than a wrapper startup - I think there's some hardcore engineering to get their web search product working so well.

Re:Show HN: We're Building a Desktop App for Browser Agents on Saturday February 01, 2025 @07:46PM (#42904271)
> keep the server up

Oh maybe I didn't understand from the site - it's not a standalone desktop app? What processing do you do on your server side?

Re:Show HN: We're Building a Desktop App for Browser Agents on Saturday February 01, 2025 @07:27PM (#42904120)
Those are good ones. I've fiddled with similar systems before, do you have a rough success rate? I know they can be finicky, especially as you execute through a chain-of-thought action plan, or however you're doing it.
Re:Show HN: We're Building a Desktop App for Browser Agents on Saturday February 01, 2025 @07:08PM (#42903988)
Very cool! Any video demos for sample tasks? I didn't come across any on the website (browsing on mobile).
Is this like window/program repositioning for multiple monitors or something? Just making sure I understand.

Would you describe how every window should be positioned? And if so would you want to just do so once, and then have the configuration (or configuration pattern, as you might have a similar but different set of windows) set up when you ask for e.g. "apply my window snapping" ?

Ask HN: What is a desktop automation task you would pay for?

What is something you or someone at your company has to do repetitively on a desktop?For example, it may involve some minor variations, could be kind of 'messy' and involves clicking through various programs, checking outputs, deciding from there, etc.Example: during an internship I remember running regression tests, which meant running some scripts, re-running them if they hanged for too long...

( Read More... | 4 comments | 2 points | on HN )

Ask HN: Datasets for computer desktop usage, AI Agents discussion

Are there any datasets, with any labels or no labels, for people using their desktop computers to do mundane tasks like open applications, browse the web, interact with spreadsheets, etc?I was thinking this type of desktop "screen record" data could be useful for training AI Agents in the future.It seems the hardest part of getting AI to "just do work" on my laptop is being able to navigate...

( Read More... | no comments | on HN )
Re:Ask HN: Why haven't we progressed in Consumer Robots? on Sunday January 05, 2025 @01:47PM (#42603947)
Great question. It's a combination of economics - lower-wage humans do many tasks much better - and technology - precise manipulation of tools and navigation of novel environments is incredibly difficult. Any small seemingly trivial task actually has an insane amount of complexity to it.

Let's say I wanted a robot to take out my trash. It sounds simple but there are so many incredibly difficult tasks when you break it down, each with a near-infinite number of variations in different homes:

- First, learn where in the house it is, and how to get to it. * Is it in a drawer? What kind of drawer, how to open it? * Is it a plastic garbage bag in a bin, with a foot lever? In a drawer? - How does the robot lift out a plastic bag, replace the plastic bag? We don't have the dexterity to do this yet * What happens when the plastic bag gets caught slightly on a corner, or begins to rip? - Let's say we pick up the plastic bag, now we need to move to a door that will take us out of the house * Are there stairs, pets, children, other obstacles that could get in the way? Just this bullet point here could be harder than self-driving cars, which is far from solved * How do we interact with the door to open it? Is it a round knob, is there a deadbolt to unlock, does the door swing outward or inwards?

...etc

This probably barely scratches the surface on all of the variability inside of a home, and yet a small kid can do all this without even thinking, while even a small subset of these problems probably requires billions of dollars to solve in a controlled/closed environment.

Maybe humanoid robot teleoperation + artificial intelligence will get us there, that's the pipe dream of a lot of these humanoid robot companies. But then they need to make money and out-compete some young/lower-skilled workers happy to do things for $10/hour. At which point one wonders how these companies will make money to justify the insane R&D needed for even the simplest of tasks. But hey the same story has played out in other industries where robots have outplaced low-skilled labor. The difference though is that these environments have been heavily controlled, i.e. the same few steps to assemble a widget, the same motions to clean the same type of object, etc.

Ask HN: What software product do you wish existed that you'd use?

Thought this could be an interesting way to share potential ideas, but also discover potential products. Last time I mentioned a software I wish existed to a friend; they told me about a specific product that pretty much did what I needed.So...What software product do you wish existed that you'd use?

( Read More... | 4 comments | 3 points | on HN )
Interesting examples. Personally, I don't really consider Ebay, AirBnB, Reddit, or Substack to be "technology companies". They are businesses that happen to be online, imo. I'm sure that e.g. AirBnB has lots of machine learning technology now, but I reckon it's doing niche stuff like optimizing conversion rates and profits by customer tracking, recommending, etc. So basically, after-the-fact value optimization. Nothing really invented or new created, aside from their novel ideas and unique executions.

Other actual tech examples seem to fall into 1 of 2 camps: obvious but hard to do (better search engine, better rockets, electric cars, etc), or cool but non-obvious customer end uses (maybe LLMs, VR/AR, curved or flexible high def screens, etc). The latter category has more risk but probably lower hanging fruit to get started, because the market needs are less obvious.

In your example, do you think the customer focus lead to pre-mature optimization and kind of tunnel-visioned the team away from further LLM development? That's another type of trade-off that's probably impossible to predict at the time. I mean who doesn't want customers.

I'm not entirely surprised that OpenAI was able to achieve so much given their structure - they had the mandate of a trendy new research lab, top talent, with 100M+ funding and no need to cater to any early customers. Seems like a great (though typically impractical) way to build big new things. Then they had the right top-level guidance when the tech was getting ready, to pivot and raise more money (unlike XEROX PARC for example).

Indeed that's a good distinction that I don't think is made. Some of the other advice I've gotten from YC/PG essays is of the form 'build what seems cool' (if you're a technical and curious person). This seems to be the 'high reward, high risk' route. I suppose VR would fall into this bucket, it's definitely cool to a lot of people, but from its inception, has taken decades to really get anywhere in a commercial sense - and it still seems quite niche.

Other examples: even though PG mentions them as solving problems, would Microsoft (starting with OS software for a niche machine) and Facebook (college kids online directory) really have been starting as 'problem-first' products? It seems like the founders were more building what seemed interesting to them, and got the high reward by stumbling on the right things (and building them better than competitors).

Still even with the distinction ('person not in search of a problem'), it seems there could be a hammer/nail phenomenon going on if someone, say, builds cool tech of a certain type, and then tries to commercialize from there, in that order. What seems to make sense is to 'build what seems cool', keep an up-to-date mental model on new and emerging technologies, and stay open-minded to problems arising that can be solved. But even then, without a 'problem-first' mindset, could one get too pigeon-holed I wonder.

Not sure where I'm going with this, just thinking out loud. The topic fascinates me.

Ask HN: Solutions searching for problems, can they succeed?

Interested in what may now be a somewhat contrarian idea. It's startup school 101 to avoid "SISP": Solutions in Search of a Problem. I think YC's startup school actually coined this acronym.But I'm wondering, have great businesses and products started from this? There's plenty of downsides that have been discussed, but I'd like a different perspective too.One could argue that anything that...

( Read More... | 6 comments | on HN )

Ask HN: How do AI SaaS products stand out from just ChatGPT?

I'm curious as to what unique value add is being done on top on the core chatgpt (or claude or whatever) website and chat interface.Now they have very long context windows, ability to upload and parse through files, custom system prompts, can work with images, remember user history across chats...So what's the unique value adds in other products that are using chatbots?My 'hot take' currently...

( Read More... | 5 comments | 2 points | on HN )

Ask HN: What do you want an AI Agent to do?

Let's say you have an AI Agent that can control your computer, or do some computer actions in a limited environment. Or maybe control some other hardware device!What would you like an AI Agent to do for you? Why would this be valuable for you?

( Read More... | 1 comment | on HN )
Re:Ask HN: Am I crazy or is Android development awful? on Wednesday July 24, 2024 @11:22PM (#41064438)
That would be my ideal device haha... have any particular devices of that nature you'd recommend? Lower end on cost would be preferred.
Re:Ask HN: Am I crazy or is Android development awful? on Wednesday July 24, 2024 @11:15PM (#41064417)
Appreciate the ego boost, but it was literally some modifications to python opencv demos available on their webpage. But that's what's amazing, it was up and running so fast and worked cross-platform after 5 minutes of debugging something with ChatGPT.

Yes it's become quite clear to me that using an Android phone is not a good development platform to work with external hardware devices. I understand this has never been it's intended purpose, but come on, we have a linux kernel sitting under the hood. Just feels like a waste of potential.

Re:Ask HN: Am I crazy or is Android development awful? on Wednesday July 24, 2024 @11:10PM (#41064398)
Funny enough I actually did Android development contract work circa 2012-2014. I never did anything more complex than working with internal phone components (bluetooth, accelerometer/gyroscope, GUI/text, etc) and SQLite, but even so I quickly decided I wanted nothing to do with that platform.

Coming back a decade later for a side project, I guess I have the same opinion.

Now with the help of GPT-like assistants, I'm sure I could slog through some fairly vanilla development tasks like I did in the past, but when it comes to building anything a bit 'outside the box', no thanks.

Thankfully there are hardware equivalent packages (mini linux development machines like raspberry pi) that fit the bill, but they aren't as ubiquitous or nicely packaged as a modern smartphone unfortunately.

One wonders if there's some opportunity there, take all this great generic smartphone hardware (a $100 phone now is crazy) and package it with a developer-first OS. It could just be a linux system with a dumb, button-focused frontend for users to mimic Android/iOS.

Re:Ask HN: Am I crazy or is Android development awful? on Wednesday July 24, 2024 @11:00PM (#41064360)
Hey thanks for this! I gave it a try, imported and built in my Android Studio ("Koala" if that matters), tried getting it installed on a phone, and unfortunately got this cryptic error:

> ninja: error: 'lib/libjpeg.so', needed by 'C:/Users/ADMIN/AndroidStudioProjects/kineticstreamer/app/build/intermediates/cxx/Debug/3xf5p505/obj/arm64-v8a/libkinetic.so', missing and no known rule to make it

That being said, I browsed through the code some more and while I think it's a great Android project, I don't think (assuming I got it working) it would be advisable for me to build on top of this. The existing complexity, and my lack of faith on cross-compatibility (different phones, SDK updates, etc) are a turn off. Heck I've even seen certain libraries and includes fail because they require different versions of Java/JDK that I have available.

So in summary, I think the solution for myself at least for now, will be to explore a different hardware route. A cheap raspberry pi equivalent, with a small display, and battery - annoying to have all these extra components but at least I know it'll work reliably.

Ask HN: Am I crazy or is Android development awful?

TL;DR - what I can do in 10 minutes on a desktop python app (windows or Linux, both worked fine) seems near impossible as an Android app.I have a simple application to prototype: take a wired USB webcam, display it on the screen on a computer device (ideally a small device/screen), and draw a few GUI elements on top of it.Using Python scripting and OpenCV, I had a working cross-compatible...

( Read More... | 153 comments | 27 points | on HN )
Re:Low Cost Robot Arm on Tuesday April 02, 2024 @12:22PM (#39907550)
As someone a lot deeper into robotics I totally get this sentiment... But I also think it's good to encourage people to share the basics, look how many newcomers in this thread find it interesting and may explore it further.

I wonder how smooth one could make a cheap servo-based robot arm operate with decent control algorithms.

Re:Low Cost Robot Arm on Tuesday April 02, 2024 @12:19PM (#39907512)
Nice build! I always wanted one of those AR robot arms but I'd rather buy it off-the-shelf than assemble from scratch. I don't think anyone sells them pre-built though. This type of 'high level hobbyist robotics' is in a bit of business dead-zone unfortunately, as it's some combination of too small a market and not enough use cases to justify having a company around. Or maybe there's potential there but no one's thought of it yet.

Btw I bet your arm's movement smoothness can be improved with some different deceleration rates. It was really fun watching it sort those beans!

My research goal with one of these 'good enough' 1mm repeatability robots would be vision-guided adaptive control to complete tasks after seeing examples of them done via human manual control. Would be a really interesting ML/AI problem. Just need a reasonable hardware platform to get started. Right now I'm leaning more towards simple/smaller servo motors like in the OP of this post (plus there's the cost/time trade-off).

Re:Low Cost Robot Arm on Tuesday April 02, 2024 @12:08PM (#39907384)
I've done similar projects in the past (robot arms pushing performance limits in the few thousand $ range), and I found pretty good results with stepper motors, and gearboxes with sufficiently low backlash. For reference, these designs got to approx 1mm repeatability with 2.5kg payload at ~80cm reach, meant to model a human arm somewhat.

Here's some specifics if you're interested. Depending on the end effector payload requirements, a mix of NEMA34,24,17 can do this (bigger ones for earlier joints). You can go cycloidal/harmonic gears if you have the budget, otherwise each actuator (motor + driver + gearbox + shaft coupling) would run you something like $100-$200 depending heavily on supplier and exact requirements (+$50 or so for closed-loop systems). So not terrible on the price front. Then for the base joint you'd want some wider cylindrical gearbox that distributes the load across better.

If you're able to work with a machine shop I think you can put together something really high quality. Here's some example design inspirations, some of them even better than what I described I was able to put together as a hobbyist:

https://www.youtube.com/watch?v=7z6rZdYHYfc (this one is fantastic; a smaller and lighter version operated more slowly would have even less wiggle from the base) https://www.youtube.com/shorts/II8gdIXPgaE (this is more comparable to the OP) https://www.youtube.com/shorts/_x7P9eZCkVM https://www.youtube.com/watch?v=g9AfhqOd-_I (most professional one I've seen, and almost certainly this BOM would be under $3k, probably under $1k in China. In fact I'll go ahead and email these guys since this is so cool and I wonder if they sell smaller models) https://www.youtube.com/watch?v=iB2NAgfVjIs (definitely check out Chris Annin, American roboticist who imo makes some of the best open source low cost stepper motor robots)

Older ยป