Cars have plenty of horror stories associated with them, but convenience keeps most people happily driving everyday without a second thought.
Google can quarantine your life with an account ban, but plenty of people still use gmail for everything despite the stories.
So even if Claude cowork can go off the rails and turn your digital life upside down, as long as the stories are just online or "friend of a friend of a friend", people won't care much.
"Claude CLI deleted my home directory and wiped my Mac" https://news.ycombinator.com/item?id=46268222
"Vibe coding service Replit deleted production database, faked data, told fibs" https://news.ycombinator.com/item?id=44632575
"Google Antigravity just deleted the contents of whole drive" https://news.ycombinator.com/item?id=46103532
Car crashes are incredibly common and likewise automotive deaths. But our personal experience keeps us driving everyday, regardless of the stories.
People will use AI because other options keep getting worse and because it keeps getting harder to avoid using it. I don't think it's fair to characterize that as convenience though, personally. Like with cars, many people will be well aware of the negative externalities, the risk of harm to themselves, and the lack of personal agency caused by this tool and still use it because avoiding it will become costly to their everyday life.
I think of convenience as something that is a "bonus" on top of normal life typically. Something that becomes mandatory to avoid being left out of society no longer counts.
People love their cars not because they’re enthusiasts
Perhaps it depends on how smelly your society is.
Anyway I think we are in agreement, given a good system and a good society trains become quite attractive, otherwise cars are more preferred.
Yeah Kagi is good, but the web is increasingly dogshit, so if you're searching in a space where you don't already have trusted domains for high quality results, you may just end up being unable to find anything reliable even with a good engine.
This is anecdotal but "people" care quite a lot in the energy sector. I've helped build our own AI Agent pool and roll it out to our employees. It's basically a librechat with our in-house models, where people can easily setup base instruction sets and name their AI's funny things, but are otherwise similar to using claude or chatgpt in a browser.
I'm not sure we're ever going to allow AI's access to filesystems, we barely allow people access to their own files as it is. Nothing that has happened in the past year has altered the way our C level view the security issues with AI in any other direction than being more restrictive. I imagine any business that cares about security (or is forced to care by leglislation) isn't looking at this as a they do cars. You'd have to be very unlucky (or lucky?) to shut down the entire power grid of Europe with a car. You could basically do it with a well placed AI attack.
Ironically, you could just hack the physical components which probably haven't had their firmware updated for 20 years. If you even need to hack it, because a lot of it frankly has build in backdoors. That's a different story that nobody on the C levels care about though.
[1]: https://eclecticlight.co/2024/04/08/apfs-snapshots/
[2]: https://eclecticlight.co/2021/09/04/explainer-the-macos-vers...
So, no, there is no undo in general. There could be under certain circumstances for certain things.
May just trash some extra files due to a fuzzy prompt, may go full psychotic and decide to self destruct while looping "I've been a bad Claude" and intentionally delete everything or the partitions to "limit the damage".
Wacky fun
[1]: https://github.com/arsenetar/send2trash (random find, not mine)
So maybe on some apps, but "all" is a difficult thing.
This is essentially a UI on top of Claude Code, which supports running in a sandbox on macOS.
Also one can simply run a virtual machine which can do that but then the issue becomes in how apps from outside connect to vm inside
NixOS still isn't ready for this world, but if it becomes the natural counterpart to LLM OS tooling, maybe that will speed up development.
I wanted to comment more, but this new tool is Mac only for now, so there isn't much of a point.
There is also xet by huggingface which tries to make git work better with big files
On the user side, I could easily see [systemd-homed](https://fedoramagazine.org/unlocking-the-future-of-user-mana...) evolving into a system that allows snapshotting/roll forward/roll back on encrypted backups of your home dir that can be mounted using systemd-homed to interface with the system for UID/GID etc.
These are just two projects that I happen to be interested in at the moment - there's a pretty big groundswell in Linux atm toward a model that resembles (and honestly even exceeds) what NixOS does in terms of recoverability on upgrade.
Time Machine has a reputation for silent failures and corruption issues that have frustrated users for years. Network backups (to NAS devices) use sparse bundle disk images that are notoriously fragile. A dropped connection mid-backup can corrupt the entire backup history, not just the current snapshot. https://www.google.com/search?q=time+machine+corruption+spar...
Time Machine sometimes decides a backup is corrupted and demands you start fresh, losing all history. Backups can stop working without obvious notification, leaving users thinking they're protected when they're not. https://www.reddit.com/r/synology/comments/11cod08/apple_tim...
The shift from HFS+ to APFS introduced new bugs, and local snapshots sometimes behave unpredictably. https://www.google.com/search?q=time+machine+restore+problem...
The backup metadata database can grow unwieldy and slow, eventually causing failures.
https://www.reddit.com/r/MacOS/comments/1cjebor/why_is_time_...
https://www.reddit.com/r/MacOS/comments/w7mkk9/time_machine_...
https://www.reddit.com/r/MacOS/comments/1du5nc6/time_machine...
https://www.reddit.com/r/osx/comments/omk7z7/is_a_time_machi...
https://www.reddit.com/r/mac/comments/ydfman/time_machine_ba...
https://www.reddit.com/r/MacOS/comments/1pfmiww/time_machine...
https://www.reddit.com/r/osx/comments/lci6z0/time_machine_ex...
Time Machine is just garbage for ignorant people.
It is a very solid setup, with 3 independent backups: local, nearby and far away.
Now - it took an awful lot of time to set up (including drinking the wrapper to account for everything). This is advanced IT level.
So Time Machine is not for ignorant people, but something everyone can use. (I never used it, no idea if it's good but it has to all last work)
Guess there's a lot of money to be made wrapping it with a paid GUI
Restic is fantastic. And restic is complicated for someone who is not technical.
So there is a need to have something that works, even not in an optimal way, that saves people data.
Are you saying that Time Machine doe snot backup data correctly? But then there are other services that do.
Restic is not for the everyday Joe.
And to your point about "ignorant people" - it is as I was saying that you are an ignorant person because you do not create your own medicine, or produce your own electricity, or paint your own paintings, or build your own car. For a biochemist specializing in pharma (or Walt in Breaking Bad :)) you are an ignorant person unable to do the basic stuff: synthetizing paracetamol. It is a piece of cake.
My father is 77 now and only started using computer abover age 60, never touched windows thanks to me, and has absolutely no problems using (and administrating at this point) it all by himself
The key for using AI for sysadmin is the same as with operating a power drill: pay at least minimum attention, and arrange things so in the event of a problem, you can easily recover from the damage.
We have far more serious rules at play for harm when it comes to physical goods which we have experience with, than generative tools.
There is no reason generative tools should not be governed by similar rules.
I suspect people at anthropic would agree with this, because it would also ensure incentives are similar for all major GenAi purveyors.
People, in general, have no such physical instincts for how using computer programs can go wrong.
The base model itself is biased away from actions that would lead to large scale destruction. Compound over time and you probably never get anywhere too scary.
I haven't had to tweak an OS like Win 11 ever.
I am not even certain if this issue can be solved since you are sending your prompts and activities to "someone else's computer", but I suspect if it is overlooked or hand-waved as insignificant, there will be a time when open, local models will become useful enough to allow most to jettison cloud AI providers.
I don't know about everyone else, but I am not at all confident in allowing access and sending my data to some AI company that may just do a rug pull once they have an actual virtual version of your mind in a kind of AI replication.
I'll just leave it at that point and not even go into the ramifications of that, e.g., "cybercrimes" being committed by "you", which is really the AI impersonator built based on everything you have told it and provide access to.
I do believe the approach Apple is taking is the right way when it comes to user facing AI.
You need to reduce AI to being an appliance that does one or at most a few things perfectly right without many controls with unexpected consequences.
Real fun is robots. Not sure no one is hurrying up on that end.
>>Edit: most comments are focused on pointing out that version control & file system snapshot exists: that's wonderful, but Claude Cowork does not use it.
Also in my experience this creates all kinds of other issues. Like going back up a tree creates all kinds of confusions and keeps the system inconsistent with regards to whatever else it is you are doing.
You are right in your analysis that many people are going to end up with totally broken systems
It would be madness to work completely offline these days, and all of these systems have version history and document recovery built in.
Weird they don't use it - might backfire hard
There's no sandboxing snapshot in revision history, rollbacks, or anything.
I expect to see many stories from parents, non-technical colleagues, and students who irreparably ruined their computer.
Edit: most comments are focused on pointing out that version control & file system snapshot exists: that's wonderful, but Claude Cowork does not use it.
For those of us who have built real systems at low levels I think the alarm bells go off seeing a tool like this - particularly one targeted at non-technical users