News for hackers. Stuff that matters.
Re:Local-first software: You own your data, in spite of the ... by echelon on Saturday July 05, 2025 @03:56PM (#44475094)
> I'm sick of everyone trying to come up with a use case to get all my data in everyone's cloud so I have to pay a subscription fee to just make things work.

AI photo and video generation is impractical to run locally.

ComfyUI and Flux exist, but they serve a tiny sliver of the market with very expensive gamer GPUs. And if you wanted to cater to that market, you'd have to support dozens of different SKUs and deal with Python dependency hell. And even then, proficient ComfyUI users are spending hours experimenting and waiting for renders - it's really only a tool for niche artists with extreme patience, such as the ones who build shows for the Las Vegas Sphere. Not your average graphics designers and filmmakers.

I've been wanting local apps and local compute for a long time, but AI at the edge is just so immature and underpowered that we might see the next category of apps only being available via the cloud. And I suspect that these apps will start taking over and dominating much of software, especially if they save time.

Previously I'd only want to edit photos and videos locally, but the cloud offerings are just too powerful. Local cannot seriously compete.

Re:Local-first software: You own your data, in spite of the ... by flkenosad on Saturday July 05, 2025 @04:29PM (#44475304)
> AI photo and video generation is impractical to run locally.

You think it always will be? What can the new iPhone chips do locally?

Re:Local-first software: You own your data, in spite of the ... by bananaboy on Saturday July 05, 2025 @07:13PM (#44476312)
Regardless of what hardware capabilities exist, the previous post makes it sound like every application needs AI which is just not true.
Re:Local-first software: You own your data, in spite of the ... by echelon on Saturday July 05, 2025 @04:56PM (#44475479)
> You think it always will be? What can the new iPhone chips do locally?

I suspect we're a decade off from being able to generate Veo 3, Seedance, or Kling 2.1 videos directly on our phones.

This is going to require both new compute paradigms and massively more capable hardware. And by that time who knows what we'll be doing in the data center.

Perhaps the demands of generating real time fully explorable worlds will push more investment into local compute for consumers. Robotics will demand tremendous low latency edge compute, and NVidia has already highlighted it as a major growth and investment opportunity.

Re:Local-first software: You own your data, in spite of the ... by satvikpendem on Saturday July 05, 2025 @05:47PM (#44475829)
But who said anything about AI? Lots of local-first apps have nor need any AI whatsoever. And by the way, Topaz Labs has good offerings for editing photos and videos with AI that run locally, works great for many use cases (although it's not fully generative like Veo etc, more like upscaling and denoising, which does use generative AI but not like the former).
Re:Local-first software: You own your data, in spite of the ... by bigfatkitten on Saturday July 05, 2025 @07:34PM (#44476407)
Most cloud apps have no need for AI either, but companies are pushing it anyway for bullshit marketing reasons, similar to what they did with blockchain a decade ago.
Re:Local-first software: You own your data, in spite of the ... by satvikpendem on Sunday July 06, 2025 @12:40AM (#44477890)
Sure, that's unrelated to my point however, it's a non sequitur.
Re:Local-first software: You own your data, in spite of the ... by echelon on Saturday July 05, 2025 @05:54PM (#44475877)
I suspect that most content will be generated in the future and that generation will dominate the creative fields, white collar work, and most internet usage.

If that's true, it's a substantial upset to the old paradigms of data and computing.

Re:Local-first software: You own your data, in spite of the ... by satvikpendem on Saturday July 05, 2025 @05:57PM (#44475902)
Yes, that is true, but again for apps like a fitness tracker, it is not "content" based. Sure, it might have some AI in the form of chatbots to ask what your diet plan should be based on your current progress, but that's not what you're talking about. In my experience, most local-first apps are like this fitness tracker, utility tools, rather than a means to view content, like TikTok.
Re:Local-first software: You own your data, in spite of the ... by echelon on Saturday July 05, 2025 @08:47PM (#44476796)
The vast majority of apps, or at least data consumption, will not fit the shape of "fitness tracker". Budgeting, emails [1], workout routines - those will fall into a non-generative bucket of applications.

I still purport that in the future, most applications and screen time will fall into a generative AI bucket: creating media, writing code, watching videos, playing games, searching for information, etc. I wouldn't even be surprised if our personal images and videos get somehow subsumed and "enriched" with AI.

[1] Well, email might fall into a non-generative bucket. There are already tools that purport to both read and write your emails for you. I'm not quite sure what to make of those.

Re:Local-first software: You own your data, in spite of the ... by satvikpendem on Sunday July 06, 2025 @12:42AM (#44477896)
> or at least data consumption

Good thing I'm not talking about data consumption apps then, as I mentioned in my comment above. Local-first apps specifically are not amenable to data consumption purposes so while you are right on the generative AI part, it's unrelated to the topic of this post.