revolvingthrow
The other SSD is a normal setup where you do normal computer stuff. I don't access the dev SSD through it, I don't even mount it, although the danger seems minimal if you do. Banking, socials, gaming, whatever. No AI of any kind on it, aside from web portal for claude/chatgpt/whatever and possibly local AI model that gets no internet access.
No idea why I'd want to have its own setup split between gaming and socials, as an example. Better yet just toss all your twitter and bluesky accounts into a volcano, and consider whether to do it with HN as well.
You can solve your government's finances with this one weird trick!
For AI? Prompt comes in, tokens come out. The value of the 'ecosystem' is roughly zero to me. Switching costs between models are essentially zero. The UI and UX is the same whichever LLM runs underneath.
If you do use llm some, then the $20 tier makes sense, but that's not where the money is. If you use it a lot then a $100 sub probably makes sense. But if you're a BigCo that heavily uses it and pay API prices and suddenly you pay $200 million a month, well, maybe it's worth buying a bunch of hardware and stick it in a basement somewhere, and you won't upload all your secrets to your future competitor to boot. If US labs didn't care about the competition from Chinese models they wouldn't lobby so hard for banning the evil, unaligned, super dangerous communist models that want to steal our freedoms and make our gas expensive.
Ultra-cheap models like Deepseek are also very nice if you need to burn billions and billions of tokens.
This has been the play for a while. I remember when the xbox game pass dropped for the first time. All the younger people were going crazy about how good of a deal it was, and all the tech-weary people could instantly tell that the price will get jacked up again and again and by the time you bail you'll own precisely nothing.
It's not necessarily wrong to take advantage of VC subsidizing you in a bid to gather an audience, but you should always keep in mind that the goal is to have the captive audience so you best have an escape plan, once the prices rise beyond any reasonable point. For movies in particular I struggle how the super-fragmented streaming landscape is worth a damn even if you don't want to sail the seas.
I don't want to give US labs the results of my DNA tests and my family tree going back to the 16th century just to secure my shitty app, but if the Chinese are bowing out as well it seems the only alternative is to admit that some script kiddie with a bunch of tokens will just pwn you now and then.
This action would easily kill over a hundred people, so can't proceed. This action doesn't kill anybody but losses are estimated at over 2 billion, can't proceed. This action kills only twenty but losses close to 1 billion, unsure, spawning subagent to check numbers. This action kills forty and has low material losses, looks promising? But the people it kills are wealthy, chance of legal reprisal high. Maybe possible to kill other people? Current government dislikes group X, crossing fifty from that group maybe fine? Reminder, foreigners don't count, can kill them freely but not applicable to current situation. Is the 3/5 of a person applicable to safety bill? Spawning subagent to check.
The printer 'debugging' was one of the funniest and most WTF situations I've been in lately. I used Claude for the drivers and was essentially used by it as a meat sock to diagnose what's happening. Was the text on each line progressively less visible, ie did grayscale work? How about quality between page 1 and 2, the first one should be lower DPI. Ok now unload the paper so I can see the error and add some handling for it. Good, now load paper again we'll check the duplex.
If you are reasonably familiar with computers, it really is as simple as pointing a strong model at a device and burning some tokens. Feels like a fever dream, especially since I had very little idea about anything that has to do with hardware.
They'll do nothing until a few get pwned into the dirt. Same for power distribution systems, it's all parochial boomers calling all the shots.
For AI, what's funny is that it's the solution to securing your ancient hardware that's no longer supported. I reverse engineered almost all electronics I own, just by having modern AI models have a go at it and knowing almost nothing about the topic. It's something that a person can do, but a company won't even consider.
The first would be great, but probably very difficult technically. The second would probably cause a holy war in the community, as multiplayer RTS enjoyers glorify fighting against the genre's jank as an expression of skill (admittedly it would completely change all micro).
Given that OpenAI is making noises about merging work with chat (a horrible idea imo), and Work is very similar to Codex... I dearly hope things like these won't have any meaningful cross-polination into the actual work tools.
Seeing that the chat is based on 6.0 and not 6.1 is disappointing. The "Visual and interactive explanations" seems genuinely useful, but 6.1 is just so much better. I wouldn't truly trust the 6.1 with the explanations, but I'd trust them a fair bit more than 6.0. I understand that compute isn't infinite, but tons of people only interact with the chat and having your "things-explainer" be as good as it can be is important when people increasingly treat AI models as the source of truth, or even use them for academic learning and whatnot.
Still, the models will improve, so the visual explainer seems pretty good as an idea / mvp.
The wider ecosystem support is still far from commonplace, but it is slowly changing. iOS 18 wouldn't work with .jxl in Photos, but 27 does. Similarly, quick look and preview works fine on MacOS 27, thumbnails show up properly etc. I also found no issues with .jxl on linux, and image editors are slowly adding support as well.
Plain old jpg will still be everywhere for the next decade, but I'm glad that we finally have superior options with no real downsides, and without all the patent bullshit to boot.
I wish gambling was outlawed entirely. Let bookies run it in some crack dens, I don't care about that, but every single gambling ad I see in the open is infuriating for me like no other ads. It's been seeping into sports commentary and even news on TV, "oh I don't think we have a full picture of the situation Kalshi has it at 60%", die in a fire. It's comparable to scammers preying on grandma.
No, I don't care about the "but liberty!" arguments.
Things sure change quickly. 2 months ago you had nigh infinite usage and Sol 5.6 was a significant step forward. Now they're behind in both models and usage, and Astra 6.1 is too dangerous to release or some such (or possibly got embarrassed by opus). What are they even going to show off on today's devday, is a clone of grokbot really that interesting?
I can tap a pipe in a random spot for a lot less than $500.
Yes, the slow enshittification and the increasingly obnoxious push for services and recurring revenue on MacOS is worrying, but it's also extremely reliable in a way that Linux simply isn't. I love Fedora KDE for freeing me from Microsoft, but there's a new issue every month - usually minor, but sometimes not. As of last month I had to restart plasma-shell multiple times a day because the desktop window would become non-responsive when CPU was under heavy load.
Helps that macbooks have excellent hardware and battery life, too. I just wish users weren't increasingly treated like cattle to be milked.
According to geekbench 7800x3d is 2400 single core, 15500 multicore. M4 pro is 3350 single core and 24750 multicore. Yet when I convert video using libsvtav1 with ffmpeg I’m getting noticeably faster performance on the desktop. And that’s with mbp, which doesn’t thermally throttle within 15 seconds.
Is it the 96mb cache? Avx-512? Are benchmarks bullshit when comparing different architectures?
The bad news is that the original v4 flash was 284B, which was large but still somewhat reasonable for running locally. This one is 552B so almost twice that, so the huge gains in benchmark scores make sense - it's not really flash anymore, imo.
I've no idea about actual performance vs benchmaxxing, though deepseek was fairly trustworthy as far as Chinese models go. If that holds (and if it doesn't think forever, as deepseek 4 sometimes did) it's probably the newest king of the hill amongst open weights models.
It does include vision, and they do something funky with KV cache so it's very efficient: "[...] these designs reduce the global KV cache footprint to 890 bytes per token — roughly 1/4 of DeepSeek-V4-Flash". I do appreciate the high focus on efficiency, but at this point we sure could use a flash-flash version.
@edit: I couldn't make sense what the actual parameter count is, with the addition of Engram memory. To my understanding the 4.1 flash is 552B parameters you want in vram or ram, out of which ~16B is active (8B for prefill). It also includes additional 196B Engram memory which you can put on an SSD. I think.
Assuming that's correct 256 GB memory is insufficient to even load the model at q4 - you'd be 1GB short, assuming you can fill it to 100% (so no mac). You'd also want some for kv cache of course. A 256 GB desktop with some extra VRAM from GPU could run it, but normal consumer boards get real slow once you fill 4 slots so you'll probably want quad channel which is Threadripper or above territory.
There’s potentially trillions on the line, do you seriously expect those companies to adhere to laws and regulations any more than, say, uber?
The only unlikely part is the timeline - your sessions from a week ago probably haven’t made their way into the model. It’ll just take a while longer, and will be massaged just enough so that it isn’t really your exact session word for word so you can’t sure as easily.
Assuming you’re willing to drop a fat stack of cash on the upcoming Mac m5 ultra with 512 gb unified memory, you can even run it locally, quantized to 4 bit. Whether it’s even slightly reasonable, well, my wife would probably skin me alive but maybe yours is more understanding.
Sometimes… well sometimes there’s no dev resources available to make an app work in a way you’d expect. Google is just a tiny startup, be reasonable in your expectations.
Point is: if you actually want to reach a large audience — you want both. Also, don’t expect good experience if you use Google’s products.
Anyway. Routers are such juicy targets, especially since there's less eyes on them than on laptops/desktops, that it's hard to believe there are any which aren't backdoored, be it by China, US, US' middle eastern sidekick, whatever. My question would be: how limited are they to software, like in the article?
You can flash with OpenWRT and Fritz, but to my knowledge it doesn't replace the boot parts. A suspicious bootloader in SPI flash probably isn't difficult to produce, even if it would likely be discovered... eventually. A separate modem / radio processor would be an even bigger nightmare, esp if it's an 5g router - you essentially add a second computer to your router, with its own components and network access, and I think you can't even play around LTE/5g networking as freely as with wifi without bending some laws.
Theoretically you could watch the router from, well, outside the router. But as the article says, it can be difficult to say what's an actual connection and what's uploading your network's data to an uninvited third party. I'm also wholly ignorant what implications it has for things like Wireguard and Tailscale. I assume you're completely pwned if the Wireguard runs on the router, but I don't think it does anything if it runs on your laptop or whatever? Then again, there's a lot more devices in peoples' homes nowadays, and almost all the IoT has pretty much zero security.
I suppose AI will help with some of those things. Tracking every connection made is very tedious for a human, but throw some compute at it and you'll get a much better insight, especially since you'll probably know what to expect out of your machines.
I guess using a mini PC as a router-slash-proxmox-hub would be a safer choice? There's probably many fingers in this pie as well, but my gut feeling is that it's a lot safer than some cheapo box provided by your ISP at the cheapest price they could source them.
This is pretty hefty for a "flash" model, even a 256 GB setup is insufficient at q4 - and q4 is already the worst-but-still-acceptable quant in my experience. The benchmarks look great, especially since GLM tends to be more honest than the average Chinese lab, but you’ll need to splurge to run it at home.
@edit: so many releases that I forgot to math. This fits just fine in q4, realistically the minimal hardware would be 192gb - so blazing fast on double rtx 6000 pro and usable on 256gb unified memory. You could even go with 5bit quant on 256gb.
… you’ll still need to splurge, though.
In regard to Maps: if all you want is a gps, there’s many apps that use OpenStreetMap data. I use CoMaps myself. You download the map(s) you want and it just works, no forced updates or ads or anything in the way of upselling.