News for hackers. Stuff that matters.
Re:Unsloth Qwen3.8-27B Quantizations – Dynamic v3.1 Update by Incipient on Saturday November 14, 2026 @01:14AM (#50494498)
This would depend hugely on the price of electricity, however I'm pretty sure where I am (at roughly 25c/kwh in usd) the price of running qwen costs more than 6.1-luna per token. So other than privacy (which doesn't matter for my work) there isn't any justification for running locally. Is privacy purely what people justify local models on?
Re:Unsloth Qwen3.8-27B Quantizations – Dynamic v3.1 Update by stkdump on Saturday November 14, 2026 @01:33AM (#50494586)
Doesn't Qwen3.8 do much better than Luna?
Re:Unsloth Qwen3.8-27B Quantizations – Dynamic v3.1 Update by otabdeveloper4 on Saturday November 14, 2026 @02:21AM (#50494818)
You can rent a dedicated server. It's easy and costs 10 times less than a "cloud".
Re:Unsloth Qwen3.8-27B Quantizations – Dynamic v3.1 Update by NooneAtAll5 on Saturday November 14, 2026 @02:27AM (#50494851)
if privacy doesn't matter for you, why use expensive luna instead of deepseek?
Re:Unsloth Qwen3.8-27B Quantizations – Dynamic v3.1 Update by girvo on Saturday November 14, 2026 @02:58AM (#50495010)
Depends. The running costs of the DGX Spark-like’s GB10 are very low; they run at crazy low wattages really. But they’re expensive devices
Re:Unsloth Qwen3.8-27B Quantizations – Dynamic v3.1 Update by anakaine on Saturday November 14, 2026 @06:30AM (#50496158)
When the XGX Spark is the equivalent of 1/10th of the pre tax annual salary of a top 5-8% earner, its far too expensive. Not sure if its cheaper comparatively in the US, but its a nightmare in Australia unless you are on an obscene salary. Throw in an approximate 30% tax rate and high cost of living - you've got to strongly wonder if it's worth it.
Re:Unsloth Qwen3.8-27B Quantizations – Dynamic v3.1 Update by entrope on Saturday November 14, 2026 @08:41AM (#50496957)
A DGX Spark is currently less than 10% of the median US household income (~80,000 USD/year), but that's still a big expense for the middle class. Until July or so, it was under 10% of the median personal income (~47,000 USD/year).
Re:Unsloth Qwen3.8-27B Quantizations – Dynamic v3.1 Update by girvo on Saturday November 14, 2026 @03:42PM (#50500634)
I bought mine in Aus, the Asus GX10 version for $6500 AUD. Expensive, but has been well worth it in terms of the knowledge I’ve gained at least
Re:Unsloth Qwen3.8-27B Quantizations – Dynamic v3.1 Update by anakaine on Tuesday November 17, 2026 @10:10PM (#50541379)
Most similar are now going for >$9,000
Re:Unsloth Qwen3.8-27B Quantizations – Dynamic v3.1 Update by LeBit on Saturday November 14, 2026 @04:23AM (#50495457)
Non-local models are sometimes unavailable.

Non-local models don’t get nerfed before the release of the newer model.

Non-local model provide privacy. You say you don’t care for your kind of world, but eventually you do care for other aspects of your work or life. I’m don’t want even a zdr model to see my private notes where I plan how to get back at coworkers who stole my lunch.

Re:Unsloth Qwen3.8-27B Quantizations – Dynamic v3.1 Update by badsectoracula on Saturday November 14, 2026 @04:55AM (#50495638)
I think the last two should have been "Local models" instead of "Non-local models" :-P
Re:Unsloth Qwen3.8-27B Quantizations – Dynamic v3.1 Update by LeBit on Saturday November 14, 2026 @08:31AM (#50496887)
It was late. I even reread my post because I have a tendency to mistype a lot the older I get.

God damn it!

Re:Unsloth Qwen3.8-27B Quantizations – Dynamic v3.1 Update by ReptileMan on Saturday November 14, 2026 @04:23AM (#50495458)
>however I'm pretty sure where I am (at roughly 25c/kwh in usd) the price of running qwen costs more than 6.1-luna per token

What is the price of not having your ssh keys uploaded to the NSA?