News for hackers. Stuff that matters.

AustinDev

I did miss your point. I would say most businesses always want to be able to do more work for less money.
Re:Astra can read and write weights to improve Qwen on Monday November 02, 2026 @05:44PM (#50345101)
Short answer is tokenizers, so to the LLM your query was roughly:

[5299][1991][428][885][306][181747][3]

[How][ many][ r]['s][ in][ blackberry][?]

Hope that helps. Using the open source gpt-tokenzier.

Re:Musk says Grok Bot cost unsustainably high on Monday November 02, 2026 @12:17PM (#50340104)
A few weeks prior they announced they were going to use the 'best model' for the job in Grok Bot which included Opus 5.5. I'm assuming the opus 5.5 bill was getting far too high.
Yeah use /goal or use another agent to prompt CC it's kind of silly but it also works.
I got Chat GPT 5.5 to land on the Mun in Kerbal Space program it was a fun and interesting learning experience.
Let's say your company makes holes. The year is 2026 so you use excavators because they are good at digging holes quickly. Would you hire a guy who refuses to use an excavator but will happily use a shovel?
Re:Git for US Legislation on Wednesday October 28, 2026 @01:06AM (#50269543)
AI explainer videos are actually pretty good. Good usage.
Re:Jev Meets the Trolley Problem on Thursday October 15, 2026 @07:46PM (#50111911)
There was a game that was Jev trolley problem PVP. The meta appears to be that you need to make the most mainstream journalism victim case. The more holocaust adjacent the better

https://trolley.typememetics.institute

It was an interesting experiment. I got to top 50 without a racial or religious based prompt but couldn't beat the top tier grievance folks.

Re:Muse Spark Open on Thursday October 15, 2026 @03:53PM (#50109341)
Yep, just benchmarked it against GLM5.3 Flash on my own local bench and it's slower in TTFT, tok/s and concurrency. It also scored lower.

Tried different reasoning levels and didn't really see any difference but GLM 5.3 flash only really works high, max or none so I couldn't really compare the lower efforts which appear to work on Spark.

Re:Why Texas Is Making Data Centers Wait on Sunday October 11, 2026 @12:52PM (#50045214)
I lived through it. I've listened to the podcast. 2026 is not 2021 or 2022. Since about 2022 or maybe 2023 I have never received a single ERCOT warning message text. Before then they were pretty common.

I'm saying it was a problem, it's been addressed. We had one of our hottest Augusts on record this year without a single issue.

If you think it's structurally broken there are energies futures markets you could use to make a lot of money on.

Re:Why Texas Is Making Data Centers Wait on Sunday October 11, 2026 @12:42PM (#50045103)
From what I can tell a bunch of batteries, solar and wind came online since then not sure if the govt was involved or not.
Re:Why Texas Is Making Data Centers Wait on Sunday October 11, 2026 @12:35PM (#50045021)
The power has been great since the freeze. Market forces fixed the problems. People were making $9,000/kwh at times. That's never going to happen again.
Re:2D Vehicles on Saturday October 10, 2026 @03:41PM (#50036414)
And for that same reason people knit their own scarves but they don't expect the scarf they see at the store to be hand knit.
Re:Reactions to 100 Solutions on Saturday October 10, 2026 @11:54AM (#50034153)
>You can already performantly run frontier level models on systems with $1600 tier video cards.

Quanted out Qwen 3.8 models are not frontier level. Have you used them for real work? They suck. They are so unsure of themselves due to the quant-lobotomy. They just endlessly loop in thinking even when they have the right decision and then output it when they get to the thinking cap. They score close in benchmarks because most benchmarks don't measure time to complete a task.

I use Qwen quants in production for fast inference but I disable thinking and have them fine tuned for the task. My realtime transcription + translation stack right now is running 5 streams at 380 tok/s.

Running DeepSeek 4.1 Flash at FP4 is going to need at least a 10-15k machine. I'd consider that near frontier level.

Re:US Suspends Visa Program for Tech Firms Including Microsoft on Thursday October 08, 2026 @11:15PM (#50015561)
What are you even talking about?
Re:US Suspends Visa Program for Tech Firms Including Microsoft on Thursday October 08, 2026 @04:31PM (#50011764)
What is the purpose of a nation if not to benefit its own Citizens. If it doesn't do that in good times then why would anyone fight when called upon?
Re:US Suspends Visa Program for Tech Firms Including Microsoft on Thursday October 08, 2026 @03:18PM (#50010670)
I don't follow? Why would a US citizen want to compete against 8B people for jobs instead of just 300M? Seems like the lower number is better for the citizens of the US.
Re:Claude Haiku 5.5 on Wednesday October 07, 2026 @02:17PM (#49996687)
encode and decode tok/s which is ($/s) when it comes to pricing drops heavily above 100k tokens.

There are plenty of workflows like translations where you'd easily be under the cap.

Re:What is going on with ceiling fans on Sunday October 04, 2026 @05:33PM (#49958119)
This makes sense when you realize most ICE car makers get a substantial portion of their revenue from maintenance and replacement parts.
Re:RuneScape's Position on Gen AI on Sunday October 04, 2026 @01:56PM (#49956204)
Fair enough. Cheers
Re:RuneScape's Position on Gen AI on Sunday October 04, 2026 @01:47PM (#49956095)
Still happens on modern models like ChatGPT Image and Qwen 2.1. It's extremely rare in Gemini since nano banana's release. I work with people who generate 1,000's of images a week and it'll happen. There is a slack channel for it where you tag the model.
Re:RuneScape's Position on Gen AI on Sunday October 04, 2026 @01:17PM (#49955809)
You're not going to know if they used an LLM to write a better shader or if they copied code from stack overflow like we used to do a few years ago.

I'm so excited that LLMs are great at coding. Most of my problems I have with various games I love is that they're written by people who couldn't write performant code at all but are great at building a world and telling a story.

Just look at Escape from Tarkov. Great game but some of the worst software architecture choices of all time. It used to take 4 minutes to get out of match and often 10-15 minutes to get into one and it was all just because of shitty code / design.

It's been fixed now and I'm sure modern LLMs were the reason.

John Carmack is the exception not the rule.

Re:I Quit OpenAI Because Its Culture Is Broken on Sunday October 04, 2026 @12:42PM (#49955469)
All of these things would require humans to prompt the models. So... the humans doing the prompting should suffer the consequences, this isn't that complicated.
Re:I Quit OpenAI Because Its Culture Is Broken on Sunday October 04, 2026 @12:39PM (#49955434)
I think railway safety and nuclear safety are fundamentally different from AI Safety.

I would bet the vast majority of the world population would agree that they don't want to see trains derail or nuclear plants meltdown.

I don't think there is that sort of agreement when it comes to the question of AI Safety.

Is generating the founding fathers of the US as Africans good AI Safety? To some people maybe.

Re:Writing code by hand is over, forever on Saturday October 03, 2026 @07:31PM (#49948832)
Just put the code in the bag.
Re:Writing code by hand is over, forever on Saturday October 03, 2026 @07:23PM (#49948777)
Sentiment is mostly correct, but the writing is terrible.
Starlink is too low to be a concern for Kessler Syndrome. They all deorbit on their own in a few years. 700-1,000km is the orbit that should be observed for Kessler risk. <500km is of no real concern due to atmospheric drag.
The US does own the moon for all practical purposes, or we did until we gave up our capacity to reach it.
Is it the public commons if you can't reach it?
Re:GPT-6 Sol and Luna on Tuesday September 22, 2026 @02:22PM (#49805862)
and anthropic won't? or any other inference provider? Running your own inference either locally or remotely are probably the only ways to make sure that doesn't happen.

Older »