AntiRush
The linked lanparty.com is also a great exploration. (The first archive is from a few months after the article)
https://web.archive.org/web/19981212015213/www.lanparty.com/
I'm pretty sure my friends and I used this resource when setting up: https://web.archive.org/web/19981202184536/http://www.lanpar...
The 3 billion includes all active experts, and then other shared weights, attention components, embeddings.
In the qwen 3.5 35b a3b series, each expert is ~3 million parameters. There are 40 layers which each have 1 shared expert and 8 routed experts. Roughly 1.1B of the 3B active are experts.
When the qwen 4 series is released I am hopeful there'll be a strong model with the same architecutre. as qwen3.8-flash-next.
Using the Q4 quant on an RTX 6000 Pro Workstation Edition at 450 watts:
Code: prefill 1,251 tok/s decode 255.26 tok/s
Prose: prefill 1,251 tok/s decode 198.78 tok/s
Most important for me, I can run 4 concurrent streams at 400+ tok/s.On the Naturalness of Software [pdf]
https://www.sec.gov/Archives/edgar/data/1018724/000101872426...
https://web.archive.org/web/20091124210529/http://eis.ucsc.e...
There's a great contemporary Ars Technica piece by a competitor:
https://arstechnica.com/gaming/2011/01/skynet-meets-the-swar...
As an undergrad I did a project using genetic programming. It was not very successful, but it was a lot of fun.
https://tomisin.space/archive/starcraft-genetic-programming/
Inside The Discussions at AI Companies over a Superintelligence Doomsday
This one is written by Paul Lutus, of Apple Writer fame.
Confessions of a Long-Distance Sailor
Pokee-Isaac 28B
The matrix of vehicles is my favorite part. If you drive down these same streets today it's a sea of black, white and grey.
You'll be happy to know that Les Girls is still there today, advertising burlesque, go go dancers and "full nude". They finally replaced the sign earlier this year, but it still looks very much the same.
Les Girls is the feature of a fascinating podcast, too: https://www.kpbs.org/podcasts/stripper-energy
https://microsoft.ai/news/introducingmai-code-1-flash/
and the model card
https://microsoft.ai/pdf/MAI-Code-1-Flash-Model-Card.PDF
The broader announcement of 7 MAI models seems to be where the 5B active in the title comes from
https://microsoft.ai/news/building-a-hillclimbing-machine-la...
The Making of Dark Castle
On top of that he was incredibly competent at navigating the combination of hostile bureaucracy, apathy, and disorganization. It's incredible what he and PIH accomplished.
Moutains Beyond Mountains[1], another book by Kidder, is even more compelling to me. It's a fascinating story of Paul Farmer, who dedicated his life to fighting infectious disease, especially in Haiti.
[1] https://en.wikipedia.org/wiki/Mountains_Beyond_Mountains
Show HN: Graph:Easy ported to TypeScript with GPT-5.2
https://tomisin.space/graph-easy-ts/
Over Christmas, I read a blog post here about attempting to port Graph::Easy (a very cool Perl module) to TypeScript using LLMs:https://news.ycombinator.com/item?id=46318080The author didn’t get the results they wanted, but I was nerd-sniped into giving it a try with some different tools.The link is a web page where you can enter Graph::Easy graph descriptions to generate graphs in the various...