News for hackers. Stuff that matters.

5kg

Host to device bandwidth (ram to vram) is 128Gb/s for PCIe Gen 6. VRAM to GPU bandwidth is 1.8Tb/s for GDDR 7 (5090), and 8Tb/s for HBM3e (B200). So it can be faster to recompute than offload kv cache.
Re:Racket v9.1 on Wednesday February 25, 2026 @04:58PM (#47158548)
The Little Learner is a great book. I tried rewriting all the code in Python/JAX while following the Scheme code style as closely as possible, and it worked out great.

The appendix on autodiff is a bit rushed, in my opinion. But in all fairness, the number of pages would probably need to be doubled to give a proper exposition of autodiff.

Best decision I made this year.
It's subsystem maintainers asking Linus to pull from their branches, e.g. https://lkml.org/lkml/2025/7/29/291
Re:OpenAI Audio Models on Thursday March 20, 2025 @04:23PM (#43428448)
May I introduce to you

https://huggingface.co/canopylabs/orpheus-3b-0.1-ft

(no affiliation)

it's English only afaics.

Re:Apple takes UK to court over 'backdoor' order on Wednesday March 05, 2025 @02:50PM (#43271389)
"In 2021: No (IPT) cases were found in favour of the complainant": https://en.wikipedia.org/wiki/Investigatory_Powers_Tribunal#...
you have no freedom of speech to publish opinions opposing (as decided by me) freedom of speech.
Re:IBM is quietly axing jobs, source says on Wednesday September 18, 2024 @08:12PM (#41587044)
Re:A good day to trie-hard: saving compute 1% at a time on Tuesday September 10, 2024 @12:36PM (#41502688)
There is FxHashMap (https://github.com/rust-lang/rustc-hash) which is faster than std::collections::HashMap.

With ~100 static entries, o1hash (https://github.com/rurban/smhasher/blob/master/o1hash.h) should also work.

Re:How to burn US$10M on an ArXiv preprint on Tuesday July 30, 2024 @12:10PM (#41110702)
I am wondering if AlphaStar is the most expensive paper ever.
The VM disk corruption problem has been affecting all open source Apple hvf hypervisors. lima with vfkit or UTM are most promising ones for now: https://github.com/lima-vm/lima/issues/1957#issuecomment-182..., https://github.com/lima-vm/lima/pull/2026, https://github.com/utmapp/UTM/pull/5919
I liked Multipass until I ran into storage corruption issues like many others [1][2] and broke all my VMs. On MacOS, Multipass uses qemu in which the apple-hvf support isn't getting much updates after 2021 [3].

[1]: https://github.com/canonical/multipass/issues/3455 [2]: https://github.com/canonical/multipass/issues/3235 [3]: https://github.com/qemu/qemu/commits/master/accel/hvf

Re:Arena-Based Parsers on Wednesday May 08, 2024 @02:20AM (#40294912)
Somewhat related talk: Modernizing Compiler Design for Carbon Toolchain - CppNow 2023 (https://www.youtube.com/watch?v=ZI198eFghJk)
Re:Every map of China is wrong on Thursday May 02, 2024 @08:51PM (#40242916)
(National) Security theatre https://en.m.wikipedia.org/wiki/Security_theater

Plus everyone who's involved will get richer.

I think it's just a coincidence.

- All the posts are from 2004/2006. - "jiat" can be abbreviation for many common Chinese names.

The backdoor (test binary blob and autoconf) is not part of the pull request.
There is zero web presence for this person and associated email address.

Looks more likely a fake identity than compromised account.

Political theatre? Courts will most likely strike it down for violating the First Amendment.
Really interesting!

Curious, why reimplementing jax in rust (nox)?

Re:Mamba: The Easy Way on Friday February 23, 2024 @03:16PM (#39485555)
I'd love to see someone who has the resources train a model bigger than 2.8b and show the scaling law still holds.
Re:Extreme Video Compression on Tuesday February 20, 2024 @12:17PM (#39443908)
Language Modeling Is Compression: https://arxiv.org/abs/2309.10668
Re:LWM – Open LLM with 1M Tokens Context Window on Friday February 16, 2024 @01:32PM (#39401087)
From https://arxiv.org/pdf/2402.08268.pdf

> We trained our models using TPUv4-1024, which is approximately equivalent to 450 A100s

> Inference for such long sequences requires a minimum of v4-128

So you'll need ~60 A100 for inference.

3) Stephen Cook was denied tenure position at UCB: https://en.m.wikipedia.org/wiki/Stephen_Cook
I've been using Firefox as System Webview for quite some time. I think all you need is setting Firefox as default browser.
Re:Google Cloud Spanner is now half the cost of Amazon DynamoDB on Wednesday October 11, 2023 @05:04PM (#37850242)
> Regarding Google Domains that is a Google product. The equivalent product from Google is “Google Cloud Domains” which is available to Google Cloud customers.

Also sold: https://cloud.google.com/domains/docs/faq

Re:Bank Failures Visualized on Tuesday May 02, 2023 @09:45PM (#35796708)
Thanks. I guess rename 'r' to 'area' will make it easier to read.

Older »