News for hackers. Stuff that matters.

jdeaton

This is really incredible work but so frustrating that its necessary
the only thing I'm asking for is better control over my cigarettes. Let me remove all the carcinogens, addictive substances and dont let me inhale things that are hazardous for my health. And do this by default on all cigarettes!
Re:New Mac Studio with M5 Max and M5 Ultra on Tuesday August 25, 2026 @01:18PM (#49437409)
unfortunately it does not run linux
Re:Attention Wasn't All We Needed on Friday May 23, 2025 @04:24PM (#44076319)
First four things on the list are attention
Its called recursion

> Doesn't for_tree(...) look a lot nicer and simpler and less error prone than needing to implement a recursive function for each operation you would want to do on a tree?

No it does not

Yeah i vote it should be rebranded “why”
0.061 standard deviations? Thats like almost nothing?
Re:Nvidia adds native Python support to CUDA on Friday April 04, 2025 @08:54PM (#43589281)
Pytorch???
Maybe shes wearing those noise canceling headphones because of her auditory processing condition and not the other way around??

This seems like basic speculative attribution error- no research here.

Re:How to Scale Your Model: A Systems View of LLMs on TPUs on Thursday February 06, 2025 @12:28PM (#42964498)
Sounds limited
Re:How to Scale Your Model: A Systems View of LLMs on TPUs on Tuesday February 04, 2025 @08:52PM (#42942498)
yeah it looks exactly like that file but replace "import numpy as np" with "import jax.numpy as np" :)
Re:How to Scale Your Model: A Systems View of LLMs on TPUs on Tuesday February 04, 2025 @08:46PM (#42942429)
Something nice about this guide is that it generally transfers to GPU directly thanks to JAX/XLA.
Re:How to Scale Your Model: A Systems View of LLMs on TPUs on Tuesday February 04, 2025 @08:32PM (#42942295)
if you're using tpu why are you using pytorch
Re:How to Scale Your Model: A Systems View of LLMs on TPUs on Tuesday February 04, 2025 @08:23PM (#42942182)
The interesting thing about this comment is that JAX is actually higher-level even than pytorch generally. Since everything is compiled you just express a logcial program and let the compiler (XLA) worry about the rest.

Are you suggesting that XLA would be where this "lower level" approach would reside since it can do more automatic optimization?

Re:We fine-tuned Llama 405B on AMD GPUs on Tuesday September 24, 2024 @12:47PM (#41638410)
JAX has a sub-system called Pallas[1] with a Triton-like programming model and an example implementation of Flash Attention [2]. It is quite fast. On TPUs I've heard that the XLA compiler already emits a flash-attention-like computation graph for a regular JAX implementation of attention so there's no need to have some specialized kernel in that case.

1. https://jax.readthedocs.io/en/latest/pallas/index.html

2. https://github.com/jax-ml/jax/blob/main/jax/experimental/pal...

Re:Kids who use ChatGPT as a study assistant do worse on tests on Thursday September 05, 2024 @12:22AM (#41453443)
Why is the study specifically of Turkish students
Re:The Art of Finishing on Monday September 02, 2024 @05:12PM (#41428875)
Its not overwhelming clear that finishing is an important piece of a side project. Real work at your job is the place where you can prioritize finishing over other outcomes. By not forcing yourself to finish everything in your side projects you open yourself up to greater levels of exploration and learning which is, after all, the point of side projects to begin with.
Software isnt pie. It isnt even food
Re:Poor Foundations in Geometric Algebra on Monday August 26, 2024 @01:19PM (#41359401)
> very real toxicity within the geometric algebra community. I can’t do much about

I was hoping the article would be about this instead. OP wondering if you have any elaborations for us to hear.

The macos disk images are "broken" according to my os.
Re:Leaving Neovim for Zed on Sunday August 18, 2024 @08:20PM (#41286674)
Helix has been trying to implement a plugins system for like 2 years that should tell you everything you need to know about its future prospects
I dont understand what it means to “move complexity into data”
> people unacquainted with biology have a false perception of how low-throughput biology experimentation is. In many ways, it can be. But the underlying physics of microbiology lends itself very well to experiments that could allow one to collect tens-of-thousands, if not millions, of measurements in a singular experiment. It just needs to be cleverly set up.

I think this passage gets to the fundamental rift of disagreement in perspective between those focused purely on computational advances versus innovating in wet lab techniques.

Why? Because years of peoples' careers have been wasted waiting on promises from molecular biologists claiming they will make these "clever" high-throughput experiments work. In my experience, they'll spend months to years concocting a Rube Goldberg machine of chained molecular biology steps, each of which has (at best) a 90% success rate. You don't have to chain many of these together before your "clever" setup has a ~0% probability of successfully gathering data.

Re:RustPython: A Python Interpreter Written in Rust on Friday August 02, 2024 @09:52PM (#41144130)
does it have a GIL
Re:Applied Machine Learning for Tabular Data on Friday July 26, 2024 @09:47AM (#41078642)
Spoiler: just use xgboost and you’re done
Re:Node.js adds experimental support for TypeScript on Thursday July 25, 2024 @10:54AM (#41069422)
Isn't the whole idea of TS that you just convert to JS to run it
Re:Reflection for C++26 on Monday July 01, 2024 @09:18PM (#40852649)
More ways to make your c++ impossibly unreadable. Cant wait to baffle future maintainers
Re:Apple Intelligence for iPhone, iPad, and Mac on Tuesday June 11, 2024 @02:17AM (#40643065)
Maybe we could just get a decent spam filter on imessage?
Re:More Itertools on Monday May 27, 2024 @03:44PM (#40493934)
ok itertools has chain.from_iterable but that name is hard to remember
Re:More Itertools on Monday May 27, 2024 @03:41PM (#40493900)
it has always annoyed me that flatten isn't already part of itertools

Older »