perfobotto

So difficult to read ..

Maybe OpenAI or Anthropic

It’s very simple. Apple doesn’t pay as well as other places and they stock price increases and their flashiness are not enough anymore to keep people around. It’s time they realize they are not the darling they used to be

No way an offchip HBM has same or better bandwidth then onchip

is this approach viable on training? wat about kernels that require different grids?

What an amazing write up! Thank you very much!

To be clear a cerebras chip is consuming a whole wafer and has only 44 GB of SRAM on it. To fit a 405B model in bf16 precision (excluding kv cache and activation memory usage) you need 19 of these “chips” (and the requirement will grow as the sequence length increases for the kvcache). Looking online it seems on one wafer one can fit between 60 to 80 H100 chips, so it’s equivalent to using >1500 H100 using wafer manufacturing cost as a metric

This is supposed to be a product , not a research artifact.

What stops nvidia from making sure this stops working in future driver releases?

To be honest restricting funding to the kind of symbolic based AI research that is criticized in this discussion might have helped AI more than it hurt , by eventually pivoting the research toward neural networks and backpropagation. I don’t know how much of a good thing would have been if this kind of research continued to be funded fully.

I mean, he was right … for what we knew at that time. He predicted correctly that the only way to achieve a general intelligence it would require to mimic the extremely complex neural networks in our brain that the hardware of the time was very far away from achieving. He could not predict that things would move so fast on the hardware side (nobody could have)that made this somewhat possible. We are atill I would argue a bit out in having the appropriate computer power to make this a reality still, but it now is much more obvious that it is possible if we continue on this path

Snaaaake

Whenever I see a product that advertises itself based on the technology it is built on I’m skeptical. Rust doesn’t make a game engine good.

Am I the only one not understanding what’s the point of all these efforts to try to run Linux on completely closed with no documentation devices (like iPhones and even mace for that matter). Seems like a lot of effort, for a crappy solution that maybe 0.0001% is going to use before realizing it is crap. Even only effort to keep up with the yearly hw updates that apple does and the complete disregard for backward compatibility and writing hw documentation makes these effort just a technocrat exercise (very cool for sure), but I can’t see anything more than that

This seems specifically designed to make the us look bad. If you try to compare us and Libya it almost seems like it would be so much better to move there which is stupid. Statistics are calculated in such a way that is just unfavorable for the us

But your really can’t. GDP per capita doesn’t capture so many parameters and conditions (like being landlocked surrounded by wealthy countries that use you as a de-facto tax haven)

Whenever I read articles like “Nordic country succeeds doing X” I always wonder if that would work on a country that is not 6 million people with tons of natural resources available per capita (Oil, timber, ore). Sadly I generally think not, but I’d be happy to be proved wrong …

Well that’s not how it works. When a company controls a very important piece of something society starts to rely on (oil, information, communication ... etc), regulation is not just preferable . It is NECESSARY.

What are you talking about. A restaurant doesn’t have the power to steer an economy of billions of dollars worldwide (the phone app market) . Apple and google do. Do you understand the risk for countries to allow one single private company to have complete control over the life/jobs of hundreds of thousands of citizens (app developers) that could be just destroyed by the whim of one of these two companies? It’s the price of creating a multi billion dollar business. You have to take responsibilities that go beyond your own revenue as you have worldwide power.

What about Microsoft and Windows then. People complained to death back in the day for anticompetitive behavior (and were right). The iPhone success is not only Apple’s success. Apple has to thank all the devs that supported its platform with their apps (yeah Facebook and google included) and without which the iPhone would be a gimmick. We can’t just ignore this and tell every developer after they get Sherlock ed to “suck it up and create your own platform you loser”.

This idea that having a separate App Store would completely render the ecosystem a Wild West of standards like Linux is something I never understood. If they allow side loading developers will still stick with the App Store and their standard if they want to sell, like it happens on android where devs stick with the play store . If people massively reject the App Store if alternative ways of installing an app become available then maybe it wasn’t that valued of a feature in the first place by the users ...

Amazon’s version of sherlocking

Can it run crysis?

If I was a founder I would certainly try to give to my organization “founder syndrome”. And I’d keep my company private for as much as I could :P

State a problem, provide not even a hint for a solution. Pfff.

I doubt most of the big earners will disclose their salary. It seems to be going in a way where mostly people that are in a less than optimal situation are gonna disclose their salary, so the whole thing is underestimating the situation

It doesn’t really matter who wrote it. It’s a comment about the article , not the author himself and the article is approssimative at best. It makes a statement that’s not true in a lot of cases (“computation is almost free”), makes some statements that while agreeable are too high level in how they are expressed like “cost of communication is high” and then the piece ends without any explanation or examples on what he means exactly or what is wrong and how to solve it in enough details to actually be an informative article. It seems like an oversized rant a programmer would make after a bad day at work on Twitter.

What a bunch of bs. There are so many places where computation is far from free and size matters (embedded, HPC for example). And the end of Moore law is just gonna emphasize the need for performance even more. This article just tells me that the author didn’t have to write any performance critical code in his life and he just extended his experience to everything

Italy in exports is indeed successful

What I always needed!