atty

Google is selling TPUs to enterprise clients for on prem deployments. We’ve evaluated them but decided to stick with Nvidia, at least for one more generation. We’re a relatively large user of GCP.

Considering that there is pretty reliable evidence that Waymo is safer than the average human driver, that seems like a simply false characterization of the Waymo driver.

I’ve never ridden in one but if I get the chance I definitely will.

It felt weird reading it because every once in awhile there were some well written sentences and coherent paragraphs, then it fell back into Claudisms.

If they had had individual keys with screens instead of the Touch Bar I think everyone would have been happy. Have it default to a normal function row but give people the option to customize, let apps customize it behind a modifier key, etc.

Work for a manufacturing company, and we spend a lot of time creating surrogate models for physical simulations. Huge speed ups, 100-1000x possible. You end up still using the “real” simulation for validation, but you can run orders of magnitude more simulations for early design and refinement first.

Sure, sometimes people get social engineered into taking money from their bank account and giving it to criminals. Should banks stop allowing withdrawals?

And physics

Factuality is orthogonal to political leaning generally. People can use the same set of facts and come to very different conclusions. That’s a separate issue from “are these facts correct” and what happens when an individual or entire party starts getting most of their news from highly partisan and unreliable sources.

In most cases it seems (at least to me and colleagues) to be turning out that picking best intelligence is a better option than picking better intelligence / dollar, assuming you can afford the cost. At least on interesting problems. If you’re doing generic web dev work, probably not the case.

The federal government and the executive branch has a well specified set of responsibilities to the people of this country, and they are massively failing at just about every metric. So yes, they are truly incompetent.

> as long as the tests pass

To be pedantic, tests prove that the code passes the test suite, nothing else. They do not prove by themselves that the code is correct, secure, maintainable, efficient, etc. Those are much harder to measure and have a ton to do with organization, architecture, culture, shared knowledge of the maintainers, etc. All of which is lacking during and after this rewrite.

I do not work in the space at all, but it seems like Cloudflare has been having more network disruptions lately than they used to. To anyone who deals with this sort of thing, is that just recency bias?

I think both your statement and their statement are too strong. There is no reason to think LLMs can do everything a human can do, which seems to be your implication. On the other hand, the technology is still improving, so maybe it’ll get there.

Never ascribe to malice what can be sufficiently explained by incompetence. And i think it’s fair to say the best and brightest at Google aren’t turning their attention to YouTube lately. Except maybe to make training datasets for Gemini N+1 :)

The unspoken assertion that Rust and Python are interchangeable is pretty wild and needs significant defense, I think. I know a lot of scientists who would see their first borrow checker error and immediately move back to Python/C++/Matlab/Fortran/Julia and never consider rust again.

To be fair, triton is in active use, and this should be even more ergonomic for Python users than triton. I dont think it’s a sure thing, but I wouldn’t say it has zero chance either.

Which ICE are you referring to? This is an EU law.

It would be quite strange indeed for Mira Murati to have a say over their technical decisions, considering she does not work for OpenAI :)

The idea that a GPU is dedicated to a single inference task is just generally incorrect. Inputs are batched, and it’s not a single GPU handling a single request, it’s a handful of GPUs in various parallelism schemes processing a batch of requests at once. There’s a latency vs throughput trade off that operators make. The larger that batch size the greater the latency, but it improves overall cluster throughput.

I think they’re referring to hardware like TPUs and other ASICs. Which also exist, of course :)

I work on a team that has actually deployed NN based surrogate models into production in industry. We don’t use PINNs for the simple reason that many industrial scale solvers are solving significantly more complex systems than a single global PDE (at least in CFD, perhaps other areas are simpler). For instance, close to the boundaries, the solver our engineers use uses an approximation that does not satisfy conservation of mass and momentum. So when we try to use physical constraints, our accuracy goes down. Even in the cases where we could technically use PINNs we find they are underwhelming, and spending time on crafting better training data sets has always been a better option for us.

I do the same thing, and I keep doing it regardless of how many times I see it working properly.

That is what Intel 18A is, no? In some ways it’s worse than N2, and in some ways it’s better. Overall seems comparable to me, and apparently it’s still on track for next year.

Generally the game is created by external forces, not the players. If you’re an independently wealthy individual you can afford to work for pleasure. The rest of us? We like to eat and live in comfortable dwellings and take care of our families, so we play the game of pleasing our superiors in return for the money to live a comfortable existence.

Jax is, as far as an outsider can tell, Google research/DeepMind’s primary computation library now, not Tensorflow. So it’s safer than most Google projects, unless you think they’re secretly developing their third tensor computation library in 10 years (I suppose if anyone was going to do it, it would be Google).

Perhaps these groups could be regulated and insured by an even larger entity, perhaps even one with the authority to punish individuals and organizations for wrongdoing?

Rather cynical comments so far. I personally am very interested to see how this line of chips does, both in terms of performance (really efficiency, for this sort of chip), and market performance. Hopefully things like Lunar Lake, Arrow Lake, etc, and their 18a node all turn out to be as good as some of the early leaks and press releases make them would indicate, because Intel needs some big wins to get back on track.

It’s very reasonable to want Google and Bing to index your page for search, but not have your data collected for training models, i think. I’m not familiar with robots.txt to know if it has a whitelisting mechanism

Apples memory is on package, not on die.

Insanely fast whisper is mainly taking advantage of a GPU’s parallelization capabilities by increasing the batch size from 1 to N. I doubt it would meaningfully improve CPU performance unless you’re finding that running whisper sequentially is leaving a lot of your CPU cores idle/underutilized. It may be more complicated if you have a matrix co-processor available, I’m really not sure.