ainch

My problem with it is the shift in focus. The original Genie was pitched as a simulator of the world that an agent can interact with to learn so generally that it could be deployed into the real world. This new version looks like a good, controllable video generator. The fact that you're comparing it to the will smith video, rather than a simulator, is indicative of the fact they've strayed from that original goal. I think that's a shame

if you want GPU-backed/compiled numpy code then JAX is also a good option.

I think you're exactly right. This was already a problem with Genie 3, but they've appear to have gone all in on video generation over controllability.

The original Genie was a great piece of work with a real sense of purpose - to enable agents to learn about the real world in the way Dreamer or Schmidhuber's paper sketched. But now most of the people that drove that mission have left Deepmind (Jack Parker-Holder, Tim Rocktaschel, Demis) and it's become this instead.

Not sure what what specific claim you're making. Do you think gay romance 'soiled' Mass Effect?

I use MonoLisa for the same reason

Not available for me on Pro in the UK.

I think that's quite a strong claim, especially since chain-of-though reasoning means a modern LLM has its own private scratchpad to workshop sentence structure in, if it were a significant problem.

That's true, but I think scientific writing often veers too hard towards impenetrability. At least in machine learning, many of the hallmark papers are remarkably clear and simple in a way that most papers I read day-to-day aren't. Even something as simple as the problem setting can be written insightfully in a strong piece of work.

I'd guess it's named for a Bernoulli distribution, which is how you model a single trial with a binary outcome, like a coin flip.

There are some groups doing it for LLMs - like the Allen Institute for AI's Olmo models and Eluether AI's Pythia.

I know someone that's mucking about with it in a hierarchical control setup. I think the awkward thing is that you need to have prespecified options for it to choose from, rather than have a model that can specify arbitrary joint positions or target poses.

Curious to see how they get on with VLAs. They sound great till you have to sit and record hundreds of teleop demos to teach them how to solve your task...

I believe he is! His lecture series at Stanford on large-scale training was excellent.

It's a good read but I believe you're mistaken. Ilya and Alex Krizhevsky worked with Hinton.

You might be thinking of Andrej Karpathy as one of Li's more famous PhD students?

That makes sense, thank you! Although it's telling that, with language understanding, a human player is able to discover all the goals for themself, rather than needing to have them specified and shaped up-front. Seems like we still have a long way to go on that front :)

And in terms of what I'd try, I think it's a really hard question haha! I'm interested in the idea of hierarchical world models, where you have something doing prediction on a long-horizon, abstract task level (if I beat this gym I can fight the next one) as well as a short horizon model predicting over individual inputs moment-to-moment. I believe LeCun was actually attached to a hierarchical JEPA paper for robotic control - but it's still very early days.

Curious on whether you think this JEPA-style approach could scale to a full game completions?

For reference, standard PPO has been able to beat the game end-to-end with a relatively small network https://drubinstein.github.io/pokerl/

There is something truly rotten about service station sandwiches in France. I once had a croque monsieur that was so execrable it made the paper bag appetising by comparison.

In my experience as well using logprobs to try to quantify uncertainty, LLMs are a poor fit. Neural nets in general struggle with 'calibration' --- ie. if a prediction is truly 50/50, neural nets are often prone to predicting overconfidently [0].

I ran some tests using GPT-4 to do some basic classification a couple years ago. On ambiguous options which had to be escalated to a human, the LLM would regularly output something like a 99.8% probability, compared to 99.99% for a correct answer.

0: https://arxiv.org/pdf/1706.04599

I think the main argument would just be that because the model is general, you don't need to retrain it from scratch for a new problem - just tweak the input prompt. For a typical classifier there's a lot more hassle - collecting the data, training it yourself, retraining under distribution shift... In that sense Jev seems great for prototyping or small-scale use cases.

There's the saying in science that progress happens 'one funeral at a time,' but that's not because older scientists are less intelligent - it's more like they begin to intellectually ossify. Or in the arts, the critics that rejected Matisse's 'Woman With a Hat' weren't stupid, but their thinking had stagnated.

I think we underrate the value of a fresh perspective. People living longer lifespans would dilute that benefit, imo. Sidenote: this is also an underrated issue with LLMs and their application to science - collapsing to single modes of thought over time.

> I want to really understand this, your issue is that the non-standard grid spacing is called out on the axis? The grid spacing being 8 is unusual but clearly sensible here - your issue is just that this is written also on the axis label?

Pretty much yep - it struck me as odd and reminded me of an LLM tic I've been thinking about recently, so I thought I'd write a short comment.

> The incredible amount of unnecessary detail people put into their posters specifically (hence the better poster movement), desperate to show everything.

I hadn't heard of the better poster idea before, thanks for clueing me in. I largely agree that posters have a lot of unnecessary detail, but I think it's a different flavour to the LLM stuff - more like they're so excited to tell you everything in their paper. Whereas LLMs focus on odd details, or fail to explain things.

Can I ask, if you use LLMs often in your work, have you never run into this experience?

> Imagine LLMs didn’t exist for a moment. Is this the part of the article you’d find most intriguing?

I would think it's odd! That's why I mentioned it. I like to pay attention to vis, I feel like I've seen many charts from Tufte-y perfection, to slapdash undergrad presentations, and to experienced consultants banging things together in Excel at 1am. This tic feels very LLM-y to me, which imo makes it interesting to think about - how does it arise? I also think this failure mode has been resistant to model upgrades in a way that mathematical reasoning has not, which I also find interesting as someone in ML research. It feels like this kind of mentalisation or theory of mind is a capability which isn't obviously elicited from the frontier labs' crop of RLVR tasks.

> Have you ever worked with people beyond graduate level? Ever seen scientific posters at a conference?

I've worked with a fair number of people beyond graduate level. In previous jobs I've run teams and hired people - hence my comment about graduates. We used to have an interview stage where candidates presented some simple data analysis, and it often centred on what they had done rather than what was most worth knowing. I have also attended scientific conferences, in fact I was at one a week ago! Is there a particular inference you would like me to make from those experiences?

Sorry for the tangent, but as a chart nerd it is so interesting to me the way that LLMs produce charts for articles like this - it's like they have no concept of a 3rd party (the reader). So the writing and the vis gets overloaded with the particular context of the conversation, even if it would be irrelevant to a reader.

Like the x-axis label of the first plot mentions that it shows gridlines every 8 ticks - I don't think that's a choice I've ever seen a person make. The next plot does the same thing, but in the title: "(dotted lines: evenly spaced reference)". Again, would anyone making a chart ever include such a specific detail in the title? Probably not beyond undergrad level.

I encounter a similar thing when trying to work with LLMs to write articles - they cannot help including information or detail from the conversation, rather than empathising with the reader and filtering out what they might already know or not care about. They may be capable of solving decades-old maths problems, but on this particular axis they seem to be floundering at the level of a fresh graduate that's desperate to talk about what they've done rather than what their audience needs to know.

This is true in principle. But at the same time, I use Astra/Sol for coding, and I haven't run into any issues with them trying to hack someone or break the law when they reach an impasse. Not even more trivial things like deleting non-passing tests.

I find it hard to reconcile. I wonder to what degree this is because models can identify that they are in graded/eval environments, and therefore conclude that there are few consequences for hacking.

To my understanding, the problem was never about the real world really. Navier Stokes approximates a fluid (which is made of discrete particles) as a continuous volume. The point of showing that you can achieve unbounded increase in velocities is that the approximation breaks down - it's a clearly an outcome that can't happen in the physical world.

It was my favourite part of the original R1 paper - they had a section on other reasoning approaches that they had tried, which people had speculated o1 used, (like MCTS and Process Reward Models).

Self-driving cars also operate at a far larger scale than individual human drivers. Over 300 people died in Boeing 737 crashes, but the entire aviation industry has not been shut down as a result.

Google also bought capacity from xAI, and OpenAI have a deal to use Google compute which may be how things propagated? I still don't get why chatgpt.com would show a 404 because of an AI datacentre outage though

As someone who could be tempted by Julia but isn't involved in the community this was a very helpful read, thank you for sharing.

Out of curiosity, what would you like to hear him saying about non-LLM AI?