davesque

Couldn't this just be a result of Astra training on massive amounts of circuit theory or mechanistic interpretability literature or other related topics? In other words, not black magic?

What if you've already played that game many other times during your 15 year long career? I mean the "game" of learning the ins and outs of a technical subtopic. And you know you could spend months ramping up on another thing just to see an idea take shape, but you only have limited resources in your life, a full time job, and so forth. And you'd still like to see an idea become a reality regardless of all that. So I guess that's not real work and it's cheating and it doesn't have value?

I mean, if you insist on doing everything by hand, go right ahead. But you won't get as much done and that's simply a fact.

I could write a well crafted reply, with a convincing argument, but why bother? You're just trolling. The whole anti AI coding thing is such a meme. I suppose you'd like to spend all the time it would take to reverse engineer a classic NES game by hand? Go familiarize yourself with 6502 assembly and everything else you'd need to know?

Unfortunately, I'm a bit concerned that cool labor of love hacker projects like this will become much less common now that Anthropic (and possibly soon others) is moving to restrict this kind of usage. Oh well, so much for cool fun stuff.

/r/whatcouldgowrong

Why can't they just say something like, "I really shouldn't have said X Y Z. It was insulting and I'm embarrassed that I chose that way of speaking to an employee. As a leader, it's important that I be encouraging and receptive." In other words, don't vaguely allude to what happened by saying there was "a communication failure." CEOs like to act like their subordinates are children and can't tell the difference.

This guys sounds like a giant prick.

Man I've cried twice today over this. I guess I really thought of Patrick Stewart as almost like a respected family member in my mind. The state of leadership in the world today is pretty bad, so I guess I'll just have to continue rewatching TNG front to back every couple of years to have an example to live by.

I did too! I don't think I've cried over a Hollywood death until now. Maybe Robin Williams but can't remember.

Black stripe would be good for this one I think.

I have a lot of questions about methods here. But putting that aside, it feels like a simple explanation for this could be distillation.

Might never come to fruition? Is there any chance at all that such a car would ever be street legal? Oh, wait the US govt is literally for sale nowadays, so hmm...maybe that's not an obstacle actually.

Because it's creepy and Orwellian, not to mention hypocritical (MAGA is supposed to hate thought policing). Do you like people telling you what words you can and cannot use?

Does any American actually think this way about lobbying?

> If you're not going to do that don't post your results online, just keep it to yourself

...I mean...I just don't really know how to respond to that. Who the heck cares if someone posts this online? If you don't like it, just move on. Sheesh. Lookout everyone, this guy doesn't approve of your side project.

But C isn't as nice to work with. Maybe OP just thought it was fun to see it take shape and wanted to share it. Why do any sort of little side project like this at all? Just seems like everyone is judging this too harshly. If an LLM is reasonably good at this sort of thing, and you think it would be cool to see Quake written in Rust running in the browser, I say just do it and have fun and don't be shy about doing show and tell about it.

I mean...why not do it? Are you implying it would only have value if someone painstakingly did it by hand?

This article's argument in a few sentences:

* Silicon valley gave us DraftKings, Polymarket, and crypto.

* Modern business planning and venture capital firms make "bets" based on the expected value of investments, i.e. probability of success.

* LLMs compute a probability distribution on the next token.

Therefore everything that silicon valley does looks like gambling and shame on them. Sad times seeing stuff like this in the paper of record.

Yes, it would be correct not to pursue a technology that has that chance of wiping out the world. But where are the people who are suggesting these probabilities getting their numbers? I personally can't imagine where, and I'm an engineer with a specific technical interest in LLMs. And I haven't heard one clear description of the methodologies used to calculate these chances.

The much more likely explanation to me is that people are just spitballing, either because they've watched too much sci-fi, or they have some weird counterintuitive agenda (e.g. Anthropic and OpenAI trying to position themselves as the amazing, trustworthy keepers of this dangerous technology before their IPOs).

Yeah I wish we would focus on concrete risks like job displacement and disinformation. The apocalyptic stuff feels either misguided or like some kind of weird, toxic, reverse psychology marketing by OpenAI and Anthropic. I wish we would just move on from it.

And the folks from podcastistan are never clear on the details of how human extinction would happen exactly. It's always something like, "Well, how do humans regard chickens? AI is way smarter therefore it wants to conquer and control us." An ASML lithography machine is also way better at making chips, but we don't consider it a threat.

I'm a bit concerned that a government chatbot like this would include a user-feedback signal like thumbs up/down. I think this could be gamed by bad actors to promote/demote specific types of content in the training data, assuming they use those signals in some sort of post training. Hopefully they're accounting for that.

AI-generated writing does not bother me, unless it is intended as prose writing, where the flow communicates as much as the specific facts that are described. For technical writing, I usually just scan for important information anyway, and in that sense the only thing that bothers me about AI-generated writing is if it's too verbose and obscures the important information by leaning ineffectively on jargon and high-minded verbiage. I find that Claude Opus is very guilty of this, whereas GPT 5.6 variants are not.

Can we please make it so that AI CEOs are smart enough not to optimize everything according to the focus group that is their shareholders? Seems like we could solve the enshittification problem with this if we play our cards right.

Unless humanity can figure out a way to make a binding international agreement to pace development, it doesn't seem practical to expect US frontier labs to do it.

Regarding automatic formalization of proofs using AI, how do we know the formalization doesn't contain errors?

Isn't it also a simple idea that a model designed to recall relevant information from its training data, which is also known to have been trained on data from user transcripts, would, in fact, reproduce directly relevant work by leading experts in the field? Seems like Occam's razor would apply to that situation as well.

We know that LLMs are trained to recall relevant info. We know AI vendors are using user transcripts to train models. Two plus two equals four, right? I mean, an LLM that failed to recall the transcripts of those researchers would be a bad model.

Honestly this whole thing is so fucking weird. I feel like there's an argument that absolutely no one involved in the final crossing of the finish line to the proof actually did any work (other than just intelligently directing an LLM) and deserves any credit. As the author of this doc mentions, the mathematicians who did the actual work that led to the formulation of this approach (without the use of LLMs; just good ole' fashioned human intellect) are the ones who deserve the credit.

Imagine that a no name janitor used their time in the evenings to go spelunking through the literature to push an LLM to this result. No one would care because that person isn't an anointed expert. So why would the expert deserve any more credit? Because they sort of understand the result, even if they couldn't have achieved it on their own? The whole issue of credit for AI-assisted discoveries seems like it's going to run into a brick wall pretty soon.

And then he wanted New Mexico to be New America. Capitulation is not just about what they're asking for now, but also what they'll be emboldened to ask for in the future.

Corruption in the US Census Bureau? No fuckin' way!

The article doesn't address what I think are the main complaints about H-1B: that it is mostly used to cut costs and hire people who have very little freedom to switch jobs. That and all the trickery with ghost jobs meant to only give the appearance of hiring stateside. The example given is also not great. Von Braun was one remarkable foreign expert in a leadership position. On the other hand, in my experience, many H-1B hires tend to occupy low-level jobs; ironically the very ones that the author says will be filled by motivated Americans. I mean...just try working at any American FAANG. The evidence is totally in your face.