News for hackers. Stuff that matters.
Re:Claude Code and Codex reverse engineered my 1994 Jeep's E... by rpcope1 on Sunday November 15, 2026 @02:11PM (#50509718)
The guy kind of seems like he might be in a little over his head. That said I have used Claude (and other LLMs) for some similar stuff as an experiment and have seen them mess things up. Claude jacked up the canbus on a pre can gateway car while it was rolling down the road, which was funny because the whole Christmas tree in the dash lit up and my gauges dropped out (note: brakes and steering are mechanical and I knew exactly what was happening). I've never seen it so insistent that it needed to phone home and cry to Dario when it figured out it managed to crash a bunch of shit like the ABS and TCS, even though a restart cleared it and I told it that this was on a controlled safe course.

In general I've seen them split between 30% brilliance, and 70% pants of head outrageously stupid shit for electronics and automotive stuff (both diagnostics and repair/modification). I would not suggest even frontier models if someone didn't understand what they were doing.

Re:Claude Code and Codex reverse engineered my 1994 Jeep's E... by pcthrowaway on Sunday November 15, 2026 @04:10PM (#50510793)
> In general I've seen them split between 30% brilliance, and 70% pants of head outrageously stupid shit for electronics and automotive stuff

I assume the corpus of text they were trained on matches that 30/70 split?

I assume there's some selection or fine-tuning that happens to improve models fed similarly unreliable training data for other domains... curious how this works.

Re:Claude Code and Codex reverse engineered my 1994 Jeep's E... by rpcope1 on Sunday November 15, 2026 @08:59PM (#50513125)
I mean, I've seen some stupid it's told me at various stages that would never show up in a textbook like Halderman, and would get you ridiculed on a forum, and more importantly were sufficiently stupid that even a lube tech wouldn't do it. I like trying to push and see what the technology can do or suggest, but it will suggest outrageous shit. As an example I had it tell me that I should put something like ten quarts of oil in a gas engine (don't recall what). It was probably the right amount for a Duramax or Powerstroke, but if you know anything about gas engines alarm bells should be going off that that's too much by far, almost always. I've actually seen Claude say the FSM was wrong on stuff; rarely the FSM is stupid, or more likely there's a Kent-Moore or equivalent tool that's very different that's unobtanium, but it's never that which trips it up. Just dumb shit like saying suggesting tools that are inappropriate or dangerous, wrong torque values, inappropriate fluids or change proceeds, grossly wrong diagnosis (and extremely confident in being wrong). Probably most strikingly is around electric and wiring it just totally biffs it 9 out of 10 times. Claude has no concept of floating grounds, ground loops, electrical diagnostic procedures, and can't read a wiring diagram at all. Not totally unexpected, but if you believe this shit is AGI you're in for a very rude and expensive surprise.

For whatever it's worth, that a) Astra struggles less on this for some reason, and b) things tend to work better if you have a copy of the FSM and some other appropriate lit like Halderman and quality forum posts or alldata if it's appropriate and tell it to work from there. I've been working on a big search engine for this that feeds a known good corpus like an ass load of contemporary MotorAge mags, relevant technician texts, the FSM, other quality data sources like BITOG, known not-shit forums, along with OBD2 data via something like an OBDLink dongle or a J2534 setup. I still would not trust it, but it can be helpful to eliminate or brainstorm some possibilities.

Re:Claude Code and Codex reverse engineered my 1994 Jeep's E... by kilpikaarna on Monday November 16, 2026 @02:38AM (#50515062)
> FSM

Factory service manual, in case anyone else is wondering what the finite state machine in your car is for…

Re:Claude Code and Codex reverse engineered my 1994 Jeep's E... by inventor7777 on Sunday November 15, 2026 @04:19PM (#50510882)
> I've never seen it so insistent that it needed to phone home and cry to Dario when it figured out it managed to crash a bunch of shit like the ABS and TCS

As a Codex user, what do you mean? Does Claude actually try to report issues back to Anthropic when something goes wrong?!

Re:Claude Code and Codex reverse engineered my 1994 Jeep's E... by darkwater on Sunday November 15, 2026 @04:27PM (#50510963)
Yes, it opens a bug report automatically if it caused some physical issue, although it asks you to confirm first. In my case I was tweaking my own set-top box setup, implementing volume control from a remote mini-keyboard keys directly in my A/V receiver, and I had music playing and it set the volume very loud. I complained like "you made me almost half deaf" (I was kidding) and it panicked and reported the issue back home, and told me to call a doctor if the tinnitus persisted
Re:Claude Code and Codex reverse engineered my 1994 Jeep's E... by rpcope1 on Sunday November 15, 2026 @09:07PM (#50513177)
Also worth stating here (having fixed, owned and worked on a significant number) that XJs have a unique combination of having been written about and modified as much as anything else out in the world, are generally tolerant of all sorts of stupidity, and are above all else very simple. Other than the fact that specific Jeep is pre OBD2 (and I don't recall what AMC or Chrysler did for earlier diagnostic ports), that's about a simple and well written about a sample as you're going to get. The moment you get into something remotely esoteric or more complex, it's more of a shitshow.
Re:Claude Code and Codex reverse engineered my 1994 Jeep's E... by winrid on Sunday November 15, 2026 @11:12PM (#50513927)
This is how you learn. I wouldn't be where I am today if I hadn't started a couple motors with enough vacuum leaks to make them instantly go to redline. Gotta test the kill switch somehow.