News for hackers. Stuff that matters.
Re:We stopped roadmap work for a week and fixed 189 bugs by OhMeadhbh on Sunday November 23, 2025 @11:31PM (#46030404)
At Amazon we had a bug that was the result of a compiler bug and the behaviour of intel cores being mis-documented. It was intermittent and related to one core occasionally being allowed to access stale data in the cache. We debugged it with a logic analyzer, the commented nginx source and a copy of the C++ 11 spec.

It took longer than 2 days to fix.

Re:We stopped roadmap work for a week and fixed 189 bugs by auguzanellato on Monday November 24, 2025 @12:33AM (#46030690)
What kind of LA did you use to de bug an Intel core?
Re:We stopped roadmap work for a week and fixed 189 bugs by OhMeadhbh on Monday November 24, 2025 @01:41AM (#46031050)
The hardware team had some semi-custom thing from intel that spat out (no surprise) gigabytes of trace data per second. I remember much of the pain was in constructing a lab where we could drive a test system at reasonable loads to get the buggy behavior to emerge. It was intermittent so it took use a couple weeks to come up with theories, another couple days for testing and a week of analysis before we came up triggers that allowed us to capture the data that showed the bug. it was a bit of a production.
Re:We stopped roadmap work for a week and fixed 189 bugs by ChrisMarshallNY on Monday November 24, 2025 @12:37AM (#46030711)
I’m old enough to have used ICEs to trace program execution.

They were damn cool. I seriously doubt that something like that, exists outside of a TSMC or Intel lab, these days.

Re:We stopped roadmap work for a week and fixed 189 bugs by plq on Monday November 24, 2025 @12:59AM (#46030808)
ICE meaning in-circuit emulator in this instance, I assume?
Re:We stopped roadmap work for a week and fixed 189 bugs by ChrisMarshallNY on Monday November 24, 2025 @05:01AM (#46032286)
Yeah. Guess it’s kind of a loaded acronym, these days.
Re:We stopped roadmap work for a week and fixed 189 bugs by Windchaser on Monday November 24, 2025 @10:59AM (#46035486)
/imagining using an internal combustion engine here
Re:We stopped roadmap work for a week and fixed 189 bugs by OhMeadhbh on Tuesday November 25, 2025 @12:55AM (#46042741)
"Rejecting this pull request because the patch you submitted does not provide enough torque."
Re:We stopped roadmap work for a week and fixed 189 bugs by buildbot on Monday November 24, 2025 @05:26PM (#46040132)
They float around on ebay! Software might be an issue.
Re:We stopped roadmap work for a week and fixed 189 bugs by amoss on Monday November 24, 2025 @02:10AM (#46031198)
When you work on compilers, all bugs are compiler bugs.

(apart from the ones in the firmware, and the hardware glitches...)