News for hackers. Stuff that matters.
Re:Ubuntu 24.04 LTS will enable frame pointers by default by brancz on Wednesday December 13, 2023 @11:30AM (#38629746)
Frame pointers are such a destructive micro-optimization to omit by default, I am beyond excited about this collaboration with the folks at Canonical to make Ubuntu debuggable by default!
Re:Ubuntu 24.04 LTS will enable frame pointers by default by duskwuff on Wednesday December 13, 2023 @12:44PM (#38631117)
This option was almost certainly a holdover from the bad old 32-bit x86 days, when disabling frame pointers gave you a seventh valuable general-purpose register. It's no longer beneficial on x86_64 -- even with rbp locked down, you still have fourteen registers there.
Re:Ubuntu 24.04 LTS will enable frame pointers by default by jandrese on Wednesday December 13, 2023 @02:09PM (#38632587)
Yeah, back in the 32 bit days -fomit-frame-pointer was the only optimization you could count on to really make a difference. It wasn't small either, often 10-15% speedup. No other flag on gcc would make even a full percentage difference in my testing.

The Amd64 architecture fixed the underlying problem, so this is pretty much just a holdover. I'm surprised they even enabled it by default.

Re:Ubuntu 24.04 LTS will enable frame pointers by default by grrandalf on Thursday December 14, 2023 @11:04AM (#38642817)
(iirc) I think I used `-fomit-frame-pointer` with DJGPP on DOS on a 486. It was an [unimpressive :)] software-rendered 3D graphics demo, and I was very happy with the substantial free speedup I got.
Re:Ubuntu 24.04 LTS will enable frame pointers by default by cesarb on Wednesday December 13, 2023 @02:25PM (#38632848)
To emphasize this point: on 64-bit x86 with frame pointers, you have twice as many registers as on 32-bit x86 without frame pointers, and these registers are twice as wide. A 64-bit value (more common than you'd expect even when pointers are 32 bits) takes two registers on 32-bit x86, but only a single register on 64-bit x86.
Re:Ubuntu 24.04 LTS will enable frame pointers by default by jamesfinlayson on Thursday December 14, 2023 @02:54AM (#38638900)
So there's no point in disabling frame pointers for 32-bit code running on a 64-bit processor then?
Re:Ubuntu 24.04 LTS will enable frame pointers by default by bodyfour on Wednesday December 13, 2023 @03:01PM (#38633407)
That much is true -- the difference between 6 and 7 registers is much larger than the benefit of going from 14 to 15.

However, even under zero register pressure having a frame pointer is still an extra register that needs to be touched on every function invocation, extra instructions taking space in the I-cache, etc. It's a small thing, but it's still a cost that has to be paid by all compiled code.

I'm not going to claim that re-enabling frame pointers was the wrong choice -- the people involved in the debate know the tradeoffs and I have to start with the assumption that I would have made the same decision if I were in their position. It does make me slightly sad, though. The idea behind removing frame pointers isn't that backtraces aren't important, it's that computing the frame pointer after-the-fact is possible -- i.e. for normal functions without alloca() or dynamically-sized stack arrays map %rip -> frame size.

The problem seems to be that despite years of experience with "no-frame-pointer" being the default I guess the profiling tools never got as reliable or good as the with-frame-pointer variants. My personal hope was that the problem would fade over time as tools improved, but it seems that's unlikely to ever happen. After all, once no-frame-pointer stops being the default there won't be any pressure for tools to improve. The towel has been thrown in.

Re:Ubuntu 24.04 LTS will enable frame pointers by default by brancz on Wednesday December 13, 2023 @03:06PM (#38633457)
Profiling tools have already solved the ability to reliably unwind in the absence of frame pointers[1], but there are plenty of tools that this kind of investment is simply too much that it won't ever happen, like bpftrace or bcc-tools.

[1] https://www.polarsignals.com/blog/posts/2022/11/29/dwarf-bas...

Re:Ubuntu 24.04 LTS will enable frame pointers by default by account42 on Thursday December 14, 2023 @07:00AM (#38640440)
Do those tools really need to implement their own unwinding though? This really should just need to be implemented once in a library and then used wherever unwinding is needed.
Re:Ubuntu 24.04 LTS will enable frame pointers by default by brancz on Thursday December 14, 2023 @09:59AM (#38642041)
With the combination of eBPF and DWARF-based it's not quite that simple, there's a pretty elaborate dance between user-space and kernel-space that needs to happen for this to work. With frame-pointers it's walking a linked list in kernel-space.
Re:Ubuntu 24.04 LTS will enable frame pointers by default by rightbyte on Wednesday December 13, 2023 @04:26PM (#38634350)
Ye. Bytecode interpreters very much benefit from the extra register. And any function that looks similar to one.

I mean e.g. getter and setter functions get alot of extra code to run.

Re:Ubuntu 24.04 LTS will enable frame pointers by default by account42 on Thursday December 14, 2023 @07:03AM (#38640461)
Note that even without -fomit-frame-pointer, the compiler can still omit the frame pointer for in some cases. From the GCC documentation:

> Note that -fno-omit-frame-pointer doesn’t guarantee the frame pointer is used in all functions. Several targets always omit the frame pointer in leaf functions.

Fully inlined functions also won't have a seperate stack frame at all. I imaging that is is a big part why the perf impact of turning the frame pointer back on is as small as it is.

It however also means that a complete stack trace will still require using debugging information, in which case you don't really need a frame pointer at all.

Re:Ubuntu 24.04 LTS will enable frame pointers by default by brancz on Wednesday December 13, 2023 @12:57PM (#38631328)
100% the way I see it! On 32-bit the performance benefits is very major on just about everything, but not so on 64-bit.
Re:Ubuntu 24.04 LTS will enable frame pointers by default by PaulDavisThe1st on Wednesday December 13, 2023 @02:01PM (#38632469)
and 14 registers should be enough for everyone!
Re:Ubuntu 24.04 LTS will enable frame pointers by default by mratsim on Wednesday December 13, 2023 @04:49PM (#38634637)
It's not. 14 is still low compared to other ISAs.
Re:Ubuntu 24.04 LTS will enable frame pointers by default by peterfirefly on Wednesday December 13, 2023 @05:11PM (#38634909)
Spilling to an XMM register instead of memory is an option.
Re:Ubuntu 24.04 LTS will enable frame pointers by default by kmeisthax on Wednesday December 13, 2023 @04:47PM (#38634613)
Also, apparently Intel is planning to extend x86_64 to 32 GPRs, with an extension called... sigh[0]... Intel APX[1]. So the overhead of frame pointers will be even lower in the future.

[0] Intel APX is extremely confusable with the iAPX 432, a failed non-x86 architecture Intel made that's completely unrelated to doubling the size of the x64 register file.

[1] https://www.intel.com/content/www/us/en/developer/articles/t...

Re:Ubuntu 24.04 LTS will enable frame pointers by default by p1mrx on Wednesday December 13, 2023 @05:52PM (#38635350)
iAPX has been dead for almost 40 years; there probably won't be much confusion.
Re:Ubuntu 24.04 LTS will enable frame pointers by default by hulitu on Thursday December 14, 2023 @03:22PM (#38646729)
It's not dead. It's sleeping.
Re:Ubuntu 24.04 LTS will enable frame pointers by default by p1mrx on Thursday December 14, 2023 @06:28PM (#38648893)
Intel processors prior to the 80386SL cannot sleep.
Re:Ubuntu 24.04 LTS will enable frame pointers by default by karmakaze on Wednesday December 13, 2023 @04:13PM (#38634205)
> Ubuntu leaps forward with frame pointers by default

Yeah it's more like "...will stop omitting frame pointers by default".

Re:Ubuntu 24.04 LTS will enable frame pointers by default by amelius on Wednesday December 13, 2023 @04:21PM (#38634296)
> to make Ubuntu debuggable by default!

How's that, you'd still need the debug symbols

Also has anyone else noticed that running stuff through Valgrind is really only possible if the program was made with Valgrind in mind? For example, Python and its many extensions generate numerous errors and warnings, so many that any real problem becomes hidden.

I'd say that modern Linux systems are very far from being debuggable.

Re:Ubuntu 24.04 LTS will enable frame pointers by default by brancz on Wednesday December 13, 2023 @04:32PM (#38634438)
Ubuntu hosts a debuginfod server that you can automatically discover debuginfo from any binary from using the binary’s build id.

https://sourceware.org/elfutils/Debuginfod.html

Re:Ubuntu 24.04 LTS will enable frame pointers by default by rightbyte on Wednesday December 13, 2023 @04:32PM (#38634429)
You offent need to make excemption file.

My tip is to run some thing one program execution, and then run it twice during the same program execution, and diff the reports.

Re:Ubuntu 24.04 LTS will enable frame pointers by default by account42 on Thursday December 14, 2023 @07:14AM (#38640537)
It's a "micro" optimization that can be automatically applied everywhere. And its not destructive because debug info contains all you need to calculate the frame pointers after the fact. Really a no-brainer to have it on unless you are dealing with broken tools.
Re:Ubuntu 24.04 LTS will enable frame pointers by default by brancz on Thursday December 14, 2023 @10:01AM (#38642075)
We've "fixed"[1] all the tooling that we work on at Polar Signals, and even then I think this is the right thing to do. It enables so much more debuggability aside from profiling.

[1] https://www.polarsignals.com/blog/posts/2022/11/29/dwarf-bas...