Indeed. Notoriously, a SEGV in gcc during compilation used to usually mean "your hardware is flaky": https://tldp.org/FAQ/sig11/html/index.html
That was before the invention of fuzzing.
There are still out-of-bounds concerns and chasing through NULL pointers. (Not arguing against gcc's quality or stability, just listing memory safety concerns that transcend memory deallocation)
Have you ever seen GCC crash with a SIGSEGV? I rarely did even when I used to be a GCC developer.