It's a double contraction, the word “of” doesn't appear at all: who'd've (who would -> who'd, would have -> would've, who'd + would've -> who'd've)