I don't think you need to be a prominent figure to be worried about being targeted specifically. If you date someone in infosec and then break up with them they could easily become a stalker who searches haveibeenpwned for your accounts and starts whittling away at your passwords...