#emacs would be my recommendation. It's a pretty great channel for random discussion/chatter, and every now and then people even discuss emacs.
Perhaps #hackernews and #startups on freenode?
Another good starting point is #xkcd. it is a large channel with a lot of tech-ish and math-y people.
EDIT: Note that channel discovery on IRC is largely a word-of-mouth thing so don't be shy to ask people for channel recommendations on irc. Most programming language have a dedicated channel, e.g. #D or #python or whatnot.
Re:IRC turns thirty
by schindlabua on Friday August 24, 2018 @04:14AM
(#17833529)
Are you talking about freenode? I just joined #xkcd and it's 8 people and no topic set. 3 other users joined and immediately left, I guess those were from HN aswell.
(A big channel for everyone to join is ##programming, by the way.)
Nowadays, most of the communication has migrated to Telegram from IRC.
EDIT: If one was to start using IRC, I guess there isn't a channel or a server where most or some of the people using also Hacker News go?