You’re only ever talking to the IRS over the phone if you initiate the call. Ideally the phone system gets fixed but that’s likely to not happen any time soon. Now you need to deal with current reality. Nobody should trust that any incoming call, purportedly from a business or government, is from who they say it’s from either verbally or through caller ID.