It sounds like you've already decided to give the talk. Have you discovered the rationale? Why would your manager us his leverage to influence your career path?

Managers learn through failure like everybody else.