You're almost right. The thing is that Congress absolutely has the power to impeach the president and strip them of all legal office. Of course, most of Congress is perfectly happy with what's going on, so this won't happen.