Where immediately is generally measured in seconds (with the exception of perhaps autoland). Normally the autopilot will have the plane trimmed at all times, so the plane will continue flying its current course for some time without control inputs.

Like the op said, split second takeover is not required in a flight autopilot

Yes it is... Especially when the autopilot causes the aircraft to enter a dangerous configuration.