I feel like driver monitoring can keep it safe, and should even be available without autopilot enabled.

Comma.ai makes the monitoring more strict when the system is less certain or when in denser traffic.