I wonder...
Wouldn't it be a better idea to inverse the roles?
The driver driving, and the autopilot watching out for danger?
At least to start with?
I've averted quite a few accidents because the person next to me also had their eyes on the road and spotted something before I did (like "YOU'RE ON THE WRONG SIDE OF THE ROAD!").