If you took humans off the road and made the roads suitable for only automated cars it would be so much easier to automate, its only hard because we have to make it drive with the signals/lines and such that humans require rather than just broadcasting things like the traffic signal in an easy way for cars to understand.