Two options for how a driverless car without human controls might handle these sorts of hand-off scenarios:

1) It hands control to an out-of-car human driver, similar to how military drones and driverless trains are operated now.

2) It turns on the hazard lights and pulls to the side of the road. Another vehicle is dispatched to pick you up.