I suspect you are underestimating how good these systems have gotten. Did you watch the video I posted above from China?When I said erratic implementation of roads I'm generalising in terms of layout but also how people park, agricultural traffic and so on - some of the villages around here if it is remotely busy you have to do a lot of planning ahead / behind to make use of passing spaces and so on which even with advanced AI would need a ton of computing power to get close to AI coping with let alone coping with safely. Most of the example videos are just 1 or 2 cars in a limited choke point rather than dealing with multiple vehicles of different types with mixed obstacles over the length of a small village, etc.
Sure you can intervene and/or take control through the worst bits if driving but another story for things like driverless taxis, etc.
Granted it’s an hour long but some of the situations the cars handled without issue were extremely challenging.
Cyclists everywhere going the right way, wrong way and every way, pedestrians everywhere doing the same, parked cars everywhere, cars pulling over and over obstacles. There were areas where there was hordes of scooters traveling the wrong way down a one way street.
All handled just fine.

