At the very least though there should be a call centre someone can ring who has the power to reach the driver, in the end amazon handled it ok, but other couriers they are more aggressively preventing intervention on the day. I have even had DPD claim they have no way to get hold of the driver implying a refusal to intervene on the day and instead the stupid "we try again tomorrow".
You'd still be in a similar situation with people in a call centre ringing the driver asking when are you going to delivery 123 Baker Street. But in reality (A) Amazon won't pay for the kind of customer service and (B) It would slow the deliveries down.
I used to occasionally get rung by my manager at Royal Mail asking when I'd be delivering a parcel as the customer had rung the office asking as they had to go out, or that it wasn't exactly delivered on the dot when the time said (even though it's an
estimated hour or two delivery slot, some still expected it at the start of that time slot). You multiple that by potentially hundreds of times per day, it would cost more in both time and money, thus never going to happen in the real world.
I can see the frustration from a customer side, but also why it's not feasible from delivery side as it would be abused and costly to intervene.