The extra Cache will only make a difference in Floating Point workloads, which is not everything but its quite a lot of things.
It will double the L3 Cache throughput from 1,000GB/s to 2,000GB/s, which by its self would not matter so much because right now its 64MB divided between two CCD's, instructions only execute on one CCD at a time, so in a 32MB Cache, which is why despite the 5900/5950X having 1,000GB/s throughput vs 600GB/s on a 5800X (32BM) there is no performance difference.
The 3D Cache actually triples the L3 available per CCD, its an extra 64MB per CCD, a total of 96MB on each CCD and that's why it will make a significant difference, the branch predictor for each execution has a huge amount more capacity, as does L2 to L3 victimisation.
If anything i think AMD could be sandbagging their performance claims a bit, perhaps not for gaming, or much, but some workloads outside of that could see a huge up tick.
Right now AMD don't need to do anything more to combat Intel, and Zen 4 will be a brand new core, again, and they will have a lot more power to play with as they lose the 142 Watt PGA limits.