For now separating the Memory Controllers and Cache from the main die is quite a significant thing in its self.
SDRAM does not scale anything like Logic with node shrinks, there is almost no scaling at all, so 1MB of Cache is the same size on 5nm as it is on 7nm.
If you can remove that from the Logic and put it on a cheap older node, because it doesn't matter anyway, then you can bring your costs down and yields up.
This is exactly what AMD Did, the Logic is on 5nm while the Chache is on 6nm, the expensive bit, the logic is only 300mm2^, compared to the 600mm2^ Nvidia die with similar performance which on top of that is also on an even more expensive 4nm, the cache around AMD's 300mm2^ logic die costs pennies.
That's how AMD are able to make a 4090 class card at $600 less retail and still make decent margins.