If you think downshifting delays the process of overtaking then you arent thinking and looking ahead enough of what you are doing.
Well it is though. There is always the extra process of downshifting to delay the process. Say I'm in a turbo car and I spot the gap 400m away, I downshift and floor it and overtake. Now consider the same situation in a NA car, I again spot the gap 400m away, floor it and overtake. It is clearly going to take less time in the NA car assuming both cars have identical performance.
I'm always looking ahead and thinking since I do a lot of karting. I've competed at university level and it's one of the first things drummed into you when you start karting.