I find sometimes that if I move my devices onto my front USB ports from the back (or vice versa) I have to re-install the device. In device manager I have two USB controllers, one for each physical USB header on my board. If I switch my mouse, camera or pen drive between them, it makes no difference. However, if I move my keyboard, webcam or graphics tablet between them I have to re-install the driver. With my iPod, I had to install my driver twice (once for each controller).
It stands to reason that drivers that come with Windows (ones that you don't have to download or install manually) are automatically installed globally when you plug in the device, so if you move it around you don't need to install it again. This doesn't apply to my keyboard as it is a wireless keyboard/mouse combo (I don't use the mouse) with an in-built media player remote.
However, any device I had to install manually (driver download or CD) makes me re-install the driver if I move it between controllers. On the same controller I get no issue. This leads me to believe that as long as the device is on the same bus path, it'll stay installed. For example:
Standard Enhanced PCI to USB Host Controller on PCI bus 0, device 11, function 1
USB Root Hub 2 on Standard Enhanced PCI to USB Host Controller
Generic USB Hub on Port #0001 (USB Root Hub 2)
Logitech Webcam on Generic USB Hub
If I move the device around on the back ports, that path doesn't change. If I move the device onto my front ports, it is then on USB Root Hub 1, port #0001.
I may be wrong about this being the reason why it asks for a new driver (the iPod definitely breaks the rule, and my phone needs re-installing every time I change the port at all) but it seems to be that most devices follow this logic.