It didn't make any difference on my 3G either, but i HAVE to turn it off when im not using it on my 4 because it destroys the battery life otherwise.
Odd, it doesn't affect me at all. My battery level stays within 1-2% of what it was after leaving it on standby overnight for ~8 hours, and that's with WiFi left enabled and connected.