I've come to the conclusion that its related to latency as well. It is basically the game checking the assets to make sure you are hacking or cheating or anything. So whenever there is more latency it affects performance more and you get this stuttering. Worse for me now than it was earlier and I have a 250ms ping now whereas earlier it was around 60.
Yeah, I'm 99% convinced it's latency related. Last night after 12 midnight I was able to play pretty much perfect, and this morning was fine to.
Weird...:/