Yeah, if you've got intakes and exhausts fighting each other you'll see that behaviour.
Or intakes battling each other. I found that using certain fans above a certain rev range, with everything else completely off, the airflow passing over the components countered the cooling.
I get the same effect on the motorcycle sometimes, or even if I have the car window open - Cooling drops above certain speeds.
I have twin 120 StatPress intakes at the case front. The upper one just blows clear into the case above the GPU, as I've removed the top HDD cage.
There's a second stronger StatPress fan pulling the lower intake through the HDD cage and then pushing it in below the GPU, but there's another StatPress intake in front of the PSU as well, which adds to the flow.
Lastly there's a pair of 120s intaking on the side panel, one above and the other below the GPU. The lower one feeds in at 90º to the other lower ones mentioned above.
Exhausts are the usuals one at the back and two up top, pulling up through the H100 rad.
Mostly my temps are pretty good. Everything idles below 28ºC even in this heat, But if I run the two strong StatPress fans too fast, the area below the GPU gets several degrees hotter than the rest of the case. It surprises me a bit, as I'd expected the hotter air to rise and/or be drawn up through the GPU cooler.
I'm still trialling different configurations...