Okay just did some extensive testing and it's the PSU, I think, I'm not 100% sure but I don't think it's the GPU.
I held the GPU fan down and the sound didn't stop, so I put a cable tie on the PSU fan and the noise didn't really stop either, so I shut the computer off to wait for the fans, and the PSU one died in synergy with the noise.
I even removed a fan I had on top to put some mesh in the case cuz it was really driving me up the wall, the noise is really annoying after a while.
Anyway, I'm not really sure what else I can do to make sure it's the PSU or what else it could be