Has it always been like that? Sometimes PSUs and mobos can make noises like that and it's perfectly normal, so if it's all working properly under load I wouldn't worry too much. You may have to have a closer look to see exactly where it's coming from, might help narrow it down. PSUs sometimes keep the fan running after the machine is shut down to cool, could it be that at all?