I don't know what options you have in gigabyte bios, but try searching for fan smoothing or fan step up and adjust how long a temp has to be before it changes speed.
Failing that, change your cpu fan to react based on the vrm mos temp sensor instead of cpu temp (might need to use a different header).
These may be available in software control if not in bios.
As for voltage, in your bios you can adjust the vcore and soc voltage offsets to negative numbers, try - 0.05 to start, if you crash, try -0.025, if you don't crash, try reducing it more etc.
Pbo is pushing it further, so won't help with temps. It's precision boost options if you want to disable it.
While the cpu doesn't throttle until 95c, it boosts higher at lower temps, even below ambient. So cooler = faster.
Voltage is high at idle because its boosting individual cores "up to" 4.6 and the core its doing that on is always changing hence fluctuations in temp as the heat moves around. But that voltage is only going to that core, not all cores.
My fans go between 0 and 25%, and under sustained rendering up to 35% sometimes! But my temps also never go above 80c on artificial load (4.1 max clock), or more like <=65-70c on real renders/folding etc.
Stock(Pbo etc enabled) gives me 4.2+ but not quite 4.3 on all core loads, so if you're running much higher temps that speed drops off fast above 75.
But that's all because my 3900x and 2070super are cooled by 3x360 rads... Specifically so I get true silent PC
Hopefully something there will help.