You’ll need to adjust the fan curves in BIOS. You need to set the fan speed first at a set level, say 35 or 40%, then with a temp monitoring program record what temps the cpu spikes to during normal usage for your use case, e.g watching 4K videos, browsing, coding etc.
If the temps go too high at said fan speed, just increase until noise/temps are acceptable
Once you know what temps you get to at a set fan speed or % you could build the fan curve around that so the fans don’t ramp up until the cpu temp goes above an upper limit.
For example, my 3600x with ambient around 22c and normal desktop use spikes around 40-45c tops in normal use, this was with fan set to 35% iirc.
Therefore my fan curve is set at 35% fan speed from 0c to 55c. Then my next step is say 50% fan speeds to say 70c to account for light gaming, then finally I have the curve ramp up to 100% fan speed for 85c.
This is where you can tweak it to your liking though.
So now under normal use, the fans don’t do that annoying ramp up and down in normal use, with a bit of headroom for either higher ambient, or slightly higher cpu usage temp. Because I know my 35% fan speed can keep normal use temps below 55c.
I also use the same curves for my case fans, but again you can choose your own curves for this using the same method.