Seems AVX Offset was broken on some Gigabyte boards after a Windows update or something, and it's never been fixed(?). Pity as it's pretty useful for maintaining higher frequencies during non-AVX operations. But if it lowers it all the time then no good. I used a board from a different brand with a 9700K and AVX Offset was working fine though to be fair I only had it 24 hours to play with.
An alternative (bit more involved) to look into is setting a Power Limit (and Current Limit if board also allows). That acts like an AVX Offset once you establish the power and current normal stuff uses (Intel Xtreme Tuning Utility is useful to monitor that), and set the limit very slightly over that. So for example you'd have XTU open while Cinebench R20 is running, spot the max power and current usage, and then set something slightly higher in the BIOS. Then, when you use Prime etc, you should see the frequency drop slightly once it hits those power and current limits so that it doesn't crash or get too hot. I used it to good effect on an old Z87 board which didn't have AVX Offset and it worked a treat. Boards may differ.