Yeah, it's not all the time. While VRR is active it's only really noticeable on darker images and literally only when frame pacing is very bad where it occurs. If the frame rate is just dropping between a small window like 70-90 or whatever with even frame pacing you wouldn't really notice it as the gamma differences for those refresh rates wouldn't be as apparent. However if say you're at 120 FPS and suddenly there's a big frame time spike then back to the normal frame times then you might notice the gamma change on a dark image which will look like a kind of flicker. I've played a lot of games and I'd say it's only a bother on a few. There's a few exceptions like Lost Ark and WoW where even in bright scenarios you can notice a bit of flicker when interacting with the UI, they're pretty easy to run though so disabling VRR isn't too much of a bother.
It's something to note if you're really sensitive to flicker though, I'd say I'm a bit sensitive, but I can tolerate it with the OLED, the benefits of the panel are just enough to outweigh it. I had a VA before where I had to straight up disable VRR on it because of too much flickering at lower frame rates, it's at least no where near as bad as that. I think if you really don't want to see VRR flicker at all you're kind of stuck with IPS.
I'm genuinely enquiring with a view of purchasing it.