Exactly same issues (same freezing for over 10 seconds now and then) I had in Borderlands 3 on 2070S (8GB vRAM) - after about 20 minutes of playing. It started fine, then the longer I played the worse it got. No such issues on 6800 as much more vRAM to play around. And BL3 doesn't have DLSS nor RT and I played it in 1440p to that - still caused issues.
Problem with people testing vRAM use in games is that they load a map, look around for a minute and say "Not a problem, works great, 8GB still enough!". But it often happens after a bit longer session of at least said 20 minutes, when game loads more assets and textures and starts chocking. I had FPS drops in few other games but freezes only in BL3, on that 8GB card.
That said, textures are the easiest and one of the best options to increase fidelity in game - it doesn't lower FPS as long as one has enough vRAM, hence can be increased in new games even on older cards, unlike RT or similar. However, with just 8GB vRAM it'll be the opposite soon enough - one will have to lower them to keep up proper FPS. :/