It's not going to be the highs that suffer the most, but the lows. Or more to the point, the areas where the CPU bottleneck shows up. You mentioned earlier in this thread that you were getting 45 FPS minimums at 1440p but at the same resolution my lows were more like 55 with the same settings. I have a 5900X, DDR4 3600 CL16 RAM and a 3080 FE. With a decent CPU your minimums would rise by 20% - 25% or more (game dependent). Obviously we don't know what area of the map each of us uses but in general the lows are reasonably indicative.
This might not matter now in this game, but will it when a game comes out where a 3080 gets 45 FPS minimums when paired with a decent CPU and RAM? In the same scenario your unbalanced PC would be getting 35 FPS or less, unless you compromise on the IQ or graphical settings.
The key is having a well balanced gaming PC where no single key component (or components) is holding the entire system back. Don't get me wrong, if you are happy then fair enough. This is just a heads up that the numbers you posted are similar to what a 2080Ti is capable off according to reviews.