I've believed for a while that Ryzen's aren't (ideal) for gaming and your statement proves that once again.
I mean, they're getting left behind in the dust by, let's face it, a legendary but ancient Xeon. AMD have to do more, like putting all their chips in the gym to work on that single core performance.
I'm guessing that leaving your RAM on auto will make it work no matter the scenario. However, I don't know if manually adjusting the timings will have a similar effect. It's worth a try though.
Have you ran the CPU mark test? I'd be curious to know how your chip performs at 4.5GHz. My overall score at 4.5GHz was 10404, while the single threaded score was 1947. That's an improvement of 33% (multi) and 37% (single). A massive jump over stock speeds. I'm not sure how RAM affects the scores, but I know that it definitely does make a little difference in Cinebench R15.