Not really, the machine is fairly well-balanced around the RX580.
For the most part you want parts which suit each other, higher end CPU's or RAM generally only provide a notable uplift in performance when not under any bottleneck. It's not worth making any changes without upgrading the GPU, which you've already mentioned.