Ouch ! I have a similar setup except for a RTX 3090 - doesn't sound like that will help much, however. I can't wait for VR to become a mature technology ; in the meantime I guess I'll persevere with ultrawide/multiple monitors.
Depends on your tolerance to motion sickness... you could have an absolute blast with a 3090, and given the CPU limitations you could probably run it at very decent resolution given you can’t aim for over 45fps anyway.
If you were planning on picking up a VR headset anyway then it is well worth giving a go. If not maybe wait 6 months or so and DX12U and the series X version should be out by then, see if things have improved.