I have both PS5 and Series X, they both have their appeal. I think it all boils down to if there are games on PS that you want to play, and if there are any titles you'd miss by not having a Series X?
I've always bought the cross-platform games on Series X, but I can see that changing in the future. I think Xbox is clearly now out of the race with innovation and power, unless they have something up their sleeves, which is doubtful as we would have heard something, so that creates no competition on consoles until MS release the next gen, perhaps at the very earliest, 2026? Who knows.
I don't have any plans to sell my Series X though, as there are titles that still interests me.