I have a PS4. I have played on an xb1 but I just fancied something different after having the original Xbox and a 360.
I am not disappointed but I wish the pads were better. I think xbox pads are superior. As for the graphics divide? Well I think it is hardly worth worrying about. The differences will not be noticeable once you are gaming and if they are, no doubt you are trying to find them instead of enjoying your game.
Neither of the current gen consoles are as good as my gaming PC and my gaming PC is not as good as as my friends gaming PC. Does it make gaming less fun because of it? No.
If you are going to let minor differences in performance sour your entire outlook on a particular console, I think you have bigger problems than which console is best
Just enjoy playing games, whatever platform you use