The difficulty isn't the problem, it's the combat mechanics as a whole, I enjoy challenges in fact I revel in them, hell I recently got done doing a no armor/magic playthrough of demons souls last week, what I'm finding with this game is not challenging, it's frustrating, it's from bowmen whose arrows you can't avoid by any means, it's from the game randomly deciding I can't attack an enemy because he's a certain way through his attack animation even if my attack would hit first, it's the block function being about as useful as throwing a hanky at them and spending every single fight with more than one enemy running around waiting for one to move away from the other because even if you stagger attacks between two enemies they will ALWAYS find time to hit you leading to a stun and being hit by the other. It's the fraction of a second after setting a trap that Geralt is completely unresponsive so if you try to do it in a fight you have to be THAT much father away or you get caught in the explosion, it's the fact you can't look around without changing targets or locking on (what was wrong with just locking on to the target geralt is pointing towards?) It's the fact that if I kill an enemy and I happen to be looking at an enemy 10ft away and accidentally hit attack again Geralt will flop about like a gymnast towards that enemy disregarding the one trying to stab me in the spine.
There are just so many things that can lead to your death that you have either no control over or have to actively avoid.