I couldn't fault mine untill it threw itself of a perfectly flat 'safe' surface and smashed its screen on the floor without any help from me, or anyone else.
I personally found mine to be very quick and responsive. However some things you may be used to - like facebook contact integration - are not properly supported on Jellybean. You may need to use a piece of software. I personally used HaxSync. Another nice feature was the email widget allowed me to access all folders in my Hotmail account, not just the inbox - which is something my S2, or my older iPhone 3g didn't let me do.
One thing to be aware on on the N4 is swiping. I deleted a few nice photos I had by accidentally swiping them off the screen (thinking I was going to go to the next photo). Thankfully the phone allows you to auto upload all photos you take to the 'cloud', meaning you dont need to worry if you delete them off the handset. Of course you can set how this works or turn it off if you don't like it. I personally had mine set to only upload when I had connection to my wi-fi at home.
The other frustrating thing is a lot of Flash based videos will not work either, but I guess you will already be used to that. Of course there are aps to fix that.
You may actually be surprised at the lack of options in raw Jellybean. There certainly feels less customisation options on my N4 than on my S2, but re-sizable widgets is a nice feature. You have incognito browsing as well (supposedly) but my gripe with that is that windows viewed still come up as 'recently closed' tabs which the phone tells you they should not do

I liked the idea of having a clutter free browsing experience but it didnt deliver as I expected. However the browsing experience overall is very fluid and fast.
A gripe I had was with the N4's seemingly random way of sometimes keeping games open and sometimes closing them after pressing the home 'button'. I only had Angry Birds star wars and Fragger installed and for both games it would sometimes leave them open in the background (cool) or close them so they had to restart when selected from the 'recent' list (not cool). This was annoying if I was in the middle of a level, or just wanted to quickly dive right back into a game after a momentary diversion to something else.
Battery use wise I was getting a day per charge, but heavier usage killed it quickly. This is not really the phones fault but the design of trickle charge type batteries that are mostly in use these days. They are designed to be constantly 'topped up' as most people have the ability to charge their devices in their cars, or in the office, or whilst sat at the computer at home.
I personally found massive differences in battery life depending on what I was doing. If just used it for texting, pushed emails, facebook etc and I avoided using wi-fi heavily (internet browsing) my battery would last around 36hrs. But at any point where I used the web browser, or started playing games, by battery life sapped pretty quickly into "please connect your charger". That said, considering the size of the screen, I don't think it did too badly, and certainly no worse than my S2 was. People used to blackberry devices will have a bit of a shock though - my work phone is a Torch, and even that only needs charging once a week!
Another issue I was having was lock screen lock ups. I would go to unlock the phone and it would freeze on the lock screen. It would do this for a good few seconds until finally loading into my homescreen. It wasnt all the time, but it happened pretty regularly. I'm not sure why. On a couple of occasions the lock screen locked up, and I had to press the screen lock button once, then once again to get it to reset the lock screen so I could get into the handset. It is a minor gripe really, but still I wasn't expecting such obvious issues with such a powerful phone on such an uncluttered OS.
I also found the screen response to faster finger movements was not always up to standard - especially when 'swiping' through long bodies of text. It seemed to somehow not behave in the way I was used to on the S2 where the speed of scrolling would increase the more times you quickly swiped your finger down/up the screen.
Finally - my main gripe was that my phone had a 'rattle' straight out of the box! Yes, it is a little anal, but it shouldn't be rattling when I shake it. It kind of made it feel cheaper somehow, and dented the 'solid' image of the build quality. I also found when tapping the back plate with my fingers it made a plasticy hollow noise, which just felt out of place seeing as the back is supposed to super tough gorilla glass!
But overall I loved this phone. Hopefully LG are not going to charge me a fortune for repairing their Kamikaze headline model.
Cheers
Buff