Not really in my experience, unless your a die hard fps find and play with very sensitive mouse settings.
My last monitor was 5ms with a virtual 2ms mode that didn't really work (using it in 2ms mode had detrimental effect in other areas) so I left it as 5ms. My new monitor is 2ms native and does feel better for fps, but it's also 5 inches bigger, and higher resolution, so there may be some placebo effect there.
I wouldn't be too concerned between 2 and 5.
2 and 8/10 maybe.