But you aren't going to notice realistic shadows in motion that much, especially when focusing on other things.
Its not just the shape of the shadows, without RT areas that shouldn't be lit are etc, it's like uncanny valley once your used to spotting it.
I have a 4000 series card so performance isn't really a top issue for me, everything runs well anyway