you got settings messed up.
I always say bandicam because the file recorded goes upto youtube, looks ok and isnt too big
Fraps is just bad. It was the only recording software but now there are free alternatives that are simply superior.
MSI afterburner is pretty good if you configure it with a custom codec.