Yeah I'm the same I think these devices are frankly crap for gaming unless it's a tower defence type of game or strategy, board games etc. I've bought and tried loads of driving and shooters and it just doesn't work for me.
I'm not the only one then!
I think the game I've played the most on mine is some Tower Defence game that was free. The graphics are rubbish, but it's great.
I actually found that I sort of dropped off playing games on it once the 'honeymoon period' was over. I only tend to play them now when I go travelling.
Infinity Blade, which is the one Apple like to tout certainly looks great, but it's not got much substance, you just randomly flick the screen like a nutter.
It's certainly the 3D games that are where the extra power will be of main use, that's pretty much what Engadget's hands-on concluded too.