So for example, the new Tomb Raider game which is not GFWL...
I would just plug Wired Xbox360 controller in and it would recognize it and I can just play?
Yep, shows the correct button icons and everything.
A fairly safe assumption is that if a game support controllers, it will support the Xbox controller.
Steam Big Picture mode is designed for it too.