I know what you mean about the controller - I keep going back and forth on whether I'd actually use it to be honest!
I've come to the conclusion that I'd probably use it the most while streaming video's etc to a TV via a HDMI cable using "Console Mode" - I tried this without the controller and basically you have zero control as the Shield's own display turns off! (the "Mirror Mode" works OK but is a tiny bit laggy and you don't get the correct aspect ratio etc!)
Gaming-wise I'm just not sure I'll get much use out of it!
I've come to the conclusion that I'd probably use it the most while streaming video's etc to a TV via a HDMI cable using "Console Mode" - I tried this without the controller and basically you have zero control as the Shield's own display turns off! (the "Mirror Mode" works OK but is a tiny bit laggy and you don't get the correct aspect ratio etc!)
Gaming-wise I'm just not sure I'll get much use out of it!