This is what CEC is for. If you wake the telly up by pressing a button on the Apple TV remote it should turn the telly on and switch to that input. My shield does this as does Sky Q and my PS4.
yes true, that works really well. I had been using the Sony remote but actually doing this is probably the way forward.