Audio router/switcher?

[Things change I've changed]

I want the audio from my pc to go to a headphone amp and a stereo amp, so basically 1 RCA in (source) ----> 2 x selectable RCA out?

It seems really hard to find a box that will allow me to do that, most of them seem to be the other way around, multiple inputs going into one output, I'm just wondering if I purchase the below audio switcher do you think I should be able to use it in reverse?

 

[Things change I've changed]

I doubt you can?

Why not just use RCA splitter at the source side only switch on the amp that you use when you need to?

I was thinking about that but some people say that you suffer audio/signal degradation when you split from the source but if I'm not using both devices at same that shouldn't happen should it?