Of course you're in control while coasting, the car's balance and weight distribution doesn't magically change and throw you in a hedge just because the clutch is depressed... What car were you in?
Eh? The weight distribution and balance changes dramatically. No longer is the car being driven by its own wheels but by mavity/kinetic energy. Whilst you can more or less get away with this in a front wheel drive car... in a rear wheel drive car you are going to come unstuck very very quickly. But even FWD need something to "pull" them through corners. And as such if you try this in a FWD car you will get a lot of understeer...
People that coast down hills with the engine idling are the sort of drivers that will also try to coast round corners when they randomly "can't be bothered"...
This is actually what causes a lot of accidents. Nervous/incompetent drivers... take a corner a bit too fast... realise their mistake so they put the clutch in... all driven wheels stop being driven. Now the car is at the complete mercy of the tyres grip and steering inputs. Often these drivers will also (as if they haven't unsettled the balance enough) hit the brakes as well.