Has it blown then?
If its blown removing it whilst blown shouldnt tip anything.
Your risk is when putting it back in, as in then it would remake the circuit and could blow as your inserting it. But if the switch is off when you do so then you shouldn't be able to draw any current.