I presume you wouldn't follow through and ask them to cancel if you were legitimately leaving?
Would the new provider sort all that out?
(Never switched providers before hence the n00b q's)
Of course not, if you can't be bothered in actually switching then you have until the day before you're due to leave to cancel your cancel. Chances are though retention will have called you before that though.