lol, chucked out the things that saved you money..... then your bills went up, that worked out well.
Its shocking that SO many people with no real alternative use storage heaters to save money but you thought the better idea was to chuck them out AND not change the tarif which was specifically designed for storage heaters.
Yes, they chuck out a lot of energy during the day, but it means when you get back to your house its say, 15C rather than 10C, and its FAR cheaper to raise the temp 5c with storage heaters, than to come home to a 10C house and whack on electric heaters that cost 5 times as much.
If you own the place, do something about it, get it insulated, make sure windows are draught proofed and basically do whatever you can.
Use storage heaters and the current tarif or E9/10, or move to a cheaper daytime tarif as you aren't using the storage heaters at night.
Buy alternative heaters, gas/oil, both will be vastly cheaper, if you use electric heaters, use them sparingly, wear more clothes, etc, etc.