The 32bn is an investment in the future, not just today as has already been said. Saving 35mins on a journey is an immense undertaking. What people fail to remember is that the current rail network was designed and built in Victorian times yet has over 20,000 miles of track to maintain. How much do you think that would cost to rip up and start again? 32bn would seem like a drop in the ocean!
For years the railway has been a victim of cost cutting (by both governments) and only recently has the railways been invested in through Network Rail. There is now a huge amount of investment in the rail network and while it may not benefit you directly, it will benefit the country as a whole by alleviating motorway/city congestion and thus serve to benefit everyone in one form or another. I would agree that there is much more to be done and investments such as this are surely a step in the right direction.