Not really sure how anyone can truly justify not paying taxes on the basis that they do not get anything of value back.
This article is over a year old now but it illustrates the point of where your tax money goes, summarised below.
Tax breakdown for £25,500 salary
£2,080 Pensions and Benefits
(including £212 on Housing Benefit and £296 on Incapacity Benefits)
£1,094 on the NHS
£824 on Education
£339 on Defence
£160 on the Police
£44 on Prisons
£92 on Roads
£71 on Railways
Of these, you could choose private pension, private healthcare and private education, but that would probably work out more expensive than the state funded alternatives. Difficult to avoid defence, police, prisons, roads and railways if you want to live in a safe society and be able to get places.