Yes it's expensive, but you can still live cheaply if you shop smart!
For example wine is reasonably priced, I typically pay about $7 (4 quid) for a nice bottle of red or white - and the wine here can be excellent!
For your fruit and veg, just like the UK if you go to a proper market...