Classics are only cheap when you know how to work on them yourself.
That's not true..... if you don't know how to work on a car yourself, you would take ANY car to a garage, classic or not, and as classic cars are usually a lot simpler than modern vehicles (there are no associated electrikery parts that must also work. No sensors, controllers, auxilliary wiring looms and so on, just basic mechanics, all done with cables or pipes) and as the resale value is not so dependant upon full service history (most buyers are happy just to see a folder full of relevant reciepts) you do not have to take it to a specialist or main dealer, any capable garage will do and, as such, the labour is often less.
Also, if you choose the right manufacturer (such as Triumph, for example, where parts are plentiful and relatively cheap) the cost of parts can often be much less than those for a modern car.
On top of this, if you are into cars, but don't know how to work on them yourself, a classic is far simpler to learn on than a modern car, engine bays are often a lot more roomy and parts easier to access (on the Spitfire, GT6, Vitesse and Herald, for example, the whole bonnet hinges forward revealing the entire engine on a stand for you. Triumph have even thoughfully provided a seat, in the form of the front wheel, for you to sit on while you work) and with very few auxilliary devices to worry about the electrics are a lot simpler. They're just like big meccano kits.
There are drawbacks to classics, of course. They're not as safe, for a start, and rust can be a serious issue and, when you are very young, you may struggle to find an insurer, although joining an owners club can often help.
I'm not saying that classics are the answer to all new drivers troubles, simply that they shouldn't be ignored, and if you pick carefully and thoughtfully, you could end up with an individualistic car that is fun to drive, rewarding to own, not hugely expensive to run and, if you look after it, may not have actually lost much value when you come to sell it on.