I love people who assume anyone who doesn't want an iPhone simply can't afford one.
I can afford an iPhone 5 without even thinking about it - I just don't want one. I don't dispute the many improvements over the 4S, no matter how "minor", just none of them really appeal to me.
With regards to the major differences, I don't need a bigger screen nor do I want a bigger phone. I don't like the all-black design and prefer the design of the 4/4S. I like the weight of my 4S and think the 5 feels too light. I prefer the glass back of my 4S and think the anodised aluminium of the iPhone 5's feels worse in the hand and marks more easily. Finally, whilst I appreciate the reasons for changing the connector, it's pure hassle right now when all my other Apple devices use the older connector and I'd have to buy new cables and accessories, none of which are available yet.
If I wanted one, I'd buy one, but I don't so I won't. Usually when a new model of an Apple device I own is released, I hanker after it and want it as soon as possible, but with the 5 I feel no urge nor desire to own one whatsoever.