If you want to actually create the armour/weapons you don't really have much choice other than putting points into it. It doesn't become really overpowered until your smithing upgrades are the last couple of tiers (and it becomes totally broken if you start smithing them beyond that).
So long as you don't wind up with like 100 Smithing by level 25 the difficulty curve shouldn't be too badly effected. Armour it probably won't make much difference on without lots of perks invested in light armour, its mostly the damage inflicted, especially by sneak attacks, which becomes very powerful.
So long as you don't wind up with like 100 Smithing by level 25 the difficulty curve shouldn't be too badly effected. Armour it probably won't make much difference on without lots of perks invested in light armour, its mostly the damage inflicted, especially by sneak attacks, which becomes very powerful.