Yep Stamina increases carrying capacity by 5 iirc.
Oh, I didn't realise Stamina boosted carry capacity.
The Stallion Stone will increase what you can carry also. Plus look out for boots of strength or carrying.
Theres a skill for Pickpocket that boosts it by 100 too. I should work on producing a potion for it but it needs really rare ingredients it seems.