I dont feel limited at all. I did with my iphone 3, the main problem for me was multitasking but not with the 4s, I cant see any reason to jailbreak.
Sure the iPhone functions fine without jailbreaking but for something like SBsettings and infinifolders its worth doing