The only issue is that you'll have to restore from a pre-iOS 8 backup, so any data or preferences you've saved since then will be lost - and if you haven't got a backup from your iOS 7 days, you won't be able to restore your data at all. In that case all your data will be lost and you'll have to go back to a factory-default 'new iPhone' setup. Something to consider.