ok, thanks for a lot of good replies and advice. Few things I've picked up that should have been mentioned before. Yes we are homeowners, however we don't have a mortgage, its paid off. The start up cash is not secured against our home either so that a bit of a safety net. TBH we don't have any debts at all as the cars are both paid for, so the gamble is again reduced.
Fully considered the partner mentioned above, They are a relation however and they are more on board for help and guidance, they sold they're business recently and that was performing exceptionally well. Their cut has been decided by them, at less than I had expected, and its been signed.
I decided before the 1st post not to mention what the venture is sorry about that I just felt like having a bit of privacy.
As for seeing my children more, they will be involved in a way so I will get more time with them than I currently do.
I've thought about this all day, and the whole problem is me.
So it's happening, I'm gonna MAN UP.
Cheers to all for the tips