Just to expand on this, with everything you propose to run, your server could be quite busy, so it is likely it wouldn't spend much time idling on a P4!
get another hard drive. running the host OS and multiple VMs off one disk, no matter how much CPU/ram you have is painful.