Ok this is getting weirder and weirder..
Further testing shows that I don't even need to switch DP inputs between boots. If, after a successful boot I shutdown the system, pull the DP cable, re-insert the DP cable in the same port, then switch on.. successful boot.. Cold boot without pulling...