So would that mean after uninstalling old drivers that I should boot back in with HDMI in motherboard rather than new GPU?
No. After uninstalling the current drivers through appwiz, run DDU which will give you the option to reboot and run in safe mode. DDU will then give you the option to clean the drivers and shutdown. After doing so you can install your new card and when the computer boots up install the latest drivers.