Got a picture?
There is a tab on the PCI-E bay which you are supposed to press to enable the graphics card to be removed easily, sounds like you've used excess force to remove it.
I think you would have a hard time fixing it, either try to RMA or buy a new motherboard.