What I believe you're looking for is a called a blank nut. Have a look on screwfix/toolstation, or even better, get down to a store with the part in your hand to make sure it fits exactly.
Did it come with a sealing washer? If it didn’t, and you didn’t tape it, it’s unlikely to be properly water tight.
You should be sorted then. Easy enough to test, open the taps and see if anything leaks.