I have a family website with a registered URL, pointing to the web space it is on, however, I do not want Search Engine bots to be able to get onto the web space in an attempt to gather information about it for the purpose of indexing the website on Search Engines. I wish to keep it private, just for family members only.
I have heard that I can use a "robots.txt" file which will stop the search engines picking the site up.
I presume that a "robots.txt" file is simply a "Notepad" text file with the appropriate information in it, and placed on the website. What information would I need to put into this "Notepad" text file and where would I place it on the website?
I realise I could password it, but would prefer not too.
Many thanks for your help.
I have heard that I can use a "robots.txt" file which will stop the search engines picking the site up.
I presume that a "robots.txt" file is simply a "Notepad" text file with the appropriate information in it, and placed on the website. What information would I need to put into this "Notepad" text file and where would I place it on the website?
I realise I could password it, but would prefer not too.
Many thanks for your help.