robots.txt

Soldato
Joined
7 Jan 2007
Posts
10,607
Location
Sussex, UK
I'm building a site and got my domain online so I can test my database and ensure all my scripts are working correctly.

I have set my robots.txt to

User-agent: *
Disallow: /


This stops all robots right?

Will it harm my site rankings when I eventually remove this?
 
Yes, that will stop all robots, and It shouldn't do any harm once you remove this! I always do this during development stages :)

Once you do plan on removing it, remember submit a sitemap to Google in the webmaster tools! Really handy to find out what Google thinks about your site.
 
Yeh, that's fine, standard for developing online. Don't want pages indexed before they're launched.
 
Back
Top Bottom