robots.txt and our new store

gord

gord

gord

Soldato
Joined
18 Oct 2003
Posts
19,415
Location
Midlands
Hello all,

I've just recently launched a web store for our company. It's been a week since launch and Google still isn't indexing it correctly. I'm not exactly new to launching sites, but this one has been slightly more complex.

So the stores are on a subdomain http://store.amttraining.com

I understand robots.txt go in the root, so that's what I have done. I've also set up htaccess to stop all indexing of https.

The two robots.txts I'm using are http://store.amttraining.com/robots.txt and http://store.amttraining.com/robots_ssl.txt, and the rewrite works.

I just want to double check I haven't done anything stupid with the folder structure as the actual stores are on subfolders, e.g. http://store.amttraining.com/uk/ etc. I've added the site to webmaster tools too and submitted the sitemap, but its not indexing any of our urls.

Am I being too impatient? Any help is much appreciated.

Oh, and what Google has indexed is a test build. So when I go to site:store.amttraining.com it comes up with a load of our old test content.
 
Last edited:
Do you have a google account?

Have you requested a robot visit?

If not do, if you have does it says it's visited and if so any issues?

The site is a bit slow which won't help things.

But also it's only been a week.
 
Indeed I do. The robots.txt is being found properly. Although, I set up the webmaster tools on the uk subfolder.. and it wont give me crawl stats unless its at the root level for the subdomain.. so I may set up another profile for that.

I think the whole subdomain, subfolder thing may have confused it. But "fetch as Google bot" seems to work. There are no HTML suggestions.
 
I'd say if you've got a test store indexed then it's just a matter of waiting. eCommerce stores always seem to take a little longer in my experience.

Have never had to wait longer than 2 weeks though.
 
Quite possibly, but I have just found an issue. Our site is being served up here too: https://store.amtportal.com/uk/

Only on the secure port.. which I don't understand. amtportal was our test environment, but that header has been removed. Unfortunately I have limited IIS knowledge.
 
You must log in or register to reply here.
Back
Top Bottom