Question

I would like for google to index my twiki site, but that is not happening right now. My research has not revealed anything that is particularly useful. The one thing that I can see is that the twiki sites that come up on google search have different code(html/javascript) than the regular wiki. Can someone clarify the situation?

Thanks,

Environment

-- ZakaiKinan - 14 Feb 2007

Answer

If you answer a question - or have a question you asked answered by someone - please remember to edit the page and set the status to answered. The status is in a drop-down list below the edit box.

I don't think this is particular to TWiki. I have a site that comes up in Google searches. It might be your robots.txt file?

-- ArthurClemens - 15 Feb 2007

It takes some time until Google is picking up a new site. On their website is a page where you can enter a new url to index.

-- PeterThoeny - 15 Feb 2007

where should the robots.txt file reside on the site?

-- ZakaiKinan - 15 Feb 2007

The robots.txt file should reside in the root of the domain.

-- ArthurClemens - 15 Feb 2007

What is the average time that I should wait for this to happen?

-- ZakaiKinan - 15 Feb 2007

There is clear documentation on Google's site on all of this.

-- ArthurClemens - 15 Feb 2007

See also http://www.robotstxt.org/

-- PeterThoeny - 16 Feb 2007