Wednesday, August 26, 2009

How Google Indexes A Website

In order to get Google index your site, it is very important to know how Google indexes your site. Search engines use a software ‘bot’ which goes through all the pages of your site. This software categorizes every page of your site and then places them in a data base. If we talk about Google, it has three bots:


1. Adsense bot

2. Freshbot

3. DeepCrawl


The Adsense bot is applied for publishers who are having Adsense on the sites. This bot contains the JavaSript within the Adsense code for sending the massage to the Adsense bot , whenever a new page is created. As soon as Adsense bot receives the massage, it indexes the new page within few minutes to serve most relevant ads.


The job of Freshbot is to crawl the main pages of your site irrespective of their quantity i.e. the pages may be one or thousands. There are the sites that are crawled every 10 minutes, as they have frequent changes in there contents. Due to the regular change in such sites, Google identify such sites and crawl them frequently. For a typical site freshbot visit may take few days depending on the popularity of the pages. On a Freshbot visit , Google finds the deeper links of the site and places these links in a database.


Finally the DeepCrawlbot visits the site only once in a month. On its visit, DeepCrawl bot goes through all the deeper links that were previously found by Freshbot. That’s why a site may take even a month to get all its pages indexed in Google.


So, to get your site indexed by Google, content should be added regularly. Contact US

0 comments: