Search Engine Site Maps
The Search Engines love it when you make it easy for their "spiders" to crawl your site and site maps normally do the trick. Place a site map page on your server that is basically an outline of the pages you have in your site and the Search Engines will than you for making their job easy.
There's a little more to it than just sticking this page out there though. You want to be sure that there are no errors on your pages that will prevent the Engine's spiders from crawling your site. Should the spider encounter an error, it will immediately stop crawling your site and move on. There is very specific software that we use to check and diagnose crawl problems before installing and submitting your site map. Once the spider crawls the site we can access what is called "Crawl Stats" which will tell us which pages were crawled successfully and which ones the spider couldn't access.
Your Site map is written and placed on your site and the Search Engines are notified that it is there.
We then are able to track the status of your site per the top three Search Engines using our Site Tracker software. This software reports the number of pages indexed per Engine and the number of back links to your site on a daily basis (see the Site Tracker page for more details).
|