What do you know about search engine robots?
Well,they are data retrieving programs which are also known as “spider” or crawler for what they do.Your websites will be indexed in search engine only when they spiders crawl on your sites.Robots collect links from each page they visit and crawl from one page to other through the links they collected.As they reach your websites,they first check the robot.txt file.This file give the information about the limits upto which the robots can enter to your website.There are many things that robots cannot do.They cannot enter the password protected area,in your websites robots will not understand flash movies,images and javascript,also they cannot click the buttons on your websites.

Summiting a webpage in a search engine means your webpage(url) will be listed in the robots’ queue of website to visit in their next outing for detection.even if you do not summit your url in search engines,robots will reach your webpages through the links which are link to you.So,increasing link popularity is also one of the important factor to get listed in search engine.

Last Modified : December 22nd, 2006 Filed under : SEO Tips Navigate : / Next post