SEARCH ENGINE ROBOT
A search engine robot (also known as a SearchEngineSpider or a WebCrawler) is a software program that browses the Web in an attempt to index (save a copy of) site code to local search engine servers. As well as indexing a site for later retrieval in search results, these programs or scripts can also build a collection of URLs to which indexed sites have linked, in order to build a seed list for further crawling.
There are no comments on this page. [Add comment]