SEARCH ENGINE WIKI

    SEARCH ENGINE ROBOT

SEARCH ENGINE ROBOT

A search engine robot (also known as a SearchEngineSpider or a WebCrawler) is a software program that browses the Web in an attempt to index (save a copy of) site code to local search engine servers. As well as indexing a site for later retrieval in search results, these programs or scripts can also build a collection of URLs to which indexed sites have linked, in order to build a seed list for further crawling.

Categories
CategoryGlossary

PageStatus: OpenPage