![](/assets/images/picto-drapeau-france-3a76576a5d60a512053b4612ab58dae5.png)
2. Search engine crawl system
As we have already seen, several steps are necessary for a search engine to function properly:
In the first phase, software crawls the Web from link to link, retrieving information from web pages;
This information is then indexed by indexing engines, with the indexed terms enriching a regularly updated – database of words contained in – pages;
finally, a search interface enables results to be returned to users by ranking them in order of relevance.
2.1 Spiders / Robots
Spiders (also known as agents, crawlers, robots or bots) are browser programs that constantly visit web pages and links to index...
Exclusive to subscribers. 97% yet to be discovered!
You do not have access to this resource.
Click here to request your free trial access!
Already subscribed? Log in!
![](/assets/images/logo-eti-286623ed91fa802ce039246e516e5852.png)
The Ultimate Scientific and Technical Reference
This article is included in
Software technologies and System architectures
This offer includes:
Knowledge Base
Updated and enriched with articles validated by our scientific committees
Services
A set of exclusive tools to complement the resources
Practical Path
Operational and didactic, to guarantee the acquisition of transversal skills
Doc & Quiz
Interactive articles with quizzes, for constructive reading
Search engine crawl system
Bibliography
- (1) - BRIN (S.), PAGE (L.) - The anatomy of a large-scale hypertextual web search engine. Computer networks and ISDN Systems. - https://snap.stanford.edu/class/cs224w-readings/Brin98Anatomy.pdf (1998).
- ...
Websites
Worldwide search engine statistics
The problem of measuring (and comparing) search engine market share
...Events
SEO Campus and SEO Camp Days
https://www.seo-camp.org/agenda-des-evenements-seo-et-webmarketing/
SMX Paris
Directory
Organizations – Federations – Associations (non-exhaustive list)
Seo Camp
Exclusive to subscribers. 97% yet to be discovered!
You do not have access to this resource.
Click here to request your free trial access!
Already subscribed? Log in!
![](/assets/images/logo-eti-286623ed91fa802ce039246e516e5852.png)
The Ultimate Scientific and Technical Reference