web crawler (Q45842)
internet bot that systematically browses the World Wide Web, typically for the purpose of Web indexing (web spidering)
Language:
other details
aliases ant
automatic indexer
web spider
web scutter
web crawlers
spider
search engine spider
description internet bot that systematically browses the World Wide Web, typically for the purpose of Web indexing (web spidering)

External Links