Skip to definition.
Get the FREE one-click dictionary software for Windows or the iPhone/iPad and Android apps


Noun: web crawler
  1. A computer program that prowls the internet looking for publicly accessible resources that can be added to a database; the database can then be searched with a search engine
    - spider, crawler

Derived forms: web crawlers

Type of: computer program, computer programme [Brit], program, programme [Brit, Cdn]

Encyclopedia: Web crawler