- An Internet bot that systematically browses the World Wide Web, typically for the purpose of Web indexing (web spidering). Web search engines and some other sites use Web crawling or spidering software to update their web content or indices of others sites’ web content. ← Wikipedia
- Previous term: CRAP
- Next term: Crawler trap
- Random term: nginx