• The systematic browsing of the World Wide Web for the purpose of indexing. ← Wikipedia

1. Related terms: Crawler, World Wide Web, One-based indexing, Robots Exclusion Protocol
2. Previous term: Crawler trap
3. Next term: CRDT
4. Random term: Yak shaving (webglossary.info/random 🎲)