WebGlossary.info

• A combination of standards and conventions governing web crawler behavior and search engine indexing. The REP includes the robots exclusion standard (robots.txt), crawling and indexing directives for HTML meta elements, the Sitemaps protocol, and the rel=nofollow microformat. ↑ rfc-editor.org/rfc/rfc9309

This term is sponsored by: your name/company?

1. Previous term: Robot
2. Next term: Robots exclusion standard
3. Random term: End-to-end testing (webglossary.info/random 🎲)