
datatracker.ietf.org/doc/draft-koster-rep/12
Preview meta tags from the datatracker.ietf.org website.
Linked Hostnames
11- 99 links todatatracker.ietf.org
- 9 links towww.ietf.org
- 2 links togithub.com
- 1 link toauthor-tools.ietf.org
- 1 link tomailarchive.ietf.org
- 1 link tostatus.ietf.org
- 1 link totrustee.ietf.org
- 1 link towww.iab.org
Thumbnail

Search Engine Appearance
https://datatracker.ietf.org/doc/draft-koster-rep/12
Robots Exclusion Protocol
Robots Exclusion Protocol
Bing
Robots Exclusion Protocol
https://datatracker.ietf.org/doc/draft-koster-rep/12
Robots Exclusion Protocol
DuckDuckGo

Robots Exclusion Protocol
Robots Exclusion Protocol
General Meta Tags
12- titledraft-koster-rep-12 - Robots Exclusion Protocol
- charsetutf-8
- X-UA-CompatibleIE=edge
- viewportwidth=device-width, initial-scale=1
- article:sectionIETF - Internet Engineering Task Force
Open Graph Meta Tags
10- og:titleRobots Exclusion Protocol
- og:urlhttps://datatracker.ietf.org/doc/draft-koster-rep/12/
- og:site_nameIETF Datatracker
- og:descriptionThis document specifies and extends the "Robots Exclusion Protocol" method originally defined by Martijn Koster in 1994 for service owners to control how content served by their services may be accessed, if at all, by automatic clients known as crawlers. Specifically, it adds definition language for the protocol, instructions for handling errors, and instructions for caching.
- og:typearticle
Twitter Meta Tags
1- twitter:cardsummary_large_image
Link Tags
13- alternate/feed/document-changes/draft-koster-rep/
- apple-touch-iconhttps://static.ietf.org/dt/12.44.0/ietf/images/ietf-logo-nor-180.png
- canonicalhttps://datatracker.ietf.org/doc/draft-koster-rep/12/
- iconhttps://static.ietf.org/dt/12.44.0/ietf/images/ietf-logo-nor-32.png
- iconhttps://static.ietf.org/dt/12.44.0/ietf/images/ietf-logo-nor-16.png
Emails
9- m.koster%40nexor.co.uk
- synack%40garyillyes.com
- henner%40google.com
- lizzi%40google.com
- ted.ietf%40gmail.com
Links
118- https://author-tools.ietf.org/api/idnits?url=https://www.ietf.org/archive/id/draft-koster-rep-12.txt
- https://datatracker.ietf.org
- https://datatracker.ietf.org/accounts/create
- https://datatracker.ietf.org/accounts/login/?next=/doc/draft-koster-rep/12
- https://datatracker.ietf.org/accounts/reset