datatracker.ietf.org/doc/draft-koster-rep/12

Preview meta tags from the datatracker.ietf.org website.

Linked Hostnames

11

Thumbnail

Search Engine Appearance

Google

https://datatracker.ietf.org/doc/draft-koster-rep/12

Robots Exclusion Protocol

Robots Exclusion Protocol



Bing

Robots Exclusion Protocol

https://datatracker.ietf.org/doc/draft-koster-rep/12

Robots Exclusion Protocol



DuckDuckGo

https://datatracker.ietf.org/doc/draft-koster-rep/12

Robots Exclusion Protocol

Robots Exclusion Protocol

  • General Meta Tags

    12
    • title
      draft-koster-rep-12 - Robots Exclusion Protocol
    • charset
      utf-8
    • X-UA-Compatible
      IE=edge
    • viewport
      width=device-width, initial-scale=1
    • article:section
      IETF - Internet Engineering Task Force
  • Open Graph Meta Tags

    10
    • og:title
      Robots Exclusion Protocol
    • og:url
      https://datatracker.ietf.org/doc/draft-koster-rep/12/
    • og:site_name
      IETF Datatracker
    • og:description
      This document specifies and extends the "Robots Exclusion Protocol" method originally defined by Martijn Koster in 1994 for service owners to control how content served by their services may be accessed, if at all, by automatic clients known as crawlers. Specifically, it adds definition language for the protocol, instructions for handling errors, and instructions for caching.
    • og:type
      article
  • Twitter Meta Tags

    1
    • twitter:card
      summary_large_image
  • Link Tags

    13
    • alternate
      /feed/document-changes/draft-koster-rep/
    • apple-touch-icon
      https://static.ietf.org/dt/12.44.0/ietf/images/ietf-logo-nor-180.png
    • canonical
      https://datatracker.ietf.org/doc/draft-koster-rep/12/
    • icon
      https://static.ietf.org/dt/12.44.0/ietf/images/ietf-logo-nor-32.png
    • icon
      https://static.ietf.org/dt/12.44.0/ietf/images/ietf-logo-nor-16.png

Emails

9
  • m.koster%40nexor.co.uk
  • synack%40garyillyes.com
  • henner%40google.com
  • lizzi%40google.com
  • ted.ietf%40gmail.com

Links

118