arxiv.org/abs/2006.15595

Preview meta tags from the arxiv.org website.

Linked Hostnames

27

Thumbnail

Search Engine Appearance

Google

https://arxiv.org/abs/2006.15595

Rethinking Positional Encoding in Language Pre-training

Abstract page for arXiv paper 2006.15595: Rethinking Positional Encoding in Language Pre-training



Bing

Rethinking Positional Encoding in Language Pre-training

https://arxiv.org/abs/2006.15595

Abstract page for arXiv paper 2006.15595: Rethinking Positional Encoding in Language Pre-training



DuckDuckGo

https://arxiv.org/abs/2006.15595

Rethinking Positional Encoding in Language Pre-training

Abstract page for arXiv paper 2006.15595: Rethinking Positional Encoding in Language Pre-training

  • General Meta Tags

    18
    • title
      [2006.15595] Rethinking Positional Encoding in Language Pre-training
    • title
      open search
    • title
      open navigation menu
    • title
      contact arXiv
    • title
      subscribe to arXiv mailings

  • Open Graph Meta Tags

    10
    • og:type
      website
    • og:site_name
      arXiv.org
    • og:title
      Rethinking Positional Encoding in Language Pre-training
    • og:url
      https://arxiv.org/abs/2006.15595v4
    • og:image
      /static/browse/0.3.4/images/arxiv-logo-fb.png

  • Twitter Meta Tags

    6
    • twitter:site
      @arxiv
    • twitter:card
      summary
    • twitter:title
      Rethinking Positional Encoding in Language Pre-training
    • twitter:description
      In this work, we investigate the positional encoding methods used in language pre-training (e.g., BERT) and identify several problems in the existing formulations. First, we show that in the...
    • twitter:image
      https://static.arxiv.org/icons/twitter/arxiv-logo-twitter-square.png

  • Link Tags

    13
    • apple-touch-icon
      /static/browse/0.3.4/images/icons/apple-touch-icon.png
    • canonical
      https://arxiv.org/abs/2006.15595
    • icon
      /static/browse/0.3.4/images/icons/favicon-32x32.png
    • icon
      /static/browse/0.3.4/images/icons/favicon-16x16.png
    • manifest
      /static/browse/0.3.4/images/icons/site.webmanifest

Links

72