arxiv.org/abs/2305.13245v3

Preview meta tags from the arxiv.org website.

Linked Hostnames

26

Thumbnail

Search Engine Appearance

Google

https://arxiv.org/abs/2305.13245v3

GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints

Abstract page for arXiv paper 2305.13245v3: GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints



Bing

GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints

https://arxiv.org/abs/2305.13245v3

Abstract page for arXiv paper 2305.13245v3: GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints



DuckDuckGo

https://arxiv.org/abs/2305.13245v3

GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints

Abstract page for arXiv paper 2305.13245v3: GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints

  • General Meta Tags

    21
    • title
      [2305.13245v3] GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints
    • title
      open search
    • title
      open navigation menu
    • title
      contact arXiv
    • title
      subscribe to arXiv mailings

  • Open Graph Meta Tags

    10
    • og:type
      website
    • og:site_name
      arXiv.org
    • og:title
      GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints
    • og:url
      https://arxiv.org/abs/2305.13245v3
    • og:image
      /static/browse/0.3.4/images/arxiv-logo-fb.png

  • Twitter Meta Tags

    6
    • twitter:site
      @arxiv
    • twitter:card
      summary
    • twitter:title
      GQA: Training Generalized Multi-Query Transformer Models from...
    • twitter:description
      Multi-query attention (MQA), which only uses a single key-value head, drastically speeds up decoder inference. However, MQA can lead to quality degradation, and moreover it may not be desirable to...
    • twitter:image
      https://static.arxiv.org/icons/twitter/arxiv-logo-twitter-square.png

  • Link Tags

    13
    • apple-touch-icon
      /static/browse/0.3.4/images/icons/apple-touch-icon.png
    • canonical
      https://arxiv.org/abs/2305.13245
    • icon
      /static/browse/0.3.4/images/icons/favicon-32x32.png
    • icon
      /static/browse/0.3.4/images/icons/favicon-16x16.png
    • manifest
      /static/browse/0.3.4/images/icons/site.webmanifest

Links

70