frontierai.substack.com/p/open-llms-dont-need-to-beat-openai/comment/55982826

Preview meta tags from the frontierai.substack.com website.

Linked Hostnames

2

Thumbnail

Search Engine Appearance

Google

https://frontierai.substack.com/p/open-llms-dont-need-to-beat-openai/comment/55982826

Nathan Lambert on The AI Frontier

Elo being a coin flip really makes me think we don’t know how to generally compare models. When you average over many tasks that are somewhat saturating, much like any AI task, signal saturates.



Bing

Nathan Lambert on The AI Frontier

https://frontierai.substack.com/p/open-llms-dont-need-to-beat-openai/comment/55982826

Elo being a coin flip really makes me think we don’t know how to generally compare models. When you average over many tasks that are somewhat saturating, much like any AI task, signal saturates.



DuckDuckGo

https://frontierai.substack.com/p/open-llms-dont-need-to-beat-openai/comment/55982826

Nathan Lambert on The AI Frontier

Elo being a coin flip really makes me think we don’t know how to generally compare models. When you average over many tasks that are somewhat saturating, much like any AI task, signal saturates.

  • General Meta Tags

    20
    • title
      Comments - Open LLMs don’t need to beat OpenAI
    • title
    • title
    • title
    • title

  • Open Graph Meta Tags

    7
    • og:url
      https://frontierai.substack.com/p/open-llms-dont-need-to-beat-openai/comment/55982826
    • og:image
      https://substackcdn.com/image/fetch/$s_!W9sH!,f_auto,q_auto:best,fl_progressive:steep/https%3A%2F%2Ffrontierai.substack.com%2Ftwitter%2Fsubscribe-card.jpg%3Fv%3D1618566398%26version%3D9
    • og:type
      article
    • og:title
      Nathan Lambert on The AI Frontier
    • og:description
      Elo being a coin flip really makes me think we don’t know how to generally compare models. When you average over many tasks that are somewhat saturating, much like any AI task, signal saturates.

  • Twitter Meta Tags

    8
    • twitter:image
      https://substackcdn.com/image/fetch/$s_!W9sH!,f_auto,q_auto:best,fl_progressive:steep/https%3A%2F%2Ffrontierai.substack.com%2Ftwitter%2Fsubscribe-card.jpg%3Fv%3D1618566398%26version%3D9
    • twitter:card
      summary_large_image
    • twitter:label1
      Likes
    • twitter:data1
      0
    • twitter:label2
      Replies

  • Link Tags

    31
    • alternate
      /feed
    • apple-touch-icon
      https://substackcdn.com/image/fetch/$s_!bsjz!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd3b91fc1-4ad2-4bc0-acf1-4436dc69c413%2Fapple-touch-icon-57x57.png
    • apple-touch-icon
      https://substackcdn.com/image/fetch/$s_!90tY!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd3b91fc1-4ad2-4bc0-acf1-4436dc69c413%2Fapple-touch-icon-60x60.png
    • apple-touch-icon
      https://substackcdn.com/image/fetch/$s_!BVaO!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd3b91fc1-4ad2-4bc0-acf1-4436dc69c413%2Fapple-touch-icon-72x72.png
    • apple-touch-icon
      https://substackcdn.com/image/fetch/$s_!Nl_k!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd3b91fc1-4ad2-4bc0-acf1-4436dc69c413%2Fapple-touch-icon-76x76.png

Links

19