title

Pathways Language Model (PaLM): Scaling to 540 Billion Parameters for Breakthrou

charset

utf-8

description

Posted by Sharan Narang and Aakanksha Chowdhery, Software Engineers, Google Research In recent years, large neural networks trained for language un...

keywords

Natural Language Processing,Machine Learning,Self-Supervised Learning

description

Posted by Sharan Narang and Aakanksha Chowdhery, Software Engineers, Google Research In recent years, large neural networks trained for language un...

og:title

Pathways Language Model (PaLM): Scaling to 540 Billion Parameters for Breakthrou

og:url

http://research.google/blog/pathways-language-model-palm-scaling-to-540-billion-parameters-for-breakthrough-performance/

og:description

Posted by Sharan Narang and Aakanksha Chowdhery, Software Engineers, Google Research In recent years, large neural networks trained for language un...

og:image

https://storage.googleapis.com/gweb-research2023-media/images/07ef38036e86f81ac74829e59384929b-i.width-800.format-jpeg.jpg

og:image:secure_url

https://storage.googleapis.com/gweb-research2023-media/images/07ef38036e86f81ac74829e59384929b-i.width-800.format-jpeg.jpg

canonical

http://research.google/blog/pathways-language-model-palm-scaling-to-540-billion-parameters-for-breakthrough-performance/

icon

/gr/static/assets/favicon.ico

preconnect

https://fonts.googleapis.com

preconnect

https://fonts.gstatic.com

preload

https://fonts.googleapis.com/css2?family=Product+Sans&family=Google+Sans+Display:ital@0;1&family=Google+Sans:ital,wght@0,400;0,500;0,700;1,400;1,500;1,700&family=Google+Sans+Text:ital,wght@0,400;0,500;0,700;1,400;1,500;1,700&display=swap