title

Alpa: Automated Model-Parallel Deep Learning

charset

utf-8

description

Posted by Zhuohan Li, Student Researcher, Google Research, and Yu Emma Wang, Senior Software Engineer, Google Core Update — 2022/05/06: This pos...

keywords

distributed systems,Machine Learning,osdi

description

Posted by Zhuohan Li, Student Researcher, Google Research, and Yu Emma Wang, Senior Software Engineer, Google Core Update — 2022/05/06: This pos...

og:title

Alpa: Automated Model-Parallel Deep Learning

og:url

https://research.google/blog/alpa-automated-model-parallel-deep-learning/

og:description

Posted by Zhuohan Li, Student Researcher, Google Research, and Yu Emma Wang, Senior Software Engineer, Google Core Update — 2022/05/06: This pos...

og:image

https://storage.googleapis.com/gweb-research2023-media/images/a15e24d606e2527e18c149083a86d16b-i.width-800.format-jpeg.jpg

og:image:secure_url

https://storage.googleapis.com/gweb-research2023-media/images/a15e24d606e2527e18c149083a86d16b-i.width-800.format-jpeg.jpg

canonical

https://research.google/blog/alpa-automated-model-parallel-deep-learning/

icon

https://www.gstatic.com/images/branding/googleg_gradient/1x/googleg_gradient_standard_20dp.png

preconnect

https://fonts.googleapis.com

preconnect

https://fonts.gstatic.com

preload

https://fonts.googleapis.com/css2?family=Product+Sans&family=Google+Sans+Display:ital@0;1&family=Google+Sans:ital,wght@0,400;0,500;0,700;1,400;1,500;1,700&family=Google+Sans+Text:ital,wght@0,400;0,500;0,700;1,400;1,500;1,700&display=swap