title

RoBERTa: An optimized method for pretraining self-supervised NLP systems

charset

utf-8

referrer

origin-when-crossorigin

description

Facebook AI’s RoBERTa is a new training recipe that improves on BERT, Google’s self-supervised method for pretraining natural language processing...

viewport

width=device-width, initial-scale=1

og:image

https://web.archive.org/web/20230303133614im_/https://scontent-hel3-1.xx.fbcdn.net/v/t39.2365-6/55283513_2136407213108244_2180786725628936192_n.jpg?_nc_cat=108&ccb=1-7&_nc_sid=ad8a9d&_nc_ohc=gqZ38QjH4LsAX8irXWO&_nc_ht=scontent-hel3-1.xx&oh=00_AfBaWLZWOwWLm0sF3eKHawE7zWDNm7uf96woqq1n7c_emg&oe=6405EF32

twitter:card

summary

canonical

https://web.archive.org/web/20230303133614/https://ai.facebook.com/blog/roberta-an-optimized-method-for-pretraining-self-supervised-nlp-systems/

preload

https://web.archive.org/web/20230303133614/https://static.xx.fbcdn.net/rsrc.php/v3/yK/l/0,cross/FGmyUZ1U_HP.css?_nc_x=Ij3Wp8lg5Kz

preload

https://web.archive.org/web/20230303133614/https://static.xx.fbcdn.net/rsrc.php/v3/yS/l/0,cross/zyuNDMiCHTO.css?_nc_x=Ij3Wp8lg5Kz

preload

https://web.archive.org/web/20230303133614/https://static.xx.fbcdn.net/rsrc.php/v3/yE/l/0,cross/RspwE1UYLwr.css?_nc_x=Ij3Wp8lg5Kz

preload

https://web.archive.org/web/20230303133614/https://static.xx.fbcdn.net/rsrc.php/v3/ya/l/0,cross/eoXYXhz27gY.css?_nc_x=Ij3Wp8lg5Kz