Innovating Neural Machine Translation with Arul Menezes - #458

Published: Feb. 22, 2021, 8:11 p.m.

b'Today we\\u2019re joined by Arul Menezes, a Distinguished Engineer at Microsoft.\\xa0\\n Arul, a 30 year veteran of Microsoft, manages the machine translation research and products in the Azure Cognitive Services group. In our conversation, we explore the historical evolution of machine translation like breakthroughs in seq2seq and the emergence of transformer models.\\xa0\\n We also discuss how they\\u2019re using multilingual transfer learning and combining what they\\u2019ve learned in translation with pre-trained language models like BERT. Finally, we explore what they\\u2019re doing to experience domain-specific improvements in their models, and what excites Arul about the translation architecture going forward.\\xa0\\n The complete show notes for this series can be found at twimlai.com/go/458.'