BROADCASTS.com

Natural language processing expert and PhD student Melanie Subbiah sits down with Jon Krohn to discuss GPT-3, its strengths and weaknesses, and the future of NLP.\n\nIn this episode you will learn:\n\nWhat is GPT-3? [6:24]\n\nThe strengths and weaknesses of GPT-3 [14:38]\n\nWhat is autoregression? [18:03]\n\nGPT-3's new fine-tuning abilities [20:02]\n\nBias issues with GPT-3 [22:47]\n\nThe future of natural language processing models [27:54]\n\nHow Melanie ended up working at OpenAI [38:13]\n\nMelanie\u2019s self-study process [42:19]\n\nMelanie's work on OpenAI API [45:45]\n\nHow to address the climate change and bias issues that cloud discussions of large natural language models [49:40]\n\nWhy Melanie chose to do a PhD at Columbia University [1:01:17]\n\nThe machine learning tools Melanie\u2019s most excited about [1:08:09]\n\n\nAdditional materials: www.superdatascience.com/559