713: Llama 2, Toolformer and BLOOM: Open-Source LLMs with Meta's Dr. Thomas Scialom

Published: Sept. 12, 2023, 11 a.m.

Artificial General Intelligence, RLHF\u2019s application in AI, and how entrepreneurs can enter the AI industry: Meta\u2019s AI Research Scientist Thomas Scialom gives us behind-the-scenes insights into developing Llama 2 and what\u2019s in the works for Llama 3. With host Jon Krohn, he discusses the future of Artificial General Intelligence, why the Galactica science-focused LLM was taken down, and what he learned from it.This episode is brought to you by AWS Inferentia, by Grafbase, the unified data layer, and by Modelbit, for deploying models in seconds. Interested in sponsoring a SuperDataScience Podcast episode? Visit JonKrohn.com/podcast for sponsorship information.In this episode you will learn:\u2022 Llama 2: Behind the Scenes of Today\u2019s Top Open-Source LLM [05:04]\u2022 Responsible use of Llama 2 [15:26]\u2022 Toolformer: LLM That Learns How to Use External Tools [24:57]\u2022 Galactica: The Science-Specific LLM and Why It Was Brought Down [36:57]\u2022 Is AGI Around the Corner? [57:03]\u2022 Advice for AI entrepreneurs [1:05:46]\u2022 How Thomas develops and manages large-scale AI projects [1:14:42]Additional materials: www.superdatascience.com/713