E53: The AI Revolution in Education with Shawn Jansepar, Director of Engineering at Khan Academy

Published: Aug. 15, 2023, 7 a.m.

In this episode, Nathan sits down with Shawn Jansepar, Director of Engineering at Khan Academy, to discuss their GPT-4 powered Socratic tutor, Khanmigo. In this conversation, Shawn and Nathan chat about Khan Academy\u2019s collaboration with OpenAI and how they helped fine-tune GPT-4, how Khan Academy leveraged GPT-4 to build Khanmigo, and the impact of providing access to an AI tutor to any student. If you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive\n\nWe're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com.\n\nTIMESTAMPS:\n(00:00) Episode Preview: Education 10 years from now\n(04:42) Khan Academy\u2019s early access partnership with OpenAI\n(06:31) Khanmigo: journey from Chrome extension to AI tutor\n(11:36) GPT-4\u2019s ability to be Socratic vs 3.5\n(15:05) Sponsors: Netsuite | Omneky\n(16:40) Integrating Khan Academy\u2019s Pedagogy into AI\n(20:06) The future of education 10 years from now\xa0\n(22:37) Khan Academy\u2019s models\n(27:20) Demo-driven development process\n(31:16) Sculpting the behaviour of a Socratic tutor model\xa0\n(35:59) Khan Academy\u2019s contribution to GPT-4\u2019s fine-tuning and RLHF\n(38:41) Being data-informed vs data-driven as a practice\xa0\n(42:10) Incurring tech debt to get ahead of the curve\n(45:28) The boundary for what an AI can/can\u2019t t tutor\xa0\n(49:30) Identifying when the user is confused and avoiding AI hallucinations\n(53:54) Khanmigo\u2019s development patterns\xa0\n(59:11) Making Khanmigo jailbreak resistant\xa0\n(01:01:50) Delivering personalized education with AI\xa0\n(01:04:08) How Shawn and his team are thinking about AI education\n(01:05:33) Khanmigo\u2019s future multimodal interactivity\n(01:08:42) Evaluating Khanmigo\u2019s efficacy for student learning\xa0\n(01:11:41) How widely is Khanmigo deployed today and what is the future for universal public access?\n(01:05:11) Distribution through teachers and districts\n(01:16:30) What are the reactions from teachers and education institutions to AI?\n(01:18:15) Khanmigo\u2019s pricing model\n(01:19:03) The future roadmap for Khanmigo\n(01:20:45) How will the AI tutor change the world at large?\n\nLINKS:\nKhanmigo: khan.co/khanmigo23\nBenjamin Bloom\u2019s 2-Sigma Problem: https://web.mit.edu/5.95/www/readings/bloom-two-sigma.pdf\n\nX/TWITTER:\n@shawnjan8 (Shawn)\n@labenz (Nathan)\n@eriktorenberg\n@CogRev_Podcast\n\nSPONSORS: Shopify | NetSuite | Omneky\nShopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system \u2013 wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts \u2013 from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive\n\nNetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform \u2705 head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist.\n\nOmneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off.