#306 Oriol Vinyals: Deep Learning and Artificial General Intelligence

Published: July 26, 2022, 4:17 p.m.

Oriol Vinyals is the Research Director and Deep Learning Lead at DeepMind. Please support this podcast by checking out our sponsors:
\n- Shopify: https://shopify.com/lex to get 14-day free trial
\n- Weights & Biases: https://lexfridman.com/wnb
\n- Magic Spoon: https://magicspoon.com/lex and use code LEX to get $5 off
\n- Blinkist: https://blinkist.com/lex and use code LEX to get 25% off premium
\n
\nEPISODE LINKS:
\nOriol's Twitter: https://twitter.com/oriolvinyalsml
\nOriol's publications: https://scholar.google.com/citations?user=NkzyCvUAAAAJ
\nDeepMind's Twitter: https://twitter.com/DeepMind
\nDeepMind's Instagram: https://instagram.com/deepmind
\nDeepMind's Website: https://deepmind.com
\nPapers:
\n1. Gato: https://deepmind.com/publications/a-generalist-agent
\n2. Flamingo: https://deepmind.com/blog/tackling-multiple-tasks-with-a-single-visual-language-model
\n3. Language Models are Few-Shot Learners: https://arxiv.org/abs/2005.14165
\n4. Emergent Abilities of Large Language Models: https://arxiv.org/abs/2206.07682
\n5. Attention Is All You Need: https://proceedings.neurips.cc/paper/2017/file/3f5ee243547dee91fbd053c1c4a845aa-Paper.pdf
\n
\nPODCAST INFO:
\nPodcast website: https://lexfridman.com/podcast
\nApple Podcasts: https://apple.co/2lwqZIr
\nSpotify: https://spoti.fi/2nEwCF8
\nRSS: https://lexfridman.com/feed/podcast/
\nYouTube Full Episodes: https://youtube.com/lexfridman
\nYouTube Clips: https://youtube.com/lexclips
\n
\nSUPPORT & CONNECT:
\n- Check out the sponsors above, it's the best way to support this podcast
\n- Support on Patreon: https://www.patreon.com/lexfridman
\n- Twitter: https://twitter.com/lexfridman
\n- Instagram: https://www.instagram.com/lexfridman
\n- LinkedIn: https://www.linkedin.com/in/lexfridman
\n- Facebook: https://www.facebook.com/lexfridman
\n- Medium: https://medium.com/@lexfridman
\n
\nOUTLINE:
\nHere's the timestamps for the episode. On some podcast players you should be able to click the timestamp to jump to that time.
\n(00:00) - Introduction
\n(05:18) - AI
\n(20:14) - Weights
\n(26:33) - Gato
\n(1:01:22) - Meta learning
\n(1:15:21) - Neural networks
\n(1:37:46) - Emergence
\n(1:44:30) - AI sentience
\n(2:08:27) - AGI