Whats Next in LLM Reasoning? with Roland Memisevic - #646

Published: Sept. 11, 2023, 6:38 p.m.

b'Today we\\u2019re joined by Roland Memisevic, a senior director at Qualcomm AI Research. In our conversation with Roland, we discuss the significance of language in humanlike AI systems and the advantages and limitations of autoregressive models like Transformers in building them. We cover the current and future role of recurrence in LLM reasoning and the significance of improving grounding in AI\\u2014including the potential of developing a sense of self in agents. Along the way, we discuss Fitness Ally, a fitness coach trained on a visually grounded large language model, which has served as a platform for Roland\\u2019s research into neural reasoning, as well as recent research that explores topics like visual grounding for large language models and state-augmented architectures for AI agents.\\n\\nThe complete show notes for this episode can be found at twimlai.com/go/646.'