BROADCASTS.com

b"Today we\\u2019re joined by James Zou, an assistant professor at Stanford University. In our conversation with James, we explore the differences in ChatGPT\\u2019s behavior over the last few months. We discuss the issues that can arise from inconsistencies in generative AI models, how he tested ChatGPT\\u2019s performance in various tasks, drawing comparisons between March 2023 and June 2023 for both GPT-3.5 and GPT-4 versions, and the possible reasons behind the declining performance of these models. James also shared his thoughts on how surgical AI editing akin to CRISPR could potentially revolutionize LLM and AI systems, and how adding monitoring tools can help in tracking behavioral changes in these models. Finally, we discuss James' recent paper on pathology image analysis using Twitter data, in which he explores the challenges of obtaining large medical datasets and data collection, as well as detailing the model\\u2019s architecture, training, and the evaluation process.\\n\\nThe complete show notes for this episode can be found at twimlai.com/go/645."