Podcasts Technology The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) Single Headed Attention RNN: Stop Thinking With Your Head with Stephen Merity - #325

Single Headed Attention RNN: Stop Thinking With Your Head with Stephen Merity - #325

Published: Dec. 12, 2019, 7:04 p.m.

b'Today we\\u2019re joined by Stephen Merity, an independent researcher focused on NLP and Deep Learning. In our conversation, we discuss Stephens latest paper, Single Headed Attention RNN: Stop Thinking With Your Head, detailing his primary motivations behind the paper, the decision to use SHA-RNNs for this research, how he built and trained the model, his approach to benchmarking, and finally his goals for the research in the broader research community.'