Single Headed Attention RNN: Stop Thinking With Your Head with Stephen Merity - #325

Previous Episode: Automated Model Tuning with SigOpt - #324

Next Episode: Metaflow, a Human-Centric Framework for Data Science with Ville Tuulos - #326

Today we’re joined by Stephen Merity, an independent researcher focused on NLP and Deep Learning. In our conversation, we discuss Stephens latest paper, Single Headed Attention RNN: Stop Thinking With Your Head, detailing his primary motivations behind the paper, the decision to use SHA-RNNs for this research, how he built and trained the model, his approach to benchmarking, and finally his goals for the research in the broader research community.

Single Headed Attention RNN: Stop Thinking With Your Head with Stephen Merity - #325

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)