The Defeat of the Winograd Schema Challenge
Data Skeptic
English - September 11, 2023 13:33 - 31 minutes - 36 MB - ★★★★★ - 477 ratingsScience Technology machinelearning skepticism datamining datascience science statistics Homepage Download Apple Podcasts Google Podcasts Overcast Castro Pocket Casts RSS feed
Previous Episode: LLMs in Social Science
Next Episode: LLMs for Evil
Our guest today is Vid Kocijan, a Machine Learning Engineer at Kumo AI. Vid has a Ph.D. in Computer Science at the University of Oxford. His research focused on common sense reasoning, pre-training in LLMs, pretraining in knowledge-based completion, and how these pre-trainings impact societal bias. He joins us to discuss how he built a BERT model that solved the Winograd Schema Challenge.