Robert Lange on NN Pruning and Collective Intelligence

Machine Learning Street Talk (MLST)

English - July 08, 2020 12:27 - 1 hour - 98.1 MB
Technology Homepage Download Google Podcasts Overcast Castro Pocket Casts RSS feed

Previous Episode: WelcomeAIOverlords (Zak Jost)

Next Episode: Sayak Paul

We speak with Robert Lange!

Robert is a PhD student at the Technical University Berlin. His research combines Deep Multi-Agent Reinforcement Learning and Cognitive Science to study the learning dynamics of large collectives. He has a brilliant blog where he distils and explains cutting edge ML research. We spoke about his story, economics, multi-agent RL, intelligence and AGI, and his recent article summarising the state of the art in neural network pruning.

Robert's article on pruning in NNs https://roberttlange.github.io/posts/2020/06/lottery-ticket-hypothesis/

00:00:00 Intro

00:04:17 Show start and intro to Robert

00:11:39 Economics background

00:27:20 Intrinsic motivation

00:33:22 Intelligence/consciousness

00:48:16 Lottery ticket/pruning article discussion

01:43:21 Robert's advice for younger self and state of deep learning

Robert's LinkedIn: https://www.linkedin.com/in/robert-tjarko-lange-19539a12a/

@RobertTLange

#machinelearning #deeplearning