Tic-Tac-Toe the Hard Way
10 episodes - English - Latest episode: almost 4 years ago -A writer and a software engineer from Google's People + AI Research team explore the human choices that shape machine learning systems by building competing tic-tac-toe agents.
Homepage Google Podcasts Overcast Castro Pocket Casts RSS feed
Episodes
Lessons learned
July 22, 2020 15:58 - 33 minutes - 75.6 MBWhat have we learned about machine learning and the human decisions that shape it? And is machine learning perhaps changing our minds about how the world outside of machine learning — also known as the world — works? For more information about the show, check out pair.withgoogle.com/thehardway/. You can reach out to the hosts on Twitter: @dweinberger and @tafsiri.
Head to Head: The Even Bigger ML Smackdown!
July 22, 2020 15:55 - 24 minutes - 56 MBYannick and David’s systems play against each other in 500 games. Who’s going to win? And what can we learn about how the ML may be working by thinking about the results? See the agents play each other in Tic-Tac-Two! For more information about the show, check out pair.withgoogle.com/thehardway/. You can reach out to the hosts on Twitter: @dweinberger and @tafsiri.
Enter tic-tac-two
July 22, 2020 15:50 - 21 minutes - 48.9 MBDavid’s variant of tic-tac-toe that we’re calling tic-tac-two is only slightly different but turns out to be far more complex. This requires rethinking what the ML system will need in order to learn how to play, and how to represent that data. For more information about the show, check out pair.withgoogle.com/thehardway/. You can reach out to the hosts on Twitter: @dweinberger and @tafsiri.
Head to Head: the Big ML Smackdown!
July 22, 2020 15:45 - 25 minutes - 58 MBDavid and Yannick’s tic-tac-toe ML agents face-off against each other in tic-tac-toe! See the agents play each other! For more information about the show, check out pair.withgoogle.com/thehardway/. You can reach out to the hosts on Twitter: @dweinberger and @tafsiri.
Give that model a treat! : Reinforcement learning explained
July 22, 2020 15:35 - 26 minutes - 59.7 MBSwitching gears, we focus on how Yannick’s been training his model using reinforcement learning. He explains the differences from David’s supervised learning approach. We find out how his system performs against a player that makes random tic-tac-toe moves. Resources: Deep Learning for JavaScript book Playing Atari with Deep Reinforcement Learning Two Minute Papers episode on Atari DQN For more information about the show, check out pair.withgoogle.com/thehardway/. You can re...
Beating random: What it means to have trained a model
July 22, 2020 15:30 - 17 minutes - 39.5 MBDavid did it! He trained a machine learning model to play tic-tac-toe! (Well, with lots of help from Yannick.) How did the whole training experience go? How do you tell how training went? How did his model do against a player that makes random tic-tac-toe moves? For more information about the show, check out pair.withgoogle.com/thehardway/. You can reach out to the hosts on Twitter: @dweinberger and @tafsiri.
From tic-tac-toe moves to ML model
July 22, 2020 13:55 - 21 minutes - 49.6 MBOnce we have the data we need—thousands of sample games--how do we turn it into something the ML can train itself on? That means understanding how training works, and what a model is. Resources: See a definition of one-hot encoding For more information about the show, check out pair.withgoogle.com/thehardway. You can reach out to the hosts on Twitter: @dweinberger and @tafsiri.
What does a tic-tac-toe board look like to machine learning?
July 22, 2020 13:38 - 23 minutes - 53.7 MBHow should David represent the data needed to train his machine learning system? What does a tic-tac-toe board “look” like to ML? Should he train it on games or on individual boards? How does this decision affect how and how well the machine will learn to play? Plus, an intro to reinforcement learning, the approach Yannick will be taking. For more information about the show, check out pair.withgoogle.com/thehardway. You can reach out to the hosts on Twitter: @dweinberger and @tafs...
Howdy, and the myth of “pouring in data”
July 21, 2020 21:05 - 22 minutes - 50.5 MBWelcome to the podcast! We’re Yannick and David, a software engineer and a non-technical writer. Over the next 9 episodes we’re going to use two different approaches to build machine learning systems that play two versions of tic-tac-toe. Building a machine learning app requires humans making a lot of decisions. We start by agreeing that David will use a “supervised learning” approach while Yannick will go with “reinforcement learning.” For more information about the show, check ou...
Introducing Tic-Tac-Toe the Hard Way
July 21, 2020 20:57 - 2 minutes - 4.99 MBIntroducing the podcast where a writer and a software engineer explore the human choices that shape machine learning systems by building competing tic-tac-toe agents. Brought to you by Google's People + AI Research team. More at: pair.withgoogle.com/thehardway