49. Nvidia A100, Training Game AI, Neural Networks | AI Developer Interview

Broken Silicon

English - May 20, 2020 13:00 - 1 hour - 172 MB - ★★★★★ - 255 ratings
Technology Homepage Download Apple Podcasts Google Podcasts Overcast Castro Pocket Casts RSS feed

Previous Episode: 48. Nvidia Ampere GA100, AMD AM4 Support, Intel 10nm++ | Too Many Leaks!

Next Episode: 50. AMD Matisse 2 v Comet Lake, Unreal Engine 5 v Fanboys | A Tale of Two Flame Wars

Hot off the heels of the announcement of Nvidia A100, we have an AI Developer on to talk about what these massive GPU’s are actually used for – AI & ML applications.

SPONSOR: https://www.cdkoffers.com
25% Windows Code discount: brokensilicon
3% off all software: dieshrink
Win10 pro oem key 13$: https://bit.ly/2Wdfghh
Win10 Home oem key 10$: https://bit.ly/3dsbSFi
Office 2016 key 27$: https://bit.ly/2Wb3sMx
Office 2019 key 44$: https://bit.ly/2WdfBAz
Win10 pro oem+Office 2016 35$: https://bit.ly/3bkJeVb

1) 1:21 AI Buzzwords & Introductions (some sound issues)
2) 6:03 What is a Neural Network?
3) 12:53 Challenges in Training Neural Networks
4) 16:21 Sparsity and Pruning
5) 24:03 How will AI Improve our Lives?
6) 35:42 Bottlenecks to AI Research
7) 42:03 AI & ML in Gaming
8) 47:38 CUDA Intrenchment, AMD’s ability to enter the market
9) 50:58 Cerebras & Graphcore
10) 55:53 AMD vs Nvidia Graphics
11) 1:03:13 Comparing Synthetic AI to Biological Brains

https://www.thispersondoesnotexist.com/
https://devblogs.nvidia.com/nvidia-ampere-architecture-in-depth/
https://www.cerebras.net/cerebras-wafer-scale-engine-why-we-need-big-chips-for-deep-learning/
https://cirrascale.com/graphcore-cloud.php?utm_term=graphcore&utm_source=adwords&utm_medium=ppc&utm_campaign=Graphcore&hsa_net=adwords&hsa_grp=86815837387&hsa_mt=p&hsa_tgt=kwd-606839681642&hsa_kw=graphcore&hsa_src=g&hsa_acc=2793442874&hsa_cam=8112712212&hsa_ver=3&hsa_ad=397149594120&gclid=CjwKCAjwwYP2BRBGEiwAkoBpAuc9L_R5wt9rbYuJ7jeopg5W5YdYxaFBkNVpQz336TjcNJYg9jyZ2BoCX0MQAvD_BwE
https://arxiv.org/pdf/1803.03635.pdf
https://arxiv.org/pdf/1807.01281.pdf
https://podcasts.google.com/feed/aHR0cHM6Ly9jaGFuZ2Vsb2cuY29tL3ByYWN0aWNhbGFpL2ZlZWQ/episode/Y2hhbmdlbG9nLmNvbS83LzcwNA?hl=en&ved=2ahUKEwiuzYfG_7jpAhUIHs0KHSavAhAQjrkEegQIBxAE&ep=6
https://twimlai.com/upside-down-reinforcement-learning/?fbclid=IwAR18e99xWPGUN0_SVG84IKUaT5KYSKVhzwMdq37goiOdDwRuUf8s9Z_8GSI
https://en.wikipedia.org/wiki/Reinforcement_learning
https://en.wikipedia.org/wiki/Concept_learning
https://en.wikipedia.org/wiki/Unsupervised_learning#cite_note-2
https://arxiv.org/abs/1912.02875
https://arxiv.org/pdf/1912.02877.pdf
https://www.alexirpan.com/2018/02/14/rl-hard.html
https://www.microsoft.com/en-us/research/blog/turing-nlg-a-17-billion-parameter-language-model-by-microsoft/
https://ai.facebook.com/blog/state-of-the-art-open-source-chatbot/
https://openai.com/blog/jukebox/
https://www.pnas.org/content/pnas/116/43/21854.full.pdf