#82 - Dr. JOSCHA BACH - Digital Physics, DL and Consciousness [UNPLUGGED]
Machine Learning Street Talk (MLST)
English - November 27, 2022 20:31 - 1 hour - 103 MBTechnology Homepage Download Google Podcasts Overcast Castro Pocket Casts RSS feed
AI Helps Ukraine - Charity Conference
A charity conference on AI to raise funds for medical and humanitarian aid for Ukraine
https://aihelpsukraine.cc/
YT version: https://youtu.be/LgwjcqhkOA4
Support us!
https://www.patreon.com/mlst
Dr. Joscha Bach (born 1973 in Weimar, Germany) is a German artificial intelligence researcher and cognitive scientist focusing on cognitive architectures, mental representation, emotion, social modelling, and multi-agent systems.
http://bach.ai/
https://twitter.com/plinz
TOC:
[00:00:00] Ukraine Charity Conference and NeurIPS 2022
[00:03:40] Theory of computation, Godel, Penrose
[00:11:44] Modelling physical reality
[00:15:19] Is our universe infinite?
[00:24:30] Large language models, and on DL / is Gary Marcus hitting a wall?
[00:45:17] Generative models / Codex / Language of thought
[00:58:46] Consciousness (with Friston references)
References:
Am I Self-Conscious? (Or Does Self-Organization Entail Self-Consciousness?) [Friston]
https://www.frontiersin.org/articles/10.3389/fpsyg.2018.00579/full
Impact of Pretraining Term Frequencies on Few-Shot Reasoning [Yasaman Razeghi]
https://arxiv.org/abs/2202.07206
Deep Learning Is Hitting a Wall [Gary Marcus]
https://nautil.us/deep-learning-is-hitting-a-wall-238440/
Turing machines
https://en.wikipedia.org/wiki/Turing_machine
Lambda Calculus
https://en.wikipedia.org/wiki/Lambda_calculus
Godel's incompletness theorem
https://en.wikipedia.org/wiki/G%C3%B6del%27s_incompleteness_theorems
Oracle machine
https://en.wikipedia.org/wiki/Oracle_machine