3 claims in “artificial intelligence, neuroscience”
Artificial neural networks are very different from real biological neurons, and the learning processes in deep learning are very different from biological learning, yet contemporary LLMs have somehow developed extraordinary functionality through large-scale training on massive datasets—a mysterious phenomenon we don't yet understand.
Hinton has changed his mind over recent months about the relationship between brain function and digital AI, now believing they work in fundamentally different ways, particularly with respect to backpropagation
Back propagation is a superior learning algorithm compared to biological brain learning because it can pack vastly more information into fewer connections—large language models with 1 trillion connections contain roughly a thousand times as much knowledge as humans, who have 100 trillion connections