What this covers
Charles Simon presents a structural argument about how the brain stores and processes knowledge, grounded in neuroscience but aimed at redirecting AI design. The video proposes that the neocortex operates as a biological graph processor rather than as a statistical engine like modern neural networks. Its central claim is that cortical columns—the brain's repeating microarchitecture, each roughly 100 neurons—function as nodes in a graph, where relationships between concepts (is-a, has-a, part-of) are wired in from birth and refined through experience rather than learned through gradient descent. Simon argues that this graph-based approach solves fundamental problems: it handles inheritance naturally (Fido inherits the property "has fur" from being a dog) and accommodates exceptions without retraining (Stubby lacks a tail despite being a dog). The video sets this against the background that the neocortex is composed of millions of nearly identical columns that specialize only based on their input signals, suggesting a single repeated general-purpose module underlies all cortical function.
The substantive disagreement centers on how knowledge is best represented in silicon. Simon contends that artificial neural networks, by assuming smooth statistical gradients and uniform layers, cannot achieve reasoning, explain concepts, or handle exceptions the way a graph model does—a claim he frames as essential to building AI that genuinely understands rather than merely recognizes patterns. He also emphasizes efficiency: the brain runs on 20 watts and demonstrates understanding far beyond current systems, a difference he attributes to architectural principle rather than brute force. The video explores how a tiny number of AND-gates and pre-existing synaptic scaffolding can encode relationships, and how bidirectional links enable both forward retrieval (activate Fido, retrieve its attributes) and backward search (activate dog, find all instances). Charles Simon acknowledges this remains a fringe position within neuroscience and AI, but presents it as the necessary direction if the field wants to build systems that think rather than predict.
Simon argues that the brain stores knowledge not as a statistical engine but as a biological graph processor in which each near-identical cortical column functions as a node with structured, inheritable relationships, and that AI must adopt this wired-in graph structure rather than layered weights to achieve genuine understanding.
- The neocortex is built from millions of nearly uniform cortical columns that all start with the same circuitry and specialize based on input
- Each column can act as a graph node (~100 neurons) with in/out neurons and AND-gates encoding 'is-a'/'has-a' relationships with inheritance and exceptions
- Modern artificial neural networks assume smooth statistical gradients and cannot reason, handle exceptions, or explain concepts the way a graph model can
This asset isn't compiled yet
You're seeing its claims, ranked. Compile it to build the argument threads, weight them, and check each claim against your library — the full view.
Knowledge can be represented as a graph of relationships with inheritance and exceptions, such that 'Fido is a dog' lets Fido inherit 'has fur' on the fly, while an exception (Stubby has no tail despite dogs having tails) overrides just that one attribute, enabling enormous compression of information.
“if a dog has fur, then phto inherits the has fur attribute on the fly. But if stubby is a dog and dogs have tails, yet Stubby has no tail, the exception overrides just that attribute.”
If we want to build AI that actually thinks, we need to stop layering up weights and start wiring in structure, because today's AI lacks understanding, generalization, and common sense precisely because it does not represent knowledge as a graph of concepts and relationships.
“If we want to build AI that actually thinks, we need to stop layering up weights and start wiring in structure.”
The brain runs on just 20 watts yet shows understanding and common sense far beyond today's AI systems.
“Your brain runs on just 20 watts, yet it shows understanding and common sense far beyond today's AI systems.”
The brain works not as a statistical engine but as a biological graph processor where concepts are nodes and relationships are precise structured connections, which is the only plausible way the brain could store knowledge.
“The brain works not as a statistical engine but as a biological graph processor where concepts are nodes and relationships are precise structured connections”
The neocortex is composed of millions of nearly uniform repeating structures called cortical columns that all start with the same circuitry, and they specialize (e.g., visual cortex tuning to edges/colors, prefrontal cortex to planning) based on the signals they receive, implying the cortex is built from a single repeated general-purpose module.
“The Neoortex consists of millions of repeating structures called cortical columns. These aren't identical, but they're close.”
Modern artificial neural networks and predictive coding models assume smooth gradients, statistical functions, and uniform layers, and while good at pattern recognition, they fall short at reasoning, understanding exceptions, or explaining concepts—partly because biological neurons are too slow to operate that way.
“Modern artificial neural networks or even predictive coding models assume smooth gradients, statistical functions, and uniform layers. They can do impressive things like pattern recognition, but they fall short when you ask them to reason, understand exceptions, or explain concepts.”
Each cortical column functions like a node in a graph, with connections representing relationships (is-a, has-a, part-of) that support inheritance, exceptions, and bidirectional links, giving the brain meaningful symbolic reasoning that today's artificial neural networks cannot do.
“Each cortical column functions like a node in a graph.”
A cortical column needs only about 100 neurons because that is enough for input/output neurons, a dozen or so AND-gates, and supporting functions, which implies most of the brain's neurons are not there for brute-force learning but are scaffolding waiting to be given meaning through experience.
“It explains why columns need only about a 100 neurons. That's enough for input output a dozen or so andgates and the other functions I mentioned.”
Learning a relationship in the brain occurs by selectively strengthening a tiny subset of pre-existing near-zero-weight synapses (e.g., from the 'is-a' column to an AND-gate in the Fido column and from that gate to the 'dog' output neuron), so the physical structure is already in place and learning just activates it.
“Meaning is created by selectively strengthening a tiny subset of synapses. The physical structure is already in place and learning just activates it.”
The brain has three major parts: the brain stem managing vital functions like heartbeat and breathing, the cerebellum handling coordination and motor learning, and the neocortex where conscious thought, planning, and reasoning happen.
“The brain stem, which keeps us alive by managing things like heartbeat and breathing. the cerebellum which handles coordination and motor learning and at the top the neoortex where conscious thought planning and reasoning happen.”
Bidirectional links allow the model to activate Fido and retrieve all dog attributes (unless overridden by exceptions), and also to activate 'dog' and discover its instances like Fido, by strengthening a mirror connection with the relationship type 'is instance of'.
“if phto was a dog, we can activate phto and retrieve all the attributes of dogs unless there's an exception. And we can also activate dog and discover its instances like pho.”
In computer simulations of this model, connections are represented as a few numbers in an array, so the lateral-versus-white-matter distinction between short and long connections need not be made and all connections are treated as lateral.
“In our computer simulations, connections are represented by a few numbers in an array. So we don't need to make this distinction and we treat all connections as lateral.”