February 2025
The Brain Builds Reality: Notes From Oliver Sacks
What happens when the machinery of perception breaks reveals how much of what we call reality is construction. Neurological case studies, identity, and what broken brains teach us about ordinary ones.
The Cases
The Man Who Mistook His Wife for a Hat is a collection of clinical tales by the neurologist Oliver Sacks, and the title is literal: one of his patients had visual agnosia, a condition where the brain can see shapes and colours but cannot assemble them into recognition. The man could describe the features of a glove but not recognise it as a glove. He looked at his wife's head and, asked to describe what he saw, reached for it as if it were a hat he might put on. He wasn't crazy. Every individual component of his perception worked. The binding was broken.
The book is full of cases like this, and each one is a window into a piece of machinery you didn't know you had. A woman who lost proprioception, the sense of where your body is in space, and had to relearn movement by watching her own limbs. A man with severe amnesia who believed he was still nineteen years old, trapped in a single moment that kept replaying. Patients with phantom limbs, feeling pain in arms that no longer existed, because the brain's map of the body hadn't updated. None of these are exotic illnesses. They're the ordinary machinery of the mind, made visible by its failure.
Reality Is Constructed, Not Received
The thing that rearranged my thinking is how much of what I experience as "reality" is construction. I had assumed, without ever stating it, that perception works like a camera: light comes in, the brain records it, done. Sacks shows that it works more like an editor: fragments arrive, and the brain assembles them into a coherent story so smoothly that the assembly is invisible. You only notice it when it breaks. The man who mistook his wife for a hat had working eyes. What he'd lost was the assembler.
The same applies to identity. The amnesic patient stuck at nineteen had a self, in some sense. He had personality, preferences, a sense of humour. What he lacked was narrative continuity, the ability to add new chapters. And yet his mind improvised: he filled gaps with confabulation, inventing plausible explanations for why things were the way they were, because a brain that can't explain itself is unbearable. The stories we tell about ourselves are not optional decoration. They're load-bearing.
I think about this constantly in the context of building things for people. Every user of anything is a person whose experience of the product is being constructed by the same editing machinery. What they remember isn't what happened, it's the story their brain assembled from fragments. Complaints, praise, feedback, it all arrives pre-edited. The job of a builder, in some deep sense, is to give the editor good material.
Sacks as a Writer, Not Just a Doctor
A third of what I took from this book has nothing to do with neurology. Sacks writes about his patients with a warmth that clinical literature usually filters out. He's interested in their lives, their music, their gardening, their inner worlds. The conditions are never the point; the people are. That's rare in any technical writing, and it's a craft lesson I've tried to absorb: you can be rigorous and human at the same time. The rigour lives in the observations, the humanity in how you treat the subject. Neither is a substitute for the other.
There's a humility to it too. Sacks regularly admits what he doesn't understand, what the cases suggest without resolving, where medicine stops and mystery continues. In a field that rewards certainty, he made uncertainty sound like intellectual honesty rather than weakness. For someone who builds things and constantly pretends to know more than I do, that was a useful mirror.
Questions I'm Still Carrying
- If perception is an editor assembling fragments, what fragments are the people I disagree with working from? How much of any disagreement is just two different edits of the same underlying material?
- Confabulation is the brain inventing explanations to fill gaps. How do I distinguish my genuine reasoning from my confabulation, given that both feel identical from the inside?
- The amnesic patient had a self without a past. How much of what I call "me" is just accumulated narrative, and what remains if you strip the story away?
- Sacks treated cases as windows into normal function. What are the equivalent broken cases for understanding how users experience software? What breaks in usability that reveals how normal usage actually works?
- If memory is reconstruction rather than playback, what am I actually optimising when I try to remember something accurately? Is the goal fidelity, or is the goal a story that serves the present?