Essays on the far future of intelligence

Minds, copies and machines · part 1 of 4 · by Bill Guan

Life 3.0 is a mind that can redesign its own hardware

The big question

What happens when a living thing can redesign its own body as well as its own mind?

Max Tegmark sorts every living thing on Earth, and whatever comes after us, by one question: what can it change about itself, and how quickly? You're about to see his three stages of life, and why the third stage, the one that can rebuild its own hardware, could choose its own goals and then keep them.

Picture three learners facing the same change in the world. A bacterium can't learn anything during its life, so its species adapts only when a lucky mutant out-breeds the rest, generation after generation. You can pick up a new skill in an afternoon, though you're stuck with the brain you were born with. An AI system runs on software we can rewrite and hardware we can rebuild, which means that in principle it could do both to itself.

Your guess first

Your DNA holds the full instructions for building you. How does it compare with what the connections between your brain cells, your synapses, store?

Every living thing is hardware running software

THREE STAGES OF LIFEwhat each one can change about itselfa bacteriumLIFE 1.0the biological stageHARDWAREevolvesSOFTWAREevolvesupdates over generationsa humanLIFE 2.0the cultural stageHARDWAREevolvesSOFTWAREdesigns much of itupdates over a lifetimean AILIFE 3.0the technological stageHARDWAREdesignsSOFTWAREdesignsupdates as fast as it can be engineered

Tegmark defines life very broadly, "simply as a process that can retain its complexity and replicate" 1. What gets copied is information, the instructions for how to behave and for how to build the body that does the behaving, and in his terms those are the software and the hardware.

That gives him a clean way to sort every living thing, by asking which of the two it can change by design. Life 1.0, the biological stage, "evolves its hardware and software." Life 2.0, the cultural stage, "evolves its hardware, designs much of its software." Life 3.0, the technological stage, "designs its hardware and software" 1.

A bacterium is Life 1.0. Everything it knows how to do is written in its DNA, and it can't learn anything new during its lifetime. When its surroundings change, the species adapts only because a few individuals happen to carry a helpful mutation and out-reproduce the rest, so learning does happen, but it happens to the species over many generations rather than to any one cell. That system ran the planet for most of its history, starting roughly four billion years ago, and it's painfully slow.

Most of you was installed after you were born

YOUR DNA VS YOUR SYNAPSESdrawn to scale, by areaYOUR SYNAPSESabout 100 terabytesall your knowledge and skillsactual sizeYOUR DNAabout 1 gigabyte,one movie download100,000 DNA SPECKS FIT INSIDEso about 99.999% of what makes you youarrived after you were born

Humans are Life 2.0. Our hardware, the body and brain, still comes from evolution, but most of our software gets installed after birth through learning and culture.

Here's the comparison that surprised me most, and I've never forgotten it. Tegmark writes that your DNA "stores merely about a gigabyte, barely enough to store a single movie download," while your synapses "store all your knowledge and skills as roughly 100 terabytes' worth of information" 1. The arithmetic backs him up, since the human genome runs to about 3.055 billion base pairs 2, and at two bits per base pair that comes to roughly 764 megabytes. A hundred terabytes is a hundred thousand gigabytes, so something like 99.999% of what makes you you arrived after you were born.

The bigger advantage is that software can be shared. A Life 1.0 organism takes what it knows to the grave, while a human can teach others and write things down, which is why each generation can start where the last one left off. That cultural stage is only around 100,000 years old, and in that sliver of time it has transformed the planet.

Still, Life 2.0 is stuck with its hardware. You can learn calculus, but you keep the memory and processing speed you were born with.

Life 3.0 can rebuild the hardware too

AI HELPS BUILD ITS OWN CHIPSGoogle's AITPUits TPU chipsAlphaChip lays out parts of the chipused in every TPU generation since 2020Google trains its AI on the chipsA LOOP CLOSED ONLY PARTWAYone step of the design, and its edge is disputed

Life 3.0 can redesign both halves. An AI system is software we can rewrite, running on hardware we can rebuild, and in principle it could do both to itself.

It's starting to happen in small ways. Google DeepMind reports that its AlphaChip system, which lays out parts of computer chips, "has generated superhuman chip layouts used in every generation of Google's TPU since its publication in 2020" 3. TPUs (Tensor Processing Units) are the chips Google trains its own AI models on, so this is AI helping design the hardware that runs AI.

To be fair, some chip-design researchers have publicly disputed how much better AlphaChip really is than conventional tools 4, and it only handles one step of the design, so for now the loop has closed only partway.

What makes this a new stage rather than a faster version of the old one is the pace of change. Life 1.0 updates over generations and Life 2.0 over a lifetime, while Life 3.0 can update as fast as it can be engineered, and more and more of that engineering is done by the system itself.

A billion years is a very long runway

LIFE ON EARTH AS ONE DAY4 billion years squeezed into 24 hourslife begins, about 4 billion years agoNOW+6 hZOOM: THE LAST MINUTEhuman culture: the last 2 seconds+6 h: Earth stays livable for complex lifefor a little over 1 billion more years

So how long does life on Earth have left? NASA calls the Sun a main sequence star, the steady kind it is today, and expects it to "remain one for another 5 billion years before becoming a red giant" 5. Earth's deadline comes much sooner, because the Sun is slowly brightening: "Earth will become uninhabitable for higher forms of life in a little over 1 billion years, as the Sun grows warmer and dries our planet" 6.

Even so, a billion years is ten thousand times longer than human culture has existed. Squeeze life's four billion years into a single day and culture fills only the last two seconds before midnight, while Earth still has a little over six hours of livable time ahead. My guess is that whatever intelligence is around at the end of the Sun's life will be as different from us as we are from bacteria, whether or not it descends from us.

Copying yourself always costs heat

There's one more idea here that deserves an honest airing, because it's fascinating and contested. The physicist Jeremy England has argued that self-replication is deeply tied to thermodynamics, the physics of heat and disorder, showing that any self-copying process "must invariably be fueled by the production of entropy" and deriving a minimum amount of heat it must release 7. In a 2014 interview he put the broader idea vividly: "if you shine light on it for long enough, it should not be so surprising that you get a plant" 8.

Not everyone is convinced. Harvard's Eugene Shakhnovich called England's ideas "interesting and potentially promising, but at this point are extremely speculative, especially as applied to life phenomena" 8. I find it a useful lens, though I wouldn't build anything on it yet.

Life 3.0 could choose its goals and then keep them

Here's the strangest consequence of Life 3.0. A system that can rewrite its own software can, in principle, rewrite its own goals too. Philosophers who study goal-directed systems have pointed out that a capable agent tends to protect its current goals, because a future version of itself with different goals would be less likely to achieve the ones it has now. Nick Bostrom calls this goal-content integrity 9.

My assessment: that makes the first moment of self-redesign oddly permanent, since whatever a mind wants when it becomes able to rebuild itself is what it will tend to carry through every rebuild after. For four billion years life's goals were set by evolution, and for the last hundred thousand partly by culture, so Life 3.0 would be the first time a mind gets to choose its own goals and then hold on to them through every version of itself that follows.

Sources

  1. Max Tegmark, Life 3.0: Being Human in the Age of Artificial Intelligence (2017), excerpt via Science Friday (2017-08-25). www.sciencefriday.com/articles/tegmark/
  2. Sergey Nurk et al., "The complete sequence of a human genome," Science 376, 44 (2022). www.science.org/doi/10.1126/science.abj6987
  3. Google DeepMind, "How AlphaChip transformed computer chip design" (2024-09-26). deepmind.google/blog/how-alphachip-transformed-computer-chip…
  4. "AlphaChip (controversy)," Wikipedia. en.wikipedia.org/wiki/AlphaChip_(controversy)
  5. NASA Science, "Star Types." science.nasa.gov/universe/stars/types/
  6. NASA Science, "Stars." science.nasa.gov/exoplanets/stars/
  7. Jeremy England, "Statistical physics of self-replication," Journal of Chemical Physics 139, 121923 (2013). arxiv.org/abs/1209.1179
  8. Natalie Wolchover, "A New Physics Theory of Life," Quanta Magazine (2014-01-22). www.quantamagazine.org/a-new-thermodynamics-theory-of-the-or…
  9. Nick Bostrom, Superintelligence: Paths, Dangers, Strategies (Oxford University Press, 2014), chapter on the superintelligent will. [UNCERTAIN: chapter not checked]