What is the time scale for evolution of complex organisms such as ourselves? On Earth complex life evolved in about 5 billion years (5 Gyr), but one can make an argument that we were probably lucky and that the typical time scale T under similar circumstances is much longer.
There is an interesting coincidence at work: 5 Gyr is remarkably close to the 10 Gyr lifetime of main sequence stars (and to the 14 Gyr age of the universe). This is unexpected, as evolution proceeds by molecular processes and natural selection among complex organisms, whereas stellar lifetimes are determined by nuclear physics.
If T were much smaller than 5 Gyr then it would be improbable for evolution to have been so slow on Earth.
It seems more plausible that T is much larger than 5 Gyr, in which case we were lucky, in a sense I will explain. Inflationary cosmology predicts a very large universe (much larger than what is currently visible to us), so that complex life is likely to exist somewhere in the universe. Conditioning on our own existence (a use of the weak anthropic principle), we should not be surprised to find ourselves lucky -- the few Earth-like planets that manage to evolve life must do so before their suns die. Intelligent beings, while not likely to evolve on any particular Earth-like planet, are likely to observe an evolutionary history that took place over a fraction of 10 Gyr.
Why should T be so large? At present we are unable to make quantitative estimates for the rate of evolution from first principles. It is entirely possible that certain evolutionary steps were highly improbable, such as the appearance of the first self-replicating complex molecules. One can also imagine abstract fitness surfaces with local maxima that trap the system for exponentially long periods of time.
I would not be surprised to find that T is exponentially larger than 5 Gyr. Godel went so far as to propose: "... a mathematical theorem to the effect that the formation within geological times of a human body by the laws of physics (or any other law of a similar nature) starting from a random distribution of the elementary particles and the field, is about as unlikely as the separation by chance of the atmosphere into its components."
The framework described above makes the following predictions:
1. The overwhelming majority of Earth-like planets are devoid of life, thereby resolving the Fermi Paradox.
2. Improved understanding of evolution will uncover highly improbable steps -- that is, improbable even over billions (or perhaps 10^100 !) of years. The fact that life on Earth climbed these steps might suggest intelligent design or divine intervention, but is better explained by the anthropic principle.
See related post evolutionary time scales.
Note added: This idea came to me after reading some discussion of ID and the question of improbable steps in evolution. (Here improbable means, for example, that even in an Earth-size population the multiple simultaneous mutations required jump across a particular fitness valley are unlikely to occur in 5 Gyr given the known mutation rate.) It occurred to me that under certain assumptions what might appear to be ID could actually be due to selection bias -- not taking into account the possibility that complex life is rare even on Earth-like planets. It turns out that the idea is not new -- it goes all the way back to Brandon Carter's 1983 paper which (I believe) coined the term "anthropic principle"! See John D. Barrow and Frank J. Tipler, The Anthropic Cosmological Principle, p. 557 for more. Also see this 1998 paper by Robin Hanson (thanks to a commenter for pointing it out). If one assumes many improbable required steps, one can deduce an upper estimate on the remaining time over which favorable conditions can persist on Earth. Note it appears the remaining lifetime of the sun is less than 1 Gyr, so the coincidence is tighter than I suggested in the original post. As the number of required improbable steps increases the likelihood that we would evolve just before time runs out (favorable conditions end) becomes very high -- this is quantified in the two references above.
The point which I have (still) not seen discussed much is that biologists need not be so defensive about improbable steps in evolution. I sense an almost reflexive -- i.e., prior-driven -- response to any claims of improbability. (On the other hand, perhaps biologists just know more about the details: the claim would be that the historical record does not resemble a typical one that would be generated by a chain of improbable events. I think this question requires further study.) But the main takeaway from this analysis is that improbability does not imply design or intervention.
Pessimism of the Intellect, Optimism of the Will Favorite posts | Manifold podcast | Twitter: @hsu_steve
Subscribe to:
Post Comments (Atom)
Blog Archive
-
▼
2009
(204)
-
▼
10
(18)
- Selectivity of US colleges and returns to elite ed...
- Do flu vaccines work?
- Eric Baum: What is Thought?
- Pessimism of the Intellect, Optimism of the Will
- Evolution, Design and the Fermi Paradox
- Affirmative action: the numbers
- Universe Splitter -- iPhone app
- Posner: How I became a Keynesian
- Efficient Frontier and William Bernstein
- Calvin Trillin on Wall Street smarts
- Signals from the market in Guangzhou
- Skidelsky at LSE
- Spooks drowning in data
- A Nobel for Barry?
- Schrodinger's virus
- More Brainpower and Globalization
- Baidu, baby, Baidu
- Supermassive black holes and the entropy of the un...
-
▼
10
(18)
Labels
- physics (420)
- genetics (325)
- globalization (301)
- genomics (295)
- technology (282)
- brainpower (280)
- finance (275)
- american society (261)
- China (249)
- innovation (231)
- ai (206)
- economics (202)
- psychometrics (190)
- science (172)
- psychology (169)
- machine learning (166)
- biology (163)
- photos (162)
- genetic engineering (150)
- universities (150)
- travel (144)
- podcasts (143)
- higher education (141)
- startups (139)
- human capital (127)
- geopolitics (124)
- credit crisis (115)
- political correctness (108)
- iq (107)
- quantum mechanics (107)
- cognitive science (103)
- autobiographical (97)
- politics (93)
- careers (90)
- bounded rationality (88)
- social science (86)
- history of science (85)
- realpolitik (85)
- statistics (83)
- elitism (81)
- talks (80)
- evolution (79)
- credit crunch (78)
- biotech (76)
- genius (76)
- gilded age (73)
- income inequality (73)
- caltech (68)
- books (64)
- academia (62)
- history (61)
- intellectual history (61)
- MSU (60)
- sci fi (60)
- harvard (58)
- silicon valley (58)
- mma (57)
- mathematics (55)
- education (53)
- video (52)
- kids (51)
- bgi (48)
- black holes (48)
- cdo (45)
- derivatives (43)
- neuroscience (43)
- affirmative action (42)
- behavioral economics (42)
- economic history (42)
- literature (42)
- nuclear weapons (42)
- computing (41)
- jiujitsu (41)
- physical training (40)
- film (39)
- many worlds (39)
- quantum field theory (39)
- expert prediction (37)
- ufc (37)
- bjj (36)
- bubbles (36)
- mortgages (36)
- google (35)
- race relations (35)
- hedge funds (34)
- security (34)
- von Neumann (34)
- meritocracy (31)
- feynman (30)
- quants (30)
- taiwan (30)
- efficient markets (29)
- foo camp (29)
- movies (29)
- sports (29)
- music (28)
- singularity (27)
- entrepreneurs (26)
- conferences (25)
- housing (25)
- obama (25)
- subprime (25)
- venture capital (25)
- berkeley (24)
- epidemics (24)
- war (24)
- wall street (23)
- athletics (22)
- russia (22)
- ultimate fighting (22)
- cds (20)
- internet (20)
- new yorker (20)
- blogging (19)
- japan (19)
- scifoo (19)
- christmas (18)
- dna (18)
- gender (18)
- goldman sachs (18)
- university of oregon (18)
- cold war (17)
- cryptography (17)
- freeman dyson (17)
- smpy (17)
- treasury bailout (17)
- algorithms (16)
- autism (16)
- personality (16)
- privacy (16)
- Fermi problems (15)
- cosmology (15)
- happiness (15)
- height (15)
- india (15)
- oppenheimer (15)
- probability (15)
- social networks (15)
- wwii (15)
- fitness (14)
- government (14)
- les grandes ecoles (14)
- neanderthals (14)
- quantum computers (14)
- blade runner (13)
- chess (13)
- hedonic treadmill (13)
- nsa (13)
- philosophy of mind (13)
- research (13)
- aspergers (12)
- climate change (12)
- harvard society of fellows (12)
- malcolm gladwell (12)
- net worth (12)
- nobel prize (12)
- pseudoscience (12)
- Einstein (11)
- art (11)
- democracy (11)
- entropy (11)
- geeks (11)
- string theory (11)
- television (11)
- Go (10)
- ability (10)
- complexity (10)
- dating (10)
- energy (10)
- football (10)
- france (10)
- italy (10)
- mutants (10)
- nerds (10)
- olympics (10)
- pop culture (10)
- crossfit (9)
- encryption (9)
- eugene (9)
- flynn effect (9)
- james salter (9)
- simulation (9)
- tail risk (9)
- turing test (9)
- alan turing (8)
- alpha (8)
- ashkenazim (8)
- data mining (8)
- determinism (8)
- environmentalism (8)
- games (8)
- keynes (8)
- manhattan (8)
- new york times (8)
- pca (8)
- philip k. dick (8)
- qcd (8)
- real estate (8)
- robot genius (8)
- success (8)
- usain bolt (8)
- Iran (7)
- aig (7)
- basketball (7)
- free will (7)
- fx (7)
- game theory (7)
- hugh everett (7)
- inequality (7)
- information theory (7)
- iraq war (7)
- markets (7)
- paris (7)
- patents (7)
- poker (7)
- teaching (7)
- vietnam war (7)
- volatility (7)
- anthropic principle (6)
- bayes (6)
- class (6)
- drones (6)
- econtalk (6)
- empire (6)
- global warming (6)
- godel (6)
- intellectual property (6)
- nassim taleb (6)
- noam chomsky (6)
- prostitution (6)
- rationality (6)
- academia sinica (5)
- bobby fischer (5)
- demographics (5)
- fake alpha (5)
- kasparov (5)
- luck (5)
- nonlinearity (5)
- perimeter institute (5)
- renaissance technologies (5)
- sad but true (5)
- software development (5)
- solar energy (5)
- warren buffet (5)
- 100m (4)
- Poincare (4)
- assortative mating (4)
- bill gates (4)
- borges (4)
- cambridge uk (4)
- censorship (4)
- charles darwin (4)
- computers (4)
- creativity (4)
- hormones (4)
- humor (4)
- judo (4)
- kerviel (4)
- microsoft (4)
- mixed martial arts (4)
- monsters (4)
- moore's law (4)
- soros (4)
- supercomputers (4)
- trento (4)
- 200m (3)
- babies (3)
- brain drain (3)
- charlie munger (3)
- cheng ting hsu (3)
- chet baker (3)
- correlation (3)
- ecosystems (3)
- equity risk premium (3)
- facebook (3)
- fannie (3)
- feminism (3)
- fst (3)
- intellectual ventures (3)
- jim simons (3)
- language (3)
- lee kwan yew (3)
- lewontin fallacy (3)
- lhc (3)
- magic (3)
- michael lewis (3)
- mit (3)
- nathan myhrvold (3)
- neal stephenson (3)
- olympiads (3)
- path integrals (3)
- risk preference (3)
- search (3)
- sec (3)
- sivs (3)
- society generale (3)
- systemic risk (3)
- thailand (3)
- twitter (3)
- alibaba (2)
- bear stearns (2)
- bruce springsteen (2)
- charles babbage (2)
- cloning (2)
- david mamet (2)
- digital books (2)
- donald mackenzie (2)
- drugs (2)
- dune (2)
- exchange rates (2)
- frauds (2)
- freddie (2)
- gaussian copula (2)
- heinlein (2)
- industrial revolution (2)
- james watson (2)
- ltcm (2)
- mating (2)
- mba (2)
- mccain (2)
- monkeys (2)
- national character (2)
- nicholas metropolis (2)
- no holds barred (2)
- offices (2)
- oligarchs (2)
- palin (2)
- population structure (2)
- prisoner's dilemma (2)
- singapore (2)
- skidelsky (2)
- socgen (2)
- sprints (2)
- star wars (2)
- ussr (2)
- variance (2)
- virtual reality (2)
- war nerd (2)
- abx (1)
- anathem (1)
- andrew lo (1)
- antikythera mechanism (1)
- athens (1)
- atlas shrugged (1)
- ayn rand (1)
- bay area (1)
- beats (1)
- book search (1)
- bunnie huang (1)
- car dealers (1)
- carlos slim (1)
- catastrophe bonds (1)
- cdos (1)
- ces 2008 (1)
- chance (1)
- children (1)
- cochran-harpending (1)
- cpi (1)
- david x. li (1)
- dick cavett (1)
- dolomites (1)
- eharmony (1)
- eliot spitzer (1)
- escorts (1)
- faces (1)
- fads (1)
- favorite posts (1)
- fiber optic cable (1)
- francis crick (1)
- gary brecher (1)
- gizmos (1)
- greece (1)
- greenspan (1)
- hypocrisy (1)
- igon value (1)
- iit (1)
- inflation (1)
- information asymmetry (1)
- iphone (1)
- jack kerouac (1)
- jaynes (1)
- jazz (1)
- jfk (1)
- john dolan (1)
- john kerry (1)
- john paulson (1)
- john searle (1)
- john tierney (1)
- jonathan littell (1)
- las vegas (1)
- lawyers (1)
- lehman auction (1)
- les bienveillantes (1)
- lowell wood (1)
- lse (1)
- machine (1)
- mcgeorge bundy (1)
- mexico (1)
- michael jackson (1)
- mickey rourke (1)
- migration (1)
- money:tech (1)
- myron scholes (1)
- netwon institute (1)
- networks (1)
- newton institute (1)
- nfl (1)
- oliver stone (1)
- phil gramm (1)
- philanthropy (1)
- philip greenspun (1)
- portfolio theory (1)
- power laws (1)
- pyschology (1)
- randomness (1)
- recession (1)
- sales (1)
- skype (1)
- standard deviation (1)
- starship troopers (1)
- students today (1)
- teleportation (1)
- tierney lab blog (1)
- tomonaga (1)
- tyler cowen (1)
- venice (1)
- violence (1)
- virtual meetings (1)
- wealth effect (1)
30 comments:
I actually agree and blogged about this recently. I think the probability of life arising is highly unlikely and the answer to how we could be so lucky is simply because the sample space is much, much bigger than the visible universe (e.g. string theory landscape) so the chance of life occurring somewhere (some time?) is nonzero and like you said we can only condition on our own existence.
We don't need string theory -- inflation is enough, or even many worlds ;-)
10 GYr is the expected lifetime for a star the size of Sun. It's a wide range. A star with half the mass can last 50 GYr or more. A 2M star can last less than a billion years. As far as stars go, Sun is below median.
It appears more probable to me that 5 GYr is the characteristic time it takes for intelligent life to evolve. We could probably come up with some kind of dimensional handwaving argument to justify this number, just like we can use dimensional arguments to calculate characteristic dimensions and velocities of carbon-based intelligent lifeforms.
That puts your argument on its head. We live next to a Sun with a steady-state lifetime of 10 GYr because it takes O(10 GYr) for life to evolve, and not vice versa.
The correct solution of the Fermi Paradox is, of course, technological singularity.
Discussion like this don't provide any acceptable definition of "improbable", hence I believe you're pulling the estimate of plausible T values out of your nether regions.
In fact, to make an analogy, I think you sound just like the econo-physicists who gravely tell us that a 20 standard deviation move in markets is "highly improbable", every time there is a crisis. That is, about every 5 years.
A further thought. Even if T >> 5 GYr, the first intelligent civilization to emerge would be likely to do that on a star that formed shortly after the Big Bang. It is highly unlikely and it requires severe fine-tuning to explain (without resorting to singularity & such) why we're apparently first civilization in the neighborhood, and yet we're on a relatively young star, and there are many stars in our own galaxy that are 5-9 Gyr older than the Sun. For example, Tau Ceti, just 12 light years away, has luminosity 0.52 of solar, and it's two times older than the Sun. Why are we here and not there?
SD Scientist: Early on, there weren't many heavy elements around, so those first stars didn't have rocky planets. Only after the first generation of stars went supernova was there enough iron and carbon and oxygen for life.
5 Gyr is remarkably close to the 10 Gyr lifetime of main sequence stars...
Ha! Only a physicist would call a 5,000,000,000 year difference "close"!
To be fair, Godel didn't believe in evolution. And your argument doesn't make the majority of Earth-like planets "devoid of life", but instead devoid of complex life.
In any case, I don't think the position is necessarily borne out by the geologic record. The Cambrian explosion of complex life happened just about as soon as it could -- after the anaerobic organisms prepared an oxygen-rich atmosphere that could support respiration. As soon as that happened, complex life was more or less instantaneous in the fossil record.
The basic chemistry to prepare that atmosphere doesn't seem wild enough to justify a T "exponentially" greater than 5 Gyr.
Now, as for the initial appearance of life, things are a lot more murky. But the evidence suggests that it happened just about as soon as it could have happened.
I will go on to say that estimating the probability of life appearing is extremely hard. Even if we knew all of the rules governing our universe, it would still be at least NP hard and the question is undecidable if you ask it for all possible (computable) universes since it amounts to solving the halting problem.
"We could probably come up with some kind of dimensional handwaving argument to justify this number, just like we can use dimensional arguments to calculate characteristic dimensions and velocities of carbon-based intelligent lifeforms."
Uh, no, we can't.
"In any case, I don't think the position is necessarily borne out by the geologic record. The Cambrian explosion of complex life happened just about as soon as it could -- after the anaerobic organisms prepared an oxygen-rich atmosphere that could support respiration. As soon as that happened, complex life was more or less instantaneous in the fossil record.
The basic chemistry to prepare that atmosphere doesn't seem wild enough to justify a T "exponentially" greater than 5 Gyr.
Now, as for the initial appearance of life, things are a lot more murky. But the evidence suggests that it happened just about as soon as it could have happened."
It is true that the first replicators appeared pretty fast (within 100 Myr?) after the Earth was formed. If this was one of the improbable steps, and T >> 5 Gyr, the probability per unit time is roughly constant over 100M-timescales, so the record somewhat disfavors this assumption, but not below the few percent level.
What is your 99% confidence interval for T?
What I think is quite hard to grasp is that the first replicators appeared almost as fast as it was possible (that 100My figure), but they appeared only once. Or, at least modern DNA based replicators appeared only once (we'd know if there were other families of RNA compilers, our encoding is quite "arbitrary").
Now, that could be solved by panspermy, that's why I always supported that idea, but can also be explained by extraordinary luck, like you imply we had.
"What is your 99% confidence interval for T?"
It depends on your definition of "Earth-like conditions" of course.
We have three pieces of real evidence:
1) The fossil record, as discussed above.
2) Our biochemical knowledge of life and ourselves.
3) The fact that we haven't found life elsewhere yet.
Two is still expanding and is hard to interpret. Three has a substantial problem: there are a lot more variables in the Fermi equation than T, and any of them could be responsible. What if we're a lot closer to the upper limit of a technological civilization to accomplish things than we realize? What if the exponential trend, "progress," was a short-term, early and mid 20th-century phenomenon?
Regardless, I certainly don't know which variables in the Fermi equation have kept the aliens from turning us into galactic food-beast/slaves yet.
So we're left with 1), the fossil record. And that tells me that life, and complex life, seems to appear quickly whenever the conditions are right.
So T is probably very close to 5 billion years under sufficiently Earth-like conditions. To a high (if not 99%) degree of confidence.
An analysis of exactly what Earth-like conditions are and how likely they are can be as pessimistic as you'd like, however. See the book "Rare Earth."
"But they appeared only once"
Or they appeared a billion times and complex DNA-based life eats the simple replicators for breakfast every time.
Support for the argument? Well, we know that's what happened to whatever the original replicators were. Nothing like that is with us anymore. At one point they should have covered the globe.
"SD Scientist: Early on, there weren't many heavy elements around, so those first stars didn't have rocky planets. Only after the first generation of stars went supernova was there enough iron and carbon and oxygen for life."
That is a good point - however, we didn't have to wait 10 GYr for that. Only the heaviest stars go supernova, and those have relatively short lifetimes, usually 10^7 to 10^8 years.
The use of "probability" here is meaningless.
The use of "complex life" here is meaningless.
Once there is a single cell the rest is easy. At the level of the cell humans aren't much more complex than paramecia.
I'm waiting for the first total synthesis of a cell. There's no money for it though I'm sure.
Isn't the speed of light by itself enough to solve the Fermi paradox. The amount of time and energy required to travel to the nearest star, let alone another Galaxy, are both, well, astronomical.
"Isn't the speed of light by itself enough to solve the Fermi paradox. ... "
Robots.
Some thoughts & links (sorry for my somewhat broken English):
The biosphere is expected to become uninhabitable in 1-2 Ga (see also this very interesting book by the same James Kasting - 20 MB).
The expected times between "evolutionary steps" are a function of their relative hardness, so a "fast" origin of life doesn't imply a high probability, as it's explained in this paper by Robin Hanson.
Thanks for your blog!
5Gyr is not the evolution time scale; it's the global geological/chemical time scale. Evolution time scale is 2% to 20% of that. Whenever conditions become ready for life to take a major step, evolution does the job in a ~100MYr. Three times it has done it already.
The first time, as soon as the Earth formed a crust, the first cellullar life appeared. There was negligible time gap. The second time, when free crustal iron was exhausted and O2 starts to accumulate in the oceans, mitochondria, oxygen metabolism, and eukaryotes appeared. Then the third time, as Thras pointed out, when O2 levels reached the level for multicellular metazoans to function, they just appeared, in more forms than you can imagine. It's scary how fast evolution works.
The real speed governor has always been the slow process of O2 photosynthesis changing the global chemistry.
As for intelligence, we are maybe 10~100MYr ahead of chimps, parrots, ravens, whales, etc.
Solution for the Fermi paradox? The Earth is unique, one in a trillion or more.
Isn't the speed of light by itself enough to solve the Fermi paradox. The amount of time and energy required to travel to the nearest star, let alone another Galaxy, are both, well, astronomical.
Age of the Universe is even more astronomical.
It's been calculated that a single technological civilization with sufficient desire to expand could colonize the Milky Way in a few million years.
Since we haven't seen any evidence of such colonization, there are several possibilities. Either we're alone in the Milky Way, or they are around but they've been hiding (perhaps treating the Earth as a zoo or something like that), or the naive picture of Star Trek - like extraterrestrials colonizing the galaxy as legacy individualistic "skin sacks" is false.
"The probability of life arising..."
What does that mean? Really?
You're just putting words together. You're not actually saying anything. Do "colorless green dreams sleep furiously"?
Probability is a model only. It is only a tool. It is not the reality.
The only exception, or supposed exception, to this is quantun mechanics, where randomness is "irreducible".
Here's the thing:
The optimality of the genetic code is puzzling.
Its fault-tolerent arangement is tough to ascribe to luck.
By some metrics, it is a million to one lucky roll of the dice.
It had to settle on this coding early. In fact, the progenitor species, right?
Do you buy million-to-one?
Is there not room for the possibility that the building blocks were common enough to select the optimal arrangement?
"What I think is quite hard to grasp is that the first replicators appeared almost as fast as it was possible (that 100My figure), but they appeared only once."
Well, RNA/DNA is universal, but a whole host of other cellular machinery appears to have appeared at least twice - once in bacteria and once in Archaea. Also, as another commentator pointed out, it may have happened many more times, but the other designs were simply out-competed.
There's a very nice recent article on emergence of the original replicators at New Scientist (an article of unusual quality for that magainze!)
Prof. Hsu:
I'm curious about your subhead. What do you mean by, "Pessimism of the Intellect, Optimism of the Will?"
Steve does not know what he means when he uses "improbable" in the above.
"improbability does not imply design or intervention"
Well, no. But it does strongly suggest it, which is all that should be expected. See page 5 of this book about the argument from design:
"http://books.google.com/books?id=0TSqizxUv-YC&dq=raymond+smullyan+who+knows&printsec=frontcover&source=bn&hl=en&ei=H0_jSrPDDon-sQO-ktCwBA&sa=X&oi=book_result&ct=result&resnum=4&ved=0CBgQ6AEwAw#v=onepage&q=&f=false"
Don the libertarian Democrat
Strongly suggests it to who, and why?
PS: I've listened to this kind of argument—perhaps one should just say assertion—for a long time, and I've concluded that unless one is willing to define "design" as an activity of the sort practiced by the designers we actually know (ie, ourselves) then we should avoid appeals to design as an explanation.
If we honestly examine our own efforts as designers, we are forced to confront how much trial and error is involved—that is, how much our efforts as designers actually resemble biological evolution and the often convoluted and halting process of scientific discovery. I think this realization is necessary, if not sufficient, to give appeals to design some explanatory value. Explanations based on the assumption of an omniscient and omnipotent designer, or a designer whose ways we cannot possibly understand, strike me as inescapably vacuous. They explain everything and nothing, and betray their advocate's indifference to, or contempt for, genuine explanation.
This article--Stars May be Cosmic Road Signs to Intelligent Aliens --reminded me of your post.
Post a Comment