Moore's Law predicts exponential growth in the number of transistors on microchips, with a doubling time of roughly 1-2 years. As discussed here, the prediction continunes to hold for transistors but not necessarily for the overall performance of the chip, as clock speeds have lagged of late. There is some hope that through concurrency (multi-threading of processes), the performance gain can be made up, but this will require fundamental changes in software design.
Moore's Law is at the intersection of physics and economics. We haven't yet reached the point of fundamental physical limitations on chip performance, although we may be only a decade or two away (people have been saying that since Moore formulated his law). But perhaps economic factors are beginning to intrude - the rate at which new fabs are brought on line is determined in part by market demand for bleeding edge performance. Only a very small subset of the market runs applications that need a 4GHz chip.
Pessimism of the Intellect, Optimism of the Will Favorite posts | Manifold podcast | Twitter: @hsu_steve
Subscribe to:
Post Comments (Atom)
Blog Archive
-
▼
2005
(253)
-
▼
01
(34)
- Chilling history
- Successful elections in Iraq
- Monkey business
- Iraqi voting begins abroad
- Orange revolution
- FX roundup
- Dark energy
- Comparison shopping via barcode
- Dangerous flows
- Goldman optimistic on China growth
- AI for kids
- Rivalry and habituation
- Skype and homeland security
- Precision QED
- Transfer payments
- Gut instinct, or efficient markets?
- String theory quotes
- New Year's Eve, Kiev
- Free will and determinism: a physicist's perspective
- How the CIA sees the world in 2020
- Top 2004 US patent recipients
- Value of a college education?
- China FX reserves up $200B in 2004
- New Scientist and minimal length
- Pessimism of the intellect
- China's world beaters?
- PIMCO commentary
- Moore's Law progress report
- Asperger's syndrome and BitTorrent
- Risk premium and equity outperformance
- Extreme male minds and autism
- Christmas reading - Kahneman and Tversky
- Obstacles to China development
- Bandwidth costs and Internet broadcasting
-
▼
01
(34)
Labels
- physics (420)
- genetics (325)
- globalization (301)
- genomics (295)
- technology (282)
- brainpower (280)
- finance (275)
- american society (261)
- China (249)
- innovation (231)
- ai (206)
- economics (202)
- psychometrics (190)
- science (172)
- psychology (169)
- machine learning (166)
- biology (163)
- photos (162)
- genetic engineering (150)
- universities (150)
- travel (144)
- podcasts (143)
- higher education (141)
- startups (139)
- human capital (127)
- geopolitics (124)
- credit crisis (115)
- political correctness (108)
- iq (107)
- quantum mechanics (107)
- cognitive science (103)
- autobiographical (97)
- politics (93)
- careers (90)
- bounded rationality (88)
- social science (86)
- history of science (85)
- realpolitik (85)
- statistics (83)
- elitism (81)
- talks (80)
- evolution (79)
- credit crunch (78)
- biotech (76)
- genius (76)
- gilded age (73)
- income inequality (73)
- caltech (68)
- books (64)
- academia (62)
- history (61)
- intellectual history (61)
- MSU (60)
- sci fi (60)
- harvard (58)
- silicon valley (58)
- mma (57)
- mathematics (55)
- education (53)
- video (52)
- kids (51)
- bgi (48)
- black holes (48)
- cdo (45)
- derivatives (43)
- neuroscience (43)
- affirmative action (42)
- behavioral economics (42)
- economic history (42)
- literature (42)
- nuclear weapons (42)
- computing (41)
- jiujitsu (41)
- physical training (40)
- film (39)
- many worlds (39)
- quantum field theory (39)
- expert prediction (37)
- ufc (37)
- bjj (36)
- bubbles (36)
- mortgages (36)
- google (35)
- race relations (35)
- hedge funds (34)
- security (34)
- von Neumann (34)
- meritocracy (31)
- feynman (30)
- quants (30)
- taiwan (30)
- efficient markets (29)
- foo camp (29)
- movies (29)
- sports (29)
- music (28)
- singularity (27)
- entrepreneurs (26)
- conferences (25)
- housing (25)
- obama (25)
- subprime (25)
- venture capital (25)
- berkeley (24)
- epidemics (24)
- war (24)
- wall street (23)
- athletics (22)
- russia (22)
- ultimate fighting (22)
- cds (20)
- internet (20)
- new yorker (20)
- blogging (19)
- japan (19)
- scifoo (19)
- christmas (18)
- dna (18)
- gender (18)
- goldman sachs (18)
- university of oregon (18)
- cold war (17)
- cryptography (17)
- freeman dyson (17)
- smpy (17)
- treasury bailout (17)
- algorithms (16)
- autism (16)
- personality (16)
- privacy (16)
- Fermi problems (15)
- cosmology (15)
- happiness (15)
- height (15)
- india (15)
- oppenheimer (15)
- probability (15)
- social networks (15)
- wwii (15)
- fitness (14)
- government (14)
- les grandes ecoles (14)
- neanderthals (14)
- quantum computers (14)
- blade runner (13)
- chess (13)
- hedonic treadmill (13)
- nsa (13)
- philosophy of mind (13)
- research (13)
- aspergers (12)
- climate change (12)
- harvard society of fellows (12)
- malcolm gladwell (12)
- net worth (12)
- nobel prize (12)
- pseudoscience (12)
- Einstein (11)
- art (11)
- democracy (11)
- entropy (11)
- geeks (11)
- string theory (11)
- television (11)
- Go (10)
- ability (10)
- complexity (10)
- dating (10)
- energy (10)
- football (10)
- france (10)
- italy (10)
- mutants (10)
- nerds (10)
- olympics (10)
- pop culture (10)
- crossfit (9)
- encryption (9)
- eugene (9)
- flynn effect (9)
- james salter (9)
- simulation (9)
- tail risk (9)
- turing test (9)
- alan turing (8)
- alpha (8)
- ashkenazim (8)
- data mining (8)
- determinism (8)
- environmentalism (8)
- games (8)
- keynes (8)
- manhattan (8)
- new york times (8)
- pca (8)
- philip k. dick (8)
- qcd (8)
- real estate (8)
- robot genius (8)
- success (8)
- usain bolt (8)
- Iran (7)
- aig (7)
- basketball (7)
- free will (7)
- fx (7)
- game theory (7)
- hugh everett (7)
- inequality (7)
- information theory (7)
- iraq war (7)
- markets (7)
- paris (7)
- patents (7)
- poker (7)
- teaching (7)
- vietnam war (7)
- volatility (7)
- anthropic principle (6)
- bayes (6)
- class (6)
- drones (6)
- econtalk (6)
- empire (6)
- global warming (6)
- godel (6)
- intellectual property (6)
- nassim taleb (6)
- noam chomsky (6)
- prostitution (6)
- rationality (6)
- academia sinica (5)
- bobby fischer (5)
- demographics (5)
- fake alpha (5)
- kasparov (5)
- luck (5)
- nonlinearity (5)
- perimeter institute (5)
- renaissance technologies (5)
- sad but true (5)
- software development (5)
- solar energy (5)
- warren buffet (5)
- 100m (4)
- Poincare (4)
- assortative mating (4)
- bill gates (4)
- borges (4)
- cambridge uk (4)
- censorship (4)
- charles darwin (4)
- computers (4)
- creativity (4)
- hormones (4)
- humor (4)
- judo (4)
- kerviel (4)
- microsoft (4)
- mixed martial arts (4)
- monsters (4)
- moore's law (4)
- soros (4)
- supercomputers (4)
- trento (4)
- 200m (3)
- babies (3)
- brain drain (3)
- charlie munger (3)
- cheng ting hsu (3)
- chet baker (3)
- correlation (3)
- ecosystems (3)
- equity risk premium (3)
- facebook (3)
- fannie (3)
- feminism (3)
- fst (3)
- intellectual ventures (3)
- jim simons (3)
- language (3)
- lee kwan yew (3)
- lewontin fallacy (3)
- lhc (3)
- magic (3)
- michael lewis (3)
- mit (3)
- nathan myhrvold (3)
- neal stephenson (3)
- olympiads (3)
- path integrals (3)
- risk preference (3)
- search (3)
- sec (3)
- sivs (3)
- society generale (3)
- systemic risk (3)
- thailand (3)
- twitter (3)
- alibaba (2)
- bear stearns (2)
- bruce springsteen (2)
- charles babbage (2)
- cloning (2)
- david mamet (2)
- digital books (2)
- donald mackenzie (2)
- drugs (2)
- dune (2)
- exchange rates (2)
- frauds (2)
- freddie (2)
- gaussian copula (2)
- heinlein (2)
- industrial revolution (2)
- james watson (2)
- ltcm (2)
- mating (2)
- mba (2)
- mccain (2)
- monkeys (2)
- national character (2)
- nicholas metropolis (2)
- no holds barred (2)
- offices (2)
- oligarchs (2)
- palin (2)
- population structure (2)
- prisoner's dilemma (2)
- singapore (2)
- skidelsky (2)
- socgen (2)
- sprints (2)
- star wars (2)
- ussr (2)
- variance (2)
- virtual reality (2)
- war nerd (2)
- abx (1)
- anathem (1)
- andrew lo (1)
- antikythera mechanism (1)
- athens (1)
- atlas shrugged (1)
- ayn rand (1)
- bay area (1)
- beats (1)
- book search (1)
- bunnie huang (1)
- car dealers (1)
- carlos slim (1)
- catastrophe bonds (1)
- cdos (1)
- ces 2008 (1)
- chance (1)
- children (1)
- cochran-harpending (1)
- cpi (1)
- david x. li (1)
- dick cavett (1)
- dolomites (1)
- eharmony (1)
- eliot spitzer (1)
- escorts (1)
- faces (1)
- fads (1)
- favorite posts (1)
- fiber optic cable (1)
- francis crick (1)
- gary brecher (1)
- gizmos (1)
- greece (1)
- greenspan (1)
- hypocrisy (1)
- igon value (1)
- iit (1)
- inflation (1)
- information asymmetry (1)
- iphone (1)
- jack kerouac (1)
- jaynes (1)
- jazz (1)
- jfk (1)
- john dolan (1)
- john kerry (1)
- john paulson (1)
- john searle (1)
- john tierney (1)
- jonathan littell (1)
- las vegas (1)
- lawyers (1)
- lehman auction (1)
- les bienveillantes (1)
- lowell wood (1)
- lse (1)
- machine (1)
- mcgeorge bundy (1)
- mexico (1)
- michael jackson (1)
- mickey rourke (1)
- migration (1)
- money:tech (1)
- myron scholes (1)
- netwon institute (1)
- networks (1)
- newton institute (1)
- nfl (1)
- oliver stone (1)
- phil gramm (1)
- philanthropy (1)
- philip greenspun (1)
- portfolio theory (1)
- power laws (1)
- pyschology (1)
- randomness (1)
- recession (1)
- sales (1)
- skype (1)
- standard deviation (1)
- starship troopers (1)
- students today (1)
- teleportation (1)
- tierney lab blog (1)
- tomonaga (1)
- tyler cowen (1)
- venice (1)
- violence (1)
- virtual meetings (1)
- wealth effect (1)
16 comments:
http://www.j-bradford-delong.net/movable_type/2005-3_archives/000132.html
Department of "Huh"?
The Economist writes that "consumers face stark choices" because of a "mobile-energy crisis" in battery technology...
Technological progress in battery technology is slow only by comparison with progress in the information-technology trinity: microprocessors, memory, and hard disks. The fact that the Economist can call an 8% per year growth rate a "crisis" is an index not of slow technological progress but of our extraordinary expectations for improvement.
Anne
We have already been pushed to rely more than ever on asset price increases to fund our retirements as defined benefit pension plans have changed to defined contribution plans. Now we are to be asked to consider private investment plans to fund our Social Security needs. However as we become ever more dependant on asset accumulation and price increases, the relatively high prices of stocks and bonds and real estate should warn us that returns going forward are likely to be considerably lower than returns from any period between 1974 and 2000. Nonetheless, we must invest and the topic is critical for our well-being.
Anne
http://www.nytimes.com/2005/01/08/business/08skin.html?pagewanted=all&position=
Cosmetics Break the Skin Barrier
By CLAUDIA H. DEUTSCH
rocter & Gamble is about to sell ball bearings - but not the metal kind. Its minuscule mineral spheres are designed to help usher its Olay-brand body lotions deep into the skin.
Freeze 24/7, meanwhile, is pushing the muscle relaxant GABA, or gamma-amino butyric acid, a common ingredient in over-the-counter antianxiety supplements. It is not using GABA to relax minds, however. Instead, the goal is to relax the muscles that cause face wrinkles.
'We knew that if we could find a way to use GABA topically, it would be a killer app,' said Scott E. Gurfein, the founder of the year-old company.
The science of smoothing women's skin is going high tech. And cosmetics companies, whether they serve the masses or the elite, are adopting not just the language of Silicon Valley but many of its most sophisticated techniques.
Researchers for cosmetics companies have spent several years developing chemical bullets to attack wrinkles. But now, the players in this growing industry are turning to the medical and electronics worlds for ways to keep human skin from bouncing those bullets off the body like so many blanks.
'What you are seeing in the skin care world is a mirror of the advancing technology in pharmaceuticals and biotechnology,' said Karyn Grossman, a dermatologist and international spokeswoman for the Prescriptives line of Estée Lauder.
Scientists from far outside the cosmetics world are noticing the change. 'Skin care,' said Neil Gordon, president of the Canadian NanoBusiness Alliance, 'is definitely becoming a big area for nanoscience,' which involves working to manipulate nature at the supersmall level of individual atoms and molecules.
Anne
http://bigpicture.typepad.com/comments/2005/01/an_interview_wi.html
An Interview With Jeremy Grantham - Barrons
Asset allocators will be sorely tested in the coming year, says a skilled practitioner of the art:
Duck and cover. That about sums up this investing great's view of how best to cope with what he thinks is likely to be a difficult year in the financial markets. A founder of Boston-based Grantham, Mayo, Van Otterloo, and steward of $80 billion for institutions and the wealthy, Grantham sizes up asset classes and seizes the best opportunities across the broad spectrum of available investments. Now, for the first time in his career, he's faced with what he calls the "asset-allocator's nightmare": asset classes of all stripes are either overpriced or fairly priced. So, what's an investor supposed to do? Grantham offered his advice in an interview conducted in late December. For some of the best advice in the business, please read on:
"Underweight equities globally because they are expensive. Only emerging-market equities are close to fair value, and now could be considered a little overpriced."
Anne
http://bigpicture.typepad.com/comments/2005/01/an_interview_wi.html
EXCERPT:
Q: The past few years have been very rough on short sellers. Are you suggesting a new golden period for them?
A: It will probably be a pretty darn good period, and conservative hedge funds are the answer to a maiden's prayer. Even if they turn out to deliver a lower return than you expect going in because of the sheer volume of the competition -- say you expect 10% but get 5% -- that may turn out to be brilliant in the next couple of years. I personally have 50% of my money in such funds, which includes a net short fund but mostly conservative market-neutral funds. Of the balance, I'm very long emerging and international. I've shorted a few S&P 500 contracts against them, just to take some of the sting out of the next few years. Our highest-confidence strategy would be going long emerging markets and short S&P 500 contracts.
Our seven-year forecast for asset classes expects a real return of around 6% from emerging markets. We expect to add three or four points to that from active management for a total return of 9%. We expect the S&P 500, on the other hand, to deliver minus-2%. That's an 11-point spread. And emerging markets have never looked higher-quality than now. Their reserves are fabulous. Their currencies, consequently, all look pretty good. Their growth rates are fabulous. The back page of the Economist lists the 24 emerging countries. If you were to take the gross-domestic-product growth rate of the European Union for the last year and add it to that page, it would rank dead last on a list that includes Egypt, Israel, Turkey and Slovakia. They are all beneficiaries of China, have a terrific fundamental strength at the moment and a good qualitative position. Still in all, they may go bump in the night. But on a three-year basis, I think they are going to hammer the S&P again.
Anne
The Federal Reserve has been criticized for failing to try to adjust asset prices with monetary policy. We might think through whether the Fed should interfere with asset prices other than in the bond market. My leaning is against any such specific price interference, but after all every Fed move effects asset prices in various ways so I am open to argument.
Anne
The problem then is we came out of a fierce bear market with still high price earning ratios for the S&P. To cope with the recession around the bear market the Fed lowered interest rates sparking elevated prices for bonds and real estate. We now have expensive assets through and through. Whether commodity prices are are elevated is not clear to me, but there is little investment value in the American economy unless traditional valuations are of no account.
Anne
The economy is growing, and we are beyond a jobless recovery, though not beyond one in which wages and benefits lag in growth. Care must be taken by the Federal Reserve that the tightening sequence does not slow us and further interfere with job creation or wage increases.
Anne
The idea that we must fret about a possible financing problem for Social Security in 38 to 48 years is absurd, when there are immediate financing problems to deal with. But, the wish is to undo the concept of Social Security and the press is largely convinced Social Security is failing awfully so the public is increasingly convinced.
Anne
Reporters on Social Security on PBS and NPR take it as a matter of fact that the program is in crisis. Have we really done so poor a job teaching such reporters how research is to be done? Grumble, grumble.
Anne
Now, you and I are suspicious of hedge fund returns. Besides, hedge funds are no middle class retirement vehicle. What sort of investments are middle class retirement vehicles in what may be a low return environment. These last 5 years long term bond funds at Vanguard were superb. What now, we wonder?
Anne
This weekend I am reading Don Quixote, slowly slowly, for the Don was born 400 years ago and Edith Grossman has a wonderful new translation. Shall we tilt at windmills together? Now, here is a book. I shall take many days, for I do not wish to come to the end.
Anne, not Sancho Panza.
Knight of Doleful Countenance Gets Little Love at Home
By RENWICK McLEAN - New York Times
MADRID - This is the city where Miguel de Cervantes did most of his writing, published "Don Quixote," died and was buried.
But his tomb is closed to the public, his house no longer stands and the shop where "Don Quixote of La Mancha" was first printed is marked only by a plaque.
Cervantes, always an outsider in Spain during his lifetime, is in some ways still struggling to fit in here, even as the country plans big celebrations for the 400th anniversary of the publication of "Don Quixote" in January.
"Cervantes is the most important Spanish writer," said Antonio Muñoz Molina, director of the New York office of the Instituto Cervantes, which promotes the teaching and study of Spanish. "But he is not the most representative of the Spanish. His irony, his sense of humor - they are too subtle to seem Spanish." The gulf between Cervantes and his people may help explain his hollow presence in the streets of Madrid.
Anne
Steve,
Can you tell this Anne person to stop making off-topic posts? What does any of this have to do with Moore's Law?!?
To summarise the article – CPUs are hitting a limit that’s slowing down individual processor speeds, and that the historical rapid increase in speed of CPUs to take care of poor coding is over. Further improvements will be aimed at hyperthreading, multi-core CPUs and more cache. Software developers need to consider this, and that it will likely be several years before the industry adjusts accordingly.
I agree with a fair amount of what he says, although I don’t think the ‘free lunch’ is over, just taking a pause. Intel are trying to sort themselves out after 5 years of terrible decisions (principally the pushing of MHz over performance in the P4, RAMBUS etc), and should be back on track sometime next year. As a consequence, AMD aren’t feeling the need to release ever faster processors so it’s ‘quiet’ just now. Most new features in PCs are in things like 64-bitness(pretty major in itself), wireless networking, faster/better memory architectures, storage, low power, and interoperability with consumer devices such as cameras and TVs. Hyperthreading, as implemented by Intel, is a dead-duck and will be made redundant by multi-core CPUs unless it’s implemented like in high-end systems (unlikely due to cost). More and more systems will be multi-CPU (Sony’s Cell architecture is based around this).
Something else that pushes multi-core is the packaging - you may shrink the CPU but you've got to get 100s of wires off the thing, and that sets a minimum footprint. Once you drop below that minimum footprint, you may as well use the space for something else, like a second CPU.
Moore's Law is holding - the number of transistors still may be doubling, but you're getting something else for it rather than just raw speed.
Post a Comment