Bang for the buck

From Paul Kedrosky, the figure below was displayed by Microsoft's Craig Mundie at an analyst presentation. If the numbers are correct, Microsoft is now the leading technology company when it comes to R&D spending. Somehow I can't believe they're getting a decent return on their investment.

For comparison, the entire US high energy physics annual budget is under $1 billion, as is CERN's budget. Total annual US defense spending on R&D (this includes weapon systems, "missile defense", etc.) is about $60 billion.

Intellectual history

I want to recommend a book I've been reading recently, The Eighth Day of Creation by H.F. Judson. It's the most detailed intellectual history of molecular biology I've yet found, covering not just the science but the scientists as well. Someone described it as a New Yorker-style book covering the discovery of DNA, RNA and protein synthesis.

It may be chauvinistic, but I can't help noticing the prominent role played by physicists who crossed over into molecular biology: Bragg, Delbruck, Crick, Wilkins, Gamow, Szilard (yes, the Gamow and Szilard you know from big bang cosmology and the atomic bomb, respectively), Walter Gilbert, etc. The influence of Schrodinger's little book What is Life? is pervasive.

It's hard for me to think of many scientific histories as good as this one, in which the writer has a deep understanding of both the science and the personalities involved. Two examples are Subtle is the Lord (Abraham Pais on Einstein) and QED and the Men Who Made It (Sam Schweber on quantum electrodynamics), but these border on unreadable for the non-specialist. Perhaps Genius, Gleick's biography of Feynman, and The Enigma, Andrew Hodge's biography of Turing, also qualify. Can anyone suggest others?

Fast fox evolution

This Times article describes controlled (should I say directed?) breeding experiments on small mammals such as foxes and rats performed by a Siberian scientist Dmitri Belyaev. Belyaev has managed to produce nice (tame, domesticated) and nasty (aggressive) versions of each animal in a surprisingly short time by simply breeding according to exhibited trait. The tame foxes can even perform difficult cognitive tasks like reading humans well enough to determine what they are looking at -- dogs can do this, but generally smarter chimps cannot. It's a great demonstration of how fast evolution can proceed when selection pressure is strong enough. One of the fascinating side effects of selection based on behavior is that certain physical traits (in foxes: floppy ears, white patches of fur and differently shaped skulls) were also altered, so the tame foxes can be readily identified versus wild or aggressive ones. (I don't see why this would be a priori implausible: the genes for tameness might have superficial physical as well as behavioral effects.)

These results rule out any simple-minded conclusions about whether superficial physical traits might be correlated to cognitive or behavioral traits. Sub-populations that look alike might actually behave alike. Sometimes you can judge a book by its cover :-)

NYTimes: Belyaev chose to test his theory on the silver fox, a variant of the common red fox, because it is a social animal and is related to the dog. Though fur farmers had kept silver foxes for about 50 years, the foxes remained quite wild. Belyaev began his experiment in 1959 with 130 farm-bred silver foxes, using their tolerance of human contact as the sole criterion for choosing the parents of the next generation.

“The audacity of this experiment is difficult to overestimate,” Dr. Fitch has written. “The selection process on dogs, horses, cattle or other species had occurred, mostly unconsciously, over thousands of years, and the idea that Belyaev’s experiment might succeed in a human lifetime must have seemed bold indeed.”

In fact, after only eight generations, foxes that would tolerate human presence became common in Belyaev’s stock. Belyaev died in 1985, but his experiment was continued by his successor, Lyudmila N. Trut. The experiment did not become widely known outside Russia until 1999, when Dr. Trut published an article in American Scientist. She reported that after 40 years of the experiment, and the breeding of 45,000 foxes, a group of animals had emerged that were as tame and as eager to please as a dog.

As Belyaev had predicted, other changes appeared along with the tameness, even though they had not been selected for. The tame silver foxes had begun to show white patches on their fur, floppy ears, rolled tails and smaller skulls.

...There was far more to Belyaev’s experiment than the production of tame foxes. He developed a parallel colony of vicious foxes, and he started domesticating other animals, like river otters and mink. Realizing that genetics can be better studied in smaller animals, Belyaev also started a study of rats, beginning with wild rats caught locally. His rat experiment was continued after his death by Irina Plyusnina. Siberian gray rats caught in the wild, bred separately for tameness and for ferocity, have developed these entirely different behaviors in only 60 or so generations.

The collection of species bred by Belyaev and his successors form an unparalleled resource for studying the process and genetics of domestication. In a recent visit to Novosibirsk, Dr. Brian Hare of the Planck Institute used the silver foxes to probe the unusual ability of dogs to understand human gestures.

If a person hides food and then points to the location with a steady gaze, dogs will instantly pick up on the cue, while animals like chimpanzees, with considerably larger brains, will not. Dr. Hare wanted to know if dogs’ powerful rapport with humans was a quality that the original domesticators of the dog had selected for, or whether it had just come along with the tameness, as implied by Belyaev’s hypothesis.

He found that the fox kits from Belyaev’s domesticated stock did just as well as puppies in picking up cues from people about hidden food, even though they had almost no previous experience with humans. The tame kits performed much better at this task than the wild kits did. When dogs were developed from wolves, selection against fear and aggression “may have been sufficient to produce the unusual ability of dogs to use human communicative gestures,” Dr. Hare wrote last year in the journal Current Biology.

Reich on China growth

Via Economist's View. I think Robert Reich's view is a bit too rosy, although his points are all well taken. Regarding point (1), the top central planners in China are likely quite good, but the system is still such that tremendous resources are misallocated -- for example, into unnecessary property development projects. They are gaining very, very fast in productivity and mastery of new technologies, although the 11 percent number in (2) isn't to be trusted entirely. Regarding point (3), I just watched the movie Syriana and recommend it to anyone who isn't in the oil industry :-)

China Growth

I've been watching the statistics coming out of China about its economic growth. Here are three things you should know. (1) The people managing China's economy (I'm not talking about the politicians but about the financial and economic wizards who are actually making decisions about money supply, capital markets, and the like) are extremely good. They match the best economic minds anywhere in the world. In other words, they know what they're doing. (2) The latest data show China is now growing at a rate faster than 11 percent. That's extraordinary. It's faster than China has been growing for the last five years -- and that was faster than anyone had predicted. China's rate of economic growth is the biggest economic news in the world. (3) That growth is putting huge demands on world energy supplies, and raw materials. Oil prices will continue to rise, as will all other commodities. This is the most important economic fact in the world right now. It is also among the most important political facts in the world.

Intelligence, nature and nurture

Some new data on genetic vs environmental influences on IQ in this recent Times magazine article. Until recently, twins studies could only examine the effect of environmental variation within a limited range -- from working to upper class -- because very poor families are generally not allowed to adopt babies. The effect of family background has been found to recede to almost nothing by late adulthood in these twins studies, but the possibility that severe deprivation might have a stronger effect has not been ruled out. Recent investigations, as detailed below, have focused on very poor families and found a significant effect. We might characterize this as discovering the non-linear region of gene--family environment interaction :-)

NYTimes: A century’s worth of quantitative-genetics literature concludes that a person’s I.Q. is remarkably stable and that about three-quarters of I.Q. differences between individuals are attributable to heredity. This is how I.Q. is widely understood — as being mainly “in the genes” — and that understanding has been used as a rationale for doing nothing about seemingly intractable social problems like the black-white school-achievement gap and the widening income disparity. If nature disposes, the argument goes, there is little to be gained by intervening. In their 1994 best seller, “The Bell Curve,” Richard Herrnstein and Charles Murray relied on this research to argue that the United States is a genetic meritocracy and to urge an end to affirmative action. Since there is no way to significantly boost I.Q., prominent geneticists like Arthur Jensen of Berkeley have contended, compensatory education is a bad bet.

...When quantitative geneticists estimate the heritability of I.Q., they are generally relying on studies of twins. Identical twins are in effect clones who share all their genes; fraternal twins are siblings born together — just half of their genes are identical. If heredity explains most of the difference in intelligence, the logic goes, the I.Q. scores of identical twins will be far more similar than the I.Q.’s of fraternal twins. And this is what the research has typically shown. Only when children have spent their earliest years in the most wretched of circumstances, as in the infamous case of the Romanian orphans, treated like animals during the misrule of Nicolae Ceausescu, has it been thought that the environment makes a notable difference. Otherwise, genes rule.

Then along came Eric Turkheimer to shake things up. Turkheimer, a psychology professor at the University of Virginia, is the kind of irreverent academic who gives his papers user-friendly titles like “Spinach and Ice Cream” and “Mobiles.” He also has a reputation as a methodologist’s methodologist. In combing through the research, he noticed that the twins being studied had middle-class backgrounds. The explanation was simple — poor people don’t volunteer for research projects — but he wondered whether this omission mattered.

Together with several colleagues, Turkheimer searched for data on twins from a wider range of families. He found what he needed in a sample from the 1970’s of more than 50,000 American infants, many from poor families, who had taken I.Q. tests at age 7. In a widely-discussed 2003 article, he found that, as anticipated, virtually all the variation in I.Q. scores for twins in the sample with wealthy parents can be attributed to genetics. The big surprise is among the poorest families. Contrary to what you might expect, for those children, the I.Q.’s of identical twins vary just as much as the I.Q.’s of fraternal twins. The impact of growing up impoverished overwhelms these children’s genetic capacities. In other words, home life is the critical factor for youngsters at the bottom of the economic barrel. “If you have a chaotic environment, kids’ genetic potential doesn’t have a chance to be expressed,” Turkheimer explains. “Well-off families can provide the mental stimulation needed for genes to build the brain circuitry for intelligence.”

Plumbing for credit derivatives

This Economist article describes backend problems in the rapidly growing market for credit derivatives. The idea of keeping track of billion dollar trades on scraps of paper seems alarming to me. On the other hand I know how hard it is to build an IT infrastructure for a growing business.

I discussed credit derivatives previously here.

One of the world's fastest-growing markets calls in the plumbers

OVER a year ago, a whiff of something nasty filled the nostrils of the world's financial regulators. It came, appropriately, from the back end of the credit-derivatives market, an unregulated asset class that was growing so fast that banks and hedge funds that dabbled in it had lost track of their trades.

In other markets where trading is private (rather than on an exchange), the problem might have seemed minor, involving thankless back-office tasks with monotonous names like matching and confirmation. But this time regulators saw a threat to the stability of banks, because of the popularity of credit-default swaps (CDSs), instruments that disperse lending risk around the financial system.

From almost nothing in 2000, trading in CDSs has ballooned to a notional value of $17 trillion at the latest count. That still leaves plenty of room to grow—interest-rate swaps, for example, are a $160 trillion market. But the CDS market, which allows banks and other financial firms to buy and sell protection against the risk of default by a borrower, punches above its weight. According to the International Monetary Fund, it is far bigger than the world's corporate-bond markets, it helps set the cost of borrowing by companies, and it might even reduce swings in the credit cycle.

For all its virtues, however, its practitioners have been hopeless at keeping tabs on their own trades, especially in the secondary market into which hedge funds have stormed. So last year regulators pressed the industry's 14 top dealers, which they do supervise, to put their rubber gloves on and sort out the plumbing.

Since then, bankers in a group known, like a ruling clique, as the “14 families” have laboured to Dyno-Rod a backlog of unconfirmed swap trades. Prodded by regulators, traders have shut themselves in hotel rooms for one weekend after another to sort out discrepancies with their counterparties. Some banks have even temporarily halted trading to allow the back offices to catch up with the sales staff.

The efforts appear to have borne fruit. The main dealers agreed to a June 30th deadline to cut the backlog of unconfirmed trades by 70% from their levels when they were first summoned by the Federal Reserve Bank of New York last September. “Everyone's already achieved that, as far as I know,” said Mark Davies, head of global credit trading at Bear Stearns, one of the firms.

Yet the smell has not quite gone away. Last month Alan Greenspan, former chairman of the Federal Reserve, startled bond traders at a dinner in New York with both a friendly pat and a slap on the wrist. Credit derivatives, he gushed, were “becoming the most important instruments I've seen in decades.” But he then went on to say how appalled he was at the “19th-century technology” used to trade credit-default swaps, with deals done over the phone and on scraps of paper. In London the Financial Services Authority, which has warned that unconfirmed trades could cause liquidity problems and accelerate a financial crisis, is partially mollified. “We've gone from a red light to an amber,” an official says.

It goes without saying that an automated, transparent back-office system is a good way to bring new investors into the market and improve liquidity. There is also broad support for the way regulators have let banks find their own answers to the problems, rather than imposing rules.

But the supervisory oversight, as well as the solutions dreamt up by the big dealers, make some people nervous. They think there may be subtle changes in the $220 trillion market for over-the-counter derivatives, which is unregulated because it involves trades between private parties.

A good deal of the grumbling comes from hedge funds. Some of these, bankers say, have unsuccessfully resisted moves to automated trading, preferring to keep details of their trades to themselves and to play dealers off against each other.

There are other worries. At the centre of the complex trading infrastructure is a vast industry-owned utility called the Depository Trust & Clearing Corporation (DTCC), which the 14 dealers—ten of which have seats on its board—see as integral to automation (handily, it gave such users a rebate of $528m last year). The utility seeks to stitch together electronic platforms that stretch from traders' desks, through confirmation, to storing records of derivative contracts until they expire.

DTCC's prevalence has led to concerns that putting so much global information into storage in America may one day make the industry subject to American regulation, no matter where trades take place. The utility's Peter Axilrod believes this fear is unwarranted. He points to the light touch shown by supervisors so far.

Another fear is that DTCC might trample on private competitors as it moves into other areas of derivatives. When it began testing a system for recording initial agreements to trade last month, it described itself as a tap-dancing gorilla.

Such concerns are likely to loom larger now that the backlog of paperwork has been reduced. Of particular interest is whether DTCC will realise its ambitions to store hundreds of trillions of dollars' worth of credit, equity and interest-rate derivative contracts. This would be a hugely complex task: already it admits that its plans to warehouse CDS contracts are taking longer than expected. And the rest of the world might well worry that too much of the plumbing of a global market would be on American soil.

Let the machines do it

Via an intrepid correspondent... the Times covers numerous areas where human "experts" are outperformed by machine intelligence. Of course, we're not quite ready to let the machines take over just yet. I think IA = Intelligence Amplification is much more promising in the short term than AI = Artifical Intelligence.

NYTimes: Do you think your high-paid managers really know best? A Dutch sociology professor has doubts.

The professor, Chris Snijders of the Eindhoven University of Technology, has been studying the routine decisions that managers make, and is convinced that computer models, by and large, can do a better job of it. He even issued a challenge late last year to any company willing to pit its humans against his algorithms.

“As long as you have some history and some quantifiable data from past experiences,” Mr. Snijders claims, a simple formula will soon outperform a professional’s decision-making skills. “It’s not just pie in the sky,” he said. “I have the data to support this.”

Some of Mr. Snijders’s experiments from the last two years have looked at the results that purchasing managers at more than 300 organizations got when they placed orders for computer equipment and software. Computer models given the same tasks achieved better results in categories like timeliness of delivery, adherence to the budget and accuracy of specifications.

No company has directly taken Mr. Snijders up on his challenge. But a Dutch insurer, Interpolis, whose legal aid department has been expanding rapidly in recent years, called in Mr. Snijders to evaluate a computer model it had designed to automate the routing of new cases — a job previously handled manually by the department’s in-house legal staff.

The manager in charge of the project, Ludo Smulders, said the model was much faster and more accurate than the old system. “We’re very satisfied about the results it’s given our organization,” he said. “That doesn’t mean there are no daily problems, but the problems are much smaller than when the humans did it by hand. And it lets them concentrate more on giving legal advice, which is what their job is.”

Mr. Snijders’s work builds on something researchers have known for decades: that mathematical models generally make more accurate predictions than humans do. Studies have shown that models can better predict, for example, the success or failure of a business start-up, the likelihood of recidivism and parole violation, and future performance in graduate school.

They also trump humans at making various medical diagnoses, picking the winning dogs at the racetrack and competing in online auctions. Computer-based decision-making has also grown increasingly popular in credit scoring, the insurance industry and some corners of Wall Street.

The main reason for computers’ edge is their consistency — or rather humans’ inconsistency — in applying their knowledge.

“People have a misplaced faith in the power of judgment and expertise,” said Greg Forsythe, a senior vice president at Schwab Equity Ratings, which uses computer models to evaluate stocks.

The algorithms behind so-called quant funds, he said, act with “much greater depth of data than the human mind can. They can encapsulate experience that managers may not have.” And critically, models don’t get emotional. “Unemotional is very important in the financial world,” he said. “When money is involved, people get emotional.” Many putative managerial qualities, like experience and intuition, may in fact be largely illusory. In Mr. Snijders’s experiments, for example, not only do the machines generally do better than the managers, but some managers perform worse over time, as they develop bad habits that go uncorrected from lack of feedback.

Other cherished decision aids, like meeting in person and poring over dossiers, are of equally dubious value when it comes to making more accurate choices, some studies have found, with face-to-face interviews actually degrading the quality of an eventual decision.

“People’s overconfidence in their ability to read someone in a half-an-hour interview is quite astounding,” said Michael A. Bishop, an associate professor of philosophy at Northern Illinois University who studies the social implications of these models.

And the effects can be serious. “Models will do much better in predicting violence than will parole officers, and in that case, not using them leads to a more dangerous society,” he said. “But people really don’t believe that the models are as accurate as they are.”

Models have other advantages beyond their accuracy and consistency. They allow an organization to codify and centralize its hard-won knowledge in a concrete and easily transferable form, so it stays put when the experts move on. Models also can teach newcomers, in part by explaining the individual steps that lead to a given choice. They are also faster than people, are immune to fatigue and give the human experts more time to work on other tasks beyond the current scope of machines.

So if they’re so good, why aren’t they already used everywhere?

Not everyone is convinced that managers are incorrigibly myopic. “I’ve never seen any evidence that there is a pattern of decline at all, and it just doesn’t fit with the way management literature is going, which is all around the emotional intelligence angle,” said Laura Empson, the director of the Clifford Chance Center of the Said Business School at Oxford University.

“I think there are a lot of people who have a strong technological orientation who would agree life would be a lot simpler if it weren’t for the humans,” she said. “But the reality is, organizations do have a lot of very intense and complicated human issues within them.”

Max H. Bazerman, a professor at Harvard Business School, wonders how many managerial decisions can actually be modeled. “The vast majority of decisions that we make in professional life don’t have this quality,” he said.

He agrees that models can make better decisions about credit card applications and college admissions, he said, “but there are many decisions that are much more unique, where that database doesn’t exist. I’m as skeptical about human intuition as these folks, but it’s not only a computer model that we replace it with. Sometimes it’s thinking more clearly.”

Many in the field of computer-assisted decision-making still refer to the debacle of Long Term Capital Management, a highflying hedge fund that counted several Nobel laureates among its founders. Its algorithms initially mastered the obscure worlds of arbitrage and derivatives with remarkable skill, until the devaluation of the Russian ruble in 1998 sent the fund into a tailspin.

“As long as the underlying conditions were in order, the computer model was almost like a money machine,” said Roger A. Pielke Jr., a professor of environmental studies at the University of Colorado whose work focuses on the relation between science and decision-making. “But when the assumptions that went into the creation of those models were violated, it led to a huge loss of money, and the potential collapse of the global financial system.”

In such situations, “you can never hope to capture all of the contingencies or variables inside of a computer model,” he said. “Humans can make big mistakes also, but humans, unlike computer models, have the ability to recognize when something isn’t quite right.”

Another problem with the models is the issue of accountability. Mr. Forsythe of Schwab pointed out that “there’s no such thing as a 100 percent quantitative fund,” in part because someone has to be in charge if the unexpected happens. “If I’m making decisions,” he said, “I don’t want to give up control and say, ‘Sorry, the model told me.’ The client wants to know that somebody is behind the wheel.”

Still, some consider the continuing ascendance of models as inevitable, and recommend that people start figuring out the best way to adapt to the role reversal. Mark E. Nissen, a professor at the Naval Postgraduate School in Monterey, Calif., who has been studying computer-vs.-human procurement, sees a fundamental shift under way, with humans becoming increasingly peripheral in making routine decisions, concentrating instead on designing ever-better models.

“The newest space, and the one that’s most exciting, is where machines are actually in charge, but they have enough awareness to seek out people to help them when they get stuck,” he said — for example, when making “particularly complex, novel, or risky” decisions.

The ideal future, then, may lie in letting computers and people each do what they do best. One way to facilitate this development is to train people to identify the typical cognitive foibles that lead to bad choices. “I’ve now worked with these models for so long,” Mr. Snijders said, “that my instincts have changed along the way.”

As Mr. Bishop of Northern Illinois University puts it, by making smart use of computer models’ advantages, “you’ll become like the crafty A student who doesn’t work that hard but gets mostly right answers, rather than the really hard-working student who gets lots of wrong answers and as a result gets C’s.”

Mutants among us

Prosopagnosia, or face blindness, affects a surprisingly large fraction (few percent) of the population. Those who suffer from it have difficulty in distinguishing human faces, except by conscious effort (recalling particular features, or contextual clues). Preliminary evidence is that (a) we have a specialized module in our brains for face recognition and (b) there are one or more alleles (gene variants) which disable this function to various degrees.

How could these alleles survive selection? One would guess that face blindness is an evolutionary handicap, at least to some degree (although perhaps less so in small hunter gatherer groups, or in theoretical physics ;-). Is there a compensating advantage provided by the mutation?

It's fascinating to consider how many other strange cognitive mutations are present in our population at the percent (or fraction of percent level). Memory? Musical ability? Specialized mathematical ability (e.g., visualizing geometrical shapes, or a "feel" for magnitudes of quantities, or lightning calculation)?

I suspect we'll find more and more of these, and their associated alleles, as time goes by. See GNXP.com for more discussion and references.

It just occurred to me that there are likely dozens of readers of this blog who have prosopagnosia. Would anyone care to share their (anonymous) comments on how they adjust to the condition, and when they noticed having it?

NYTimes: Dr. Sellers, a professor of English at Hope College in Holland, Mich., has a disorder called prosopagnosia, or face blindness, and she has had it since birth. “I see faces that are human,” she said, “but they all look more or less the same. It’s like looking at a bunch of golden retrievers: some may seem a little older or smaller or bigger, but essentially they all look alike.”

Face blindness can be a rare result of a stroke or a brain injury, but a study published in the July issue of The American Journal of Medical Genetics Part A is the first report of the prevalence of a congenital or developmental form of the disorder.

The researchers say the phenomenon is much more common than previously believed: they found that 2.47 percent of 689 randomly selected students in Münster, Germany, had the disorder.

Dr. Thomas Grüter, a co-author of the paper, said there were reasons to believe that the condition was equally common in other populations. “First,” he said, “our population was not selected in terms of cognition deficits. And second, a study done by Harvard University with a different diagnostic approach yielded very similar figures.”

Dr. Grüter is himself prosopagnosic. His wife and co-author, Dr. Martina Grüter of the Institute for Human Genetics at the University of Münster, did not realize he was face blind until she had known him more than 20 years. The reason, she says, is he was so good at compensating for his deficits.

“How do you recognize a face?” she asked. “For most people, this is a silly question. You just do. But people who have prosopagnosia can tell you exactly why they recognize a person. Thomas consciously looks for the details that others notice unconsciously.”

Sun Valley: Predators' Ball 2.0

Herb Allen (of boutique investment bank Allen & Company) has traditionally run a summer retreat for the biggest movers and shakers in media and technology in Sun Valley, Idaho. This year it's reported that financiers (hedge fund and private equity guys) have invaded the party, perhaps signalling a shift in the balance of power.

I once hoped for an invite to this event a few years ago, as one of our startup's investors (a hedge fund) was a regular attendee and its founder an Allen & Co. alumnus. Alas, the invite never materialized, but I did have several meetings with Allen & Co. bankers (one of whom turned out to be the son of a famous former Treasury Secretary) in their luxurious Manhattan offices and our not so exciting Oakland digs. The Manhattan offices are lushly carpeted, wood paneled and sound proofed. A remote control device on the oak table let us order coffee and drinks, delivered by a uniformed servant, during the meeting.

NYTimes DealBook: The annual mogul-fest that Allen & Company holds here every year is best known for A-list attendees like Rupert Murdoch of the News Corporation, Richard D. Parsons of Time Warner, Howard Stringer of Sony and Sumner M. Redstone of Viacom.

It is a conference that has taken on an almost supernatural reputation for deal making amid barbecues, discussion panels and whitewater rafting. (The seeds of Walt Disney’s acquisition of ABC/Capital Cities in 1996 were sown here.) But this year, the ones to watch were deep-pocketed people you may have never heard of, from the world of private equity and hedge funds.

“I walked into dinner last night and didn’t recognize three-quarters of the people there,” said the chief executive of one of the world’s largest media companies, who refused to speak on the record for fear of upsetting Herbert A. Allen of Allen & Company, who frowns on attendees talking publicly about the invitation-only conference, which ended yesterday. “It was all these hedge fund and finance guys I had never met before. The balance of power is shifting.”

The guest list at Mr. Allen’s conference, which began in 1982, may be the ultimate barometer of where the center of influence lies in corporate America and on Wall Street. For most of the 1980’s and early 90’s, the power players were Hollywood studio moguls like Barry Diller, then of Paramount, and Michael D. Eisner, formerly of Disney. By the mid-1990’s, cable and telecommunications executives like John C. Malone of Liberty Media and Brian L. Roberts of Comcast became the belles of the ball. In the late 1990’s and early 2000’s, technology and Internet executives like Stephen M. Case, the founder of America Online, and Jerry Yang, co-founder of Yahoo, were drawing crowds at the hotel bar.

Now, flush with billions in cash and the ability to borrow heavily on top of that, the private equity bigwigs and hedge fund managers have become the stars. Call it Predators’ Ball 2.0 — a kind of outdoorsy reprise of Michael Milken’s famous gathering of leveraged-buyout mavens of the 1980’s.

“We used to come here every year to sniff each other,” said the chief executive of another media company, who also did not want his name used. “Now, all these finance people are sniffing us.” With media stocks down virtually across the board, some may smell opportunity.

Physical limits on information processing

http://arxiv.org/abs/hep-th/0607082

Physical limits on information processing

Authors: Stephen D.H. Hsu

We derive a fundamental upper bound on the rate at which a device can process information (i.e., the number of logical operations per unit time), arising from quantum mechanics and general relativity. In Planck units a device of volume V can execute no more than the cube root of V operations per unit time. We compare this to the rate of information processing performed by nature in the evolution of physical systems, and find a connection to black hole entropy and the holographic principle.

AdSense arbitrage

You may have noticed little Google ads on this blog, placed through their AdSense program. A snippet of JavaScript on this page is executed by your browser, which then loads the appropriate text ads from a Google server. The ads are targeted by key word and the placement of the ads is sold in a key word auction to advertisers.

I put the ads up mainly out of curiosity -- as you know, I am fascinated by all things Google :-)

What I've learned recently is that certain key words are very valuable. If you are reading this blog and see ads related to, e.g., hedge funds, derivatives, FX trading, volatility, etc., you can send me a dollar just by clicking! Please click early and often -- you'll be transferring funds from rapacious luxocrats to a humble physics professor ;-)

Bruce Schneier has a nice article on click fraud (Google's greatest weakness at the moment) in Wired News. Note I am not encouraging click fraud -- my readers really are interested in stochastic volatility and Black-Scholes :-)

Google's $6 billion-a-year advertising business is at risk because it can't be sure that anyone is looking at its ads. The problem is called click fraud, and it comes in two basic flavors...

But the overarching problem is both hard to solve and important: How do you tell if there's an actual person sitting in front of a computer screen? How do you tell that the person is paying attention, hasn't automated his responses, and isn't being assisted by friends? Authentication systems are big business, whether based on something you know (passwords), something you have (tokens) or something you are (biometrics). But none of those systems can secure you against someone who walks away and lets another person sit down at the keyboard, or a computer that's infected with a Trojan.

More income inequality

Latest on income inequality (via Economist's View). From 2003-2004 the top 1% gained 17%, while the other 99% of the population barely advanced. So, the fruits of economic growth went overwhelmingly to a small group. The top 1% of earners now account for about 20% of pre-tax earnings. IIRC, the threshold for the top 1% is about $275k per annum.

Economists Thomas Piketty and Emmanuel Saez have recently made available an updated version of their groundbreaking data series on U.S. income inequality.[1] The data are unique because of the detailed information they provide regarding income gains at the top of the income spectrum, and also because they extend back to 1913. By contrast, widely used Census data on income developments do not capture income trends among the top one percent of households and go back only to the end of World War II.

...The Piketty and Saez data offer the first real snapshot of income trends among those at the pinnacle of the income spectrum in 2004. The data show that income gains between 2003 and 2004 were particularly large for those at the very top of the income spectrum, resulting in a nearly unprecedented one-year increase in income concentration.[3] The Piketty and Saez data show:

1) From 2003 to 2004, the average incomes of the bottom 99 percent of households grew by less than 3 percent, after adjusting for inflation.

2) In contrast, the average incomes of the top one percent of households experienced a jump of almost 17 percent, after adjusting for inflation. (Census data show that real median income fell between 2003 and 2004. Average income is pulled up by gains at the top of the income spectrum; the 3 percent rise among the bottom 99 percent seems to largely reflect gains by households in the top quintile of the income spectrum. In contrast, trends in median income capture the experience of households in the middle of the income spectrum.)

3) The top one percent of households garnered 36 percent of the income gains in 2004.

Gdrive: codename Platypus

Gdrive, a Web-based hard drive application from Google, has been rumored for some time. Enterprising sleuths seem to have found some interesting tidbits -- looks like client software that syncs with a distributed storage network. I can't wait for mine! (Although, do you want all your files searchable by Google?)

This is what was on the page just some hours ago (the page isn’t active anymore, but Corsin made a backup):

Platypus (Gdrive)

A filer for the world. But better.

Storing your files in Platypus has a number of advantages over storing your files on either your C: drive or filer.

Backup. If you lose your computer, grab a new one and reinstall Platypus. Your files will be on your new machine in minutes.

Sync. Keep all your machines synchronized, even if they run different operating systems.

VPN-less access. Not at a Google computer? View your files on the web at http://troutboard.com/p.

Collaborate. Create shared spaces to which multiple Googlers can write.

Disconnected access. On the plane? VPN broken? All your files are still accessible.

The page also offers you to “find a new bug, get a free Platypus t-shirt!” and to browse a Platypus share with your username or group name. The Gdrive download is available for Windows, Mac and Linux. Within the page source, Google author Justin Rosenstein is listed (Justin was Product Manager for Google Page Creator). Also, a couple of feature listings are hidden as comments in the source:

Publish. All of the files you store on Platypus are automatically accessible from the (corporate) web.

Share. Other Googlers can mount your Platypus folders and open your files in read-only mode.

Collaborate. ... It also has advantages over storing your files in your filer or WWW directory

Local IO speeds. Open and save as quickly as you could if you were accessing them from your C: drive.

Can we say good-bye to traditional methods of saving files, accessing them, and creating backups?

Hedge fund mania

Mysterious hedge funds have reached the popular consciousness! Details magazine, in an article entitled The New American Class System, profiles the new money "luxocrats" that have risen to the top of our winner take all economy.

Don't miss the slideshow field guide to luxocrats -- the hedge fund guy, the Silicon Valley geek, the old money trust funder, the struggling guy trying to make it in NYC on $500k a year.

The article is, of course, more amusing than realistic, but see here and here for accurate numbers on the US wealth distribution. If you want something even meatier, read this Economist article on the growth of credit derivatives (hedge funds are the largest traders of credit derivatives). The CDS (Credit Default Swap) market has a notional value of $17 trillion now! If I recall correctly, this market barely existed five years ago.

Bonus! Here's a long profile of James Simons, one of the most successful hedge fund managers of all time (via the new blog angryphysics; where's the anger, though? :-) The article has some interesting details about a lawsuit between Renaissance and two former employees, physics guys trained at MIPT (one of Landau's institutes in Moscow) and MIT.

Details: You know this guy from college. He runs a hedge fund—let's call it Colossal Capital Strategies—and if you’re diligent or masochistic enough to do a little research, you’ll find out that he made about $100 million last year. He’s 36 years old and he has billions under management. The Wall Street Journal likes to refer to him as a “high-net-worth individual,” but that wording seems so odd and clunky—the sort of boardroom-pretzel terminology that some lawyer from Enron might use to explain away a phantom transaction.

No. Let’s call him a luxocrat.

A luxocrat is not merely rich, but rich in a way that you couldn’t have imagined back in college. (Otherwise you would have been nicer to the guy.) He’s rich enough to guarantee that every calorie that passes his lips has been fussed over by a master chef, rich enough to share his truffled foie gras with the treasury secretary on a Gulfstream headed for Barbados, rich enough to impulse-buy doodads from the Robb Report with a black American Express Centurion card (whose existence you weren’t even aware of), rich enough to make your proud and dutiful little 401(k) look, in comparison, like the mound of coins that an Appalachian beet farmer might stash away in a pickle jar. A luxocrat is enormo-rich, robber-baron rich, 21st-century rich, swelled up with a wealth of such magnitude that it suggests the American class system would have to undergo a wholesale restructuring in order to accommodate it.

Which is arguably what’s happening at this very moment.

Usually when you read about the widening gap between the rich and the poor, you think of the insane chasm that yawns between, say, Bill Gates and a laborer trying to subsist on a few cents a day on the Bangladeshi floodplain. But there is a new status gap opening up in the American consciousness, one in which a young guy can earn or inherit what used to be a very respectable sum (well into the six figures, for instance) and still feel as if he’s stuck on a treadmill of perpetual proletarian worry and strain. Meanwhile he can’t help but notice that he’s got ultra-wealthy contemporaries (hedge-funders, real-estate moguls, Google geeks, surfers who retired at 30 after hitting the Silicon Valley jackpot) whose daily activities seem to have been shorn of all that worry and strain. The end result is the emergence of a different social pecking order—one in which the new money dwarfs the old, in which the currency-market globalists and Palo Alto venture capitalists conquer the top while even the Hollywood producers and Merrill Lynch desk jockeys get shunted to the bottom. A world in which the old rituals and pathways to success have been vaporized.

Let’s begin with the luxocrat’s home. “There is so much more big money in the hands of younger people,” says Pam Liebman, the president and CEO of the Corcoran Group, a national real-estate powerhouse with almost $12 billion in annual sales. “And their way of thinking is much less traditional.” In Manhattan, for instance, every budding tycoon used to lust for the pedigreed grandeur of an apartment in one of the pre-war buildings on Fifth Avenue or Park Avenue; he could acquire status by living in proximity to old money. Now “old,” in any configuration, has lost its allure. The luxury tyro’s ideal habitat is a brand-new, Lysol-scrubbed steel-and-glass monument to personal service. (Consider the residential tower that Eric Packer, the cold-blooded 28-year-old billionaire in Don DeLillo’s 2003 novel Cosmopolis, likes to call home: “It had the kind of banality that reveals itself over time as being truly brutal. He liked it for this reason.”) Even if the building happens to be beautiful and designed by Richard Meier or Santiago Calatrava, what you see from the outside is less important than what the luxocrat has access to on the inside. The magic word is amenities: He wants a concierge, a pool, a gym, a spa, a playroom for the kids, valet parking, haute cuisine delivered to his door. He wants things taken care of. He wants, in effect, to live in a five-star hotel 24-7. You can’t really blame him. “People are busy, and they want to be pampered,” Liebman says. “They want things that make their lives easier, more pleasant.”

Children

Khalil Gibran (1883-1931), The Prophet.

Your children are not your children.

They are the sons and daughters of Life's longing for itself.

They come through you but not from you,

And though they are with you, yet they belong not to you.

You may give them your love but not your thoughts.

For they have their own thoughts.

You may house their bodies but not their souls,

For their souls dwell in the house of tomorrow, which you cannot visit, not even in your dreams.

You may strive to be like them, but seek not to make them like you.

For life goes not backward nor tarries with yesterday.

Hollywood genius

Physicist turned author and screenwriter Leonard Mlodinow has a nice article in the LA Times on the hit or miss nature of the movie industry. He recapitulates the myth of expertise as it applies to studio executives, whom he compares to dart throwing monkeys (a la fund managers in finance).

Mlodinow wrote a charming memoir about his time as a postdoc at Caltech in the early 1980s. Fresh from Berkeley, having written a PhD dissertation on the large-d expansion (d is the number of dimensions), he was in over his head at Caltech, but found a friend and mentor in the ailing Richard Feynman.

We all understand that genius doesn't guarantee success, but it's seductive to assume that success must come from genius. As a former Hollywood scriptwriter, I understand the comfort in hiring by track record. Yet as a scientist who has taught the mathematics of randomness at Caltech, I also am aware that track records can deceive.

That no one can know whether a film will hit or miss has been an uncomfortable suspicion in Hollywood at least since novelist and screenwriter William Goldman enunciated it in his classic 1983 book "Adventures in the Screen Trade." If Goldman is right and a future film's performance is unpredictable, then there is no way studio executives or producers, despite all their swagger, can have a better track record at choosing projects than an ape throwing darts at a dartboard.

That's a bold statement, but these days it is hardly conjecture: With each passing year the unpredictability of film revenue is supported by more and more academic research.

That's not to say that a jittery homemade horror video could just as easily become a hit as, say, "Exorcist: The Beginning," which cost an estimated $80 million, according to Box Office Mojo, the source for all estimated budget and revenue figures in this story. Well, actually, that is what happened with "The Blair Witch Project" (1999), which cost the filmmakers a mere $60,000 but brought in $140 million—more than three times the business of "Exorcist." (Revenue numbers reflect only domestic receipts.)

What the research shows is that even the most professionally made films are subject to many unpredictable factors that arise during production and marketing, not to mention the inscrutable taste of the audience. It is these unknowns that obliterate the ability to foretell the box-office future.

But if picking films is like randomly tossing darts, why do some people hit the bull's-eye more often than others? For the same reason that in a group of apes tossing darts, some apes will do better than others. The answer has nothing to do with skill. Even random events occur in clusters and streaks.

...If the mathematics is counterintuitive, reality is even worse, because a funny thing happens when a random process such as the coin-flipping experiment is actually carried out: The symmetry of fairness is broken and one of the films becomes the winner. Even in situations like this, in which we know there is no "reason" that the coin flips should favor one film over the other, psychologists have shown that the temptation to concoct imagined reasons to account for skewed data and other patterns is often overwhelming.

...Actors in Hollywood understand best that the industry runs on luck. As Bruce Willis once said, "If you can find out why this film or any other film does any good, I'll give you all the money I have." (For the record, the film to which he referred, 1993's "Striking Distance," didn't do any good.) Willis understands the unpredictability of the film business not simply because he's had box-office highs and lows. He knows that random events fueled his career from the beginning, and his story offers another case in point...

Googleplexus, Nexus

A quick report on my Google visit. The place didn't disappoint -- it's like the 90's tech bubble never ended there! The cafeteria was great, the buildings are full of bean bag chairs, pool tables, espresso stations, mini scooters, you name it. The employees are surprisingly young and unsurprisingly very geeky. It felt like I was back on the Caltech campus. There was one guy in pajamas in the cafeteria, and lots of people with their dogs. At Caltech one often sees students who look like they just rolled out of bed at midday, staggering across campus in flip flops, gym shorts and t-shirts to hand in a problem set. Google had that feel to me. Interestingly, the ethnic mix is about the same as at Caltech or MIT -- at least a third of employees are south- or east-Asians.

The place has tremendous energy. You can tell people are very engaged in their work, and that Google is straining to keep up with the operational load of delivering search services to the entire planet. I noticed a lot of smaller satellite buildings scattered a few blocks from the main campus. They have a terrible space crunch -- many developers are sitting four to a small office. CEO Eric Schmidt's office is tiny and even celebrity technologists like Kai Fu Lee are sharing offices with several other people. (I suppose Lee might spend most of his time in China.) At one point we walked by what appeared to be an inflatable white tent in one of the open areas in building 43. Joking, I asked if those were temporary offices. My host replied (deadpan, peering into the tent) "No, I think that's a conference room, and it's not temporary..."

Googleplexus

Next week I'm headed down to the valley on another Robot Genius business trip. Among the meetings with engineers, bankers and VCs is a visit to the Googleplex in Mountain View. I'll let you know how the wasabi seared ahi is, and whether I managed to get a free massage ;-)

Seriously though, I'm one of Google's biggest fans, and fascinated by the technical aspects of what they're doing. This extends well beyond search, to things like AI and natural language (they are in a good position to use statistical methods with the large corpus of text they have on hand), massive scaling of computing systems (they have over 500k servers deployed) and even how they hire and manage highly talented technologists. I would consider taking my next sabbatical there! (OK, also in the running are the Santa Fe Institute and possibly KITP Beijing.)

Here's an interesting example of the kind of problem Google has to deal with in its core search business. A Russian hacker managed to create billions of fake Web pages using scraped content. He registered numerous domains and hosted the pages on servers in Russia. Through clever linking he managed to get Google to index his fake pages and made of order $100k in AdSense revenue before being discovered. This type of search engine manipulation is an ongoing problem, which, along with click fraud, threaten Google's core business.

Below is a hint about something we're working on in the Robot Genius labs. Why shouldn't search engines characterize the executables found on Web sites, not just the text or images?

We're also crawling the web in order to find distributors of spyware, and can automatically identify packages installed by bad guys as soon as they are created on the system.

Proof

There's an amusing back and forth (complete with little fables) going on between physicist Dave Bacon and computer scientist Scott Aaronson on their respective blogs. Both work on quantum information theory, and the argument appears to be an old one about physicists' intuition versus mathematical rigor. ("By the time you can prove it, the result will have been obvious to us for a generation" vs. "You guys are just guessing! Real men prove theorems".)

I'd like to add my opinion in the form of the following two quotes from Feynman (whom Schwinger remembered in an epitaph as "the outstanding intuitionist of our age"):

"We know a lot more than we can prove."

"Mathematics is to physics as masturbation is to sex."

I really only agree with the first quote, which, if you think about it, says something quite deep.

For our proof-obsessed brethren, I recommend the book Proofs and Refutations by Lakatos. How is it, exactly, that we "know" things? Can we ever be entirely sure that a given proof is error free? If not, how is it different from having only a probabilistic (e.g., confidence level) sense of truth?

It is their attempts to deal with unwanted and unexpected refutations - to preserve a valuable theory in the face of imperfect axioms and proof methods - that teach mathematicians the true depths of their conceptions and to point the way to new and deeper ones.

Lakatos shows this by an account of the historical development of the concept of proof in mathematics and by showing in historical detail how certain valuable 'proofs' were preserved in the face of refutation. To this point Lakatos shows that the 'proofs' of the truth of Euler's number are no proofs at all. The great mathematician Euler noticed that for any regular polyhedron the formula V-E+F=2 holds where V is the number of vertices, E is the number of edges and F is the number of faces. Euler's and his successors' proofs fall before any number of counterexamples. Does this prove that the theorem is 'incorrect?' Or does it mean... that their concept of what constituted a regular polyhedron was deficient. Lakatos shows how these conceptions were modified over a couple of hundred years as counterexample after counterexample were faced.

Kamikazes and terrorists

Freeman Dyson reflects on kamikaze pilots and Islamic terrorists in the New York Review of Books. (See the very end of the article, which is mostly a review of Daniel Dennett's book on religion and natural science.) I have heard it said many times that men die in battle for friends in their unit, rather than for flag and country.

The best source of information about modern Islamic terrorists that I know of is a book, Understanding Terror Networks, by Marc Sageman.[1] Sageman is a former United States foreign service officer who worked with the Mujahideen in Afghanistan and Pakistan. In chapter 5 of his book, he describes in detail the network that planned and carried out the September 2001 attacks on the United States. He finds that the bonds holding the group together, during its formative years in Hamburg, were more personal than political. He concludes: "Despite the popular accounts of the 9/11 perpetrators in the press, in-group love rather than out-group hate seems a better explanation for their behavior."

To end this review, I would like to introduc another recently published book, Kamikaze Diaries: Reflections of Japanese Student Soldiers, by Emiko Ohnuki-Tierney.[2] This contains extensive extracts from diaries written by seven of the young men who died in suicidal missions or as kamikaze pilots in the closing months of World War II. The diaries give us firsthand testimony of the thoughts and feelings of these young soldiers who knew that they were fated to die. Their thoughts and feelings are astonishingly lucid and free from illusions. Some of them expressed their feelings in poetry. All of them were highly educated and familiar with Western literature in several languages, having spent most of their brief lives in reading and writing. Only one of them, Hayashi Ichizo, was religious, having grown up in a Japanese Christian family. His Christian faith did not make self-sacrifice easier for him than for the others. He had read Kierkegaard's Sickness unto Deathand carried it with him on his final mission together with his Bible.

All of the young men, including Hayashi, had a profoundly tragic view of life, mitigated only by happy memories of childhood with family and friends. They were as far as it was possible to be from the brainwashed zombies that contemporary Americans imagined to be piloting the kamikaze planes. They were thoughtful and sensitive young men, neither religious nor nationalistic fanatics.

Here I have space to mention only one of them, Nakao Takanori, who must speak for the rest. Nakao left a poem beginning, "How lonely is the sound of the clock in the darkness of the night." In his last letter to his parents, a week before his death, he wrote,

At the farewell party, people gave me encouragement. I did my best to encourage myself. My co-pilot is Uno Shigeru, a handsome boy, aged nineteen, a naval petty officer second class. His home is in Hyogo Prefecture. He thinks of me as his elder brother, and I think of him as my younger brother. Working as one heart, we will plunge into an enemy vessel. Although I did not do much in my life, I am content that I fulfilled my wish to live a pure life, leaving nothing ugly behind me.

We have no firsthand testimony from the young men who carried out the September 11 attacks. They were not as highly educated and as thoughtful as the kamikaze pilots, and they were more influenced by religion. But there is strong evidence that they were not brainwashed zombies. They were soldiers enlisted in a secret brotherhood that gave meaning and purpose to their lives, working together in a brilliantly executed operation against the strongest power in the world. According to Sageman, they were motivated like the kamikaze pilots, more by loyalty to their comrades than by hatred of the enemy. Once the operation had been conceived and ordered, it would have been unthinkable and shameful not to carry it out.

Brains, genes, backlash

We posted before about Bruce Lahn's research. Lahn showed that two variants of a gene suspected to be related to brain function exhibit very different distributions in different ethnic groups, and show signs of having been subject to strong selection fairly recently in human history. Today the WSJ ran a front page article on Lahn and the backlash against his research (excerpts below). See also this interview with Lahn from Science.

Last September, Bruce Lahn, a professor of human genetics at the University of Chicago, stood before a packed lecture hall and reported the results of a new DNA analysis: He had found signs of recent evolution in the brains of some people, but not of others.

It was a triumphant moment for the young scientist. He was up for tenure and his research was being featured in back-to-back articles in the country's most prestigious science journal. Yet today, Dr. Lahn says he is moving away from the research. "It's getting too controversial," he says.

Dr. Lahn had touched a raw nerve in science: race and intelligence.

What Dr. Lahn told his audience was that genetic changes over the past several thousand years might be linked to brain size and intelligence. He flashed maps that showed the changes had taken hold and spread widely in Europe, Asia and the Americas, but weren't common in sub-Saharan Africa.

Web sites and magazines promoting white "racialism" quickly seized on Dr. Lahn's suggestive scientific snapshot. One magazine that blames black and Hispanic people for social ills hailed his discovery as "the moment the antiracists and egalitarians have dreaded."

Dr. Lahn has drawn sharp fire from other leading genetics researchers. They say the genetic differences he found may not signify any recent evolution -- and even if they do, it is too big a leap to suggest any link to intelligence. "This is not the place you want to report a weak association that might or might not stand up," says Francis Collins, director of the genome program at the National Institutes of Health.

Several scientific groups have set out to disprove or challenge Dr. Lahn's discoveries. His own university now says it is abandoning a patent application it filed to cover a DNA-based intelligence test that drew on his work.

As scientific tools for probing genes become increasingly powerful, research into human differences has exploded. Most of the time, scientists are looking for clues about the causes of disease. But some research is raising tensions as scientists such as Dr. Lahn venture into studies of genetic differences in behavior or intelligence.

Pilar Ossorio, a professor of law and medical ethics at the University of Wisconsin, criticizes Dr. Lahn for implying a conclusion similar to "The Bell Curve," a controversial 1994 bestseller by Richard J. Herrnstein and Charles Murray. The book argued that the lower average performance by African-Americans on IQ tests had a genetic component and wasn't solely the result of social factors. Referring to Dr. Lahn and his co-authors, Prof. Ossorio says: "It's exactly what they were getting at. There was a lot of hallway talk. People said he's doing damage to the whole field of genetics."

The 37-year-old Dr. Lahn says his research papers, published in Science last September, offered no view on race and intelligence. He personally believes it is possible that some populations will have more advantageous intelligence genes than others. And he thinks that "society will have to grapple with some very difficult facts" as scientific data accumulate. Yet Dr. Lahn, who left China after participating in prodemocracy protests, says intellectual "police" in the U.S. make such questions difficult to pursue.

Scientists believe that a small group of anatomically modern humans struck out from Africa probably less than 100,000 years ago. After arriving on the Eurasian land mass, they continued to split up and eventually humans populated nearly every corner of the globe. One use of genetic research is to probe how each group evolved differently after becoming isolated from the others. Recently created genetic maps of people of African, Asian and European ancestry make that research easier.

For instance, researchers have found that most Europeans have a genetic variant that lets them fully digest milk as adults. The variant is much less common in Africa and Asia, where lactose intolerance is widespread. Scientists theorize that it spread quickly among Europeans because drinking milk from domesticated dairy animals conferred a nutritional advantage. Similar evolutionary reasoning may explain why many people in malaria-prone parts of Africa carry gene variants linked to malaria resistance.

Other research is starting to explain variations in human skin color and hair texture. But scientists tense up when it comes to doing the same sort of research on the brain. Sociologist Troy Duster, who studies the use of racial categories by geneticists, worries that scientists will interpret data in ways that fit their prejudices. He cites the sorry history of phrenology, a study of skull shapes popular in the 19th century, and other pseudoscientific techniques used to categorize people as inferior. "Science doesn't transcend the social milieu," says Dr. Duster, of New York University.

Dr. Lahn traces his interest in human differences back to his youth in China. Foreigners there used to have a special currency that they could use at stores closed to ordinary Chinese. "I wondered why people were different, and why Chinese were at the bottom," he says.

By the time violence struck Tiananmen Square in 1989, Dr. Lahn, the son of two physicists, was an undergraduate at Harvard University. He channeled his curiosity into genetics and built his reputation with a groundbreaking study of the Y chromosome. After taking a post at the University of Chicago in 2000, Dr. Lahn won a prestigious fellowship from the Howard Hughes Medical Institute.

The fellowship pays most of his research bills and has allowed him to pursue creative projects, often on attention-grabbing subjects. One study looked at how promiscuity among female chimpanzees, gorillas and humans affected the evolution of a gene that makes sperm sticky. "Bruce is in a hurry to be famous," says Martin Kreitman, a Chicago colleague who is friendly with him.

Henry Harpending, a University of Utah anthropology professor who recently published a theory for why Ashkenazi Jews tend to have high IQ's, says Dr. Lahn once suggested they co-author an article for Scientific American about the genetics of behavior, in which they could explain why "Chinese are boring."

"I think that Bruce doesn't understand political correctness," Dr. Harpending says. Dr. Lahn says he only vaguely recalls the conversation but confirms that he wonders whether during China's imperial times there was "some selection" against rebellious individuals.

In recent years, Dr. Lahn has become interested in why the human brain is so large and complex. Although humans and chimpanzees share about 96% of their DNA, human brains are about four times larger. Even today, researchers can find a correlation, on average, between people's brain size and their IQ.

Dr. Lahn's group zeroed in on the role of two genes, called ASPM and microcephalin, that are known to have a role in brain size. Humans with defective copies of either gene are born with brains only about one-third the normal size.

Studying DNA from several species, the Chicago team found that, over millions of years, the genes had undergone more rapid change in monkeys, apes and humans than in other animals. Their next step was to determine if evolution had continued in modern humans. Dr. Lahn's graduate students began decoding DNA from 1,184 people belonging to 59 groups from around the world, including Bedouins, Pima Indians and French-speaking Basques.

The data showed that evolution had continued in recent millennia. A statistical analysis of DNA patterns suggested that new mutations in each of the two brain-related genes had spread quickly through some human populations. Evidently, these mutations were advantageous among those populations -- just as the genetic variant promoting milk digestion was advantageous to early Europeans. Dr. Lahn and his team further observed that the new mutations are found most frequently outside of Africa.

What the data didn't say was how the mutations were advantageous. Perhaps the genes play a role outside of the brain or affect a brain function that has nothing to do with intelligence.

While acknowledging that the evidence doesn't permit a firm conclusion, Dr. Lahn favors the idea that the advantage conferred by the mutations was a bigger and smarter brain. He found ways to suggest that in his papers. One mutation, which according to his estimates arose some 40,000 years ago, coincided with the first art found in caves, the paper observed. The other mutation, present mostly in people from the Middle East and Europe, and estimated to be 5,800 years old, coincided with the "development of cities and written language."

That suggested brain evolution might have occurred in tandem with important cultural changes. Yet because neither variant is common in sub-Saharan Africa, there was another potential implication: Some groups had been left out.

The dean of the University of Chicago's medical school, James L. Madara, says he approached Dr. Lahn before the papers were published. They discussed whether the report could be taken out of context. "Let the chips lie where they may," Dr. Madara says he told Dr. Lahn. As long as the ideas and data are clear, "don't worry about the implications," the dean said.

John Easton, head of media relations at the medical school, says his office was worried the work could be misinterpreted and abused by racist groups. Mr. Easton borrowed a copy of "The Mismeasure of Man," the famous attack on IQ tests and brain-volume measurements by the late paleontologist Stephen Jay Gould. Mr. Easton helped Dr. Lahn with talking points about his research. "We said, 'Don't be shy about telling people what it doesn't mean,' " Mr. Easton recalls.

Mr. Easton says Dr. Lahn "makes us nervous" but "with Bruce we know it's not driven by personal bias." That is because Asians "don't score at the top" in the frequency of the brain-gene mutations, Mr. Easton says.

Dr. Lahn's paper and talk at his university -- in which he also claimed the gene variants were probably linked to higher IQ -- provoked a strong reaction both on and off campus. Dr. Collins, head of the federal genome program, obtained advance copies of the papers and circulated them to top population geneticists. He wasn't persuaded by the statistical evidence for evolution and criticized Dr. Lahn's work in media interviews.

The papers won wide attention among researchers, and several responded by setting out to test Dr. Lahn's findings. Scientists at the Broad Institute, a top genetics center in Cambridge, Mass., have been reanalyzing some of the data and say they may challenge Dr. Lahn's finding that evolution acted on ASPM, one of the genes. Broad's influential chief, Eric Lander, says scientists probing recent evolution run the risk of "seeing a difference, and saying there is a story to fit it."

A team at the University of California, Los Angeles, recently tested whether the gene variants actually affect brain size. They studied DNA from 120 people whose brain volumes they had already measured using magnetic-resonance imaging. They didn't find any difference. "It certainly makes you want to look at other explanations" of what the variations mean, says Roger P. Woods, a UCLA brain-mapping expert who reported the results in May.

Some of Dr. Lahn's co-authors are also uncomfortable with the work. Sarah Tishkoff, a geneticist at the University of Maryland who provided DNA from remote African groups, says she is bothered how one paper drew a link between the genetic changes and the rise of civilization. She thinks it is too early to reach any conclusions about why the changes spread and says it is "very simplistic" to imagine that a single gene could have a major effect on complex cultural traits.

Several groups of scientists have sent letters to Science criticizing the papers. Dr. Lahn prepared responses, sending one earlier this month, but Dr. Tishkoff wasn't willing to add her name to them.

"You have to follow the data wherever it leads, but speculating in this field is dangerous," says Spencer Wells, head of the National Geographic Society's Genographic Project, a five-year, $40 million effort to collect DNA samples from 100,000 indigenous people. Dr. Wells says the project team might try to find evolutionary reasons for physical differences such as why Danes are taller than pygmies. But Dr. Wells says National Geographic won't study the brain. "I think there is very little evidence of IQ differences between races," he says.

The accuracy of Dr. Lahn's work and his views on race came up in his tenure review last fall, says a person familiar with it. After debate, his department voted unanimously in his favor, according to another faculty member. A more senior committee agreed and awarded Dr. Lahn the post of full professor, although it wasn't unanimous, this person says.

Dr. Lahn stands by his work but says that because of the controversy he is moving into other projects. Earlier this year, Mr. Easton of the university's media department forwarded Dr. Lahn a paper by two economists looking at the IQ of infants of different races. Dr. Lahn wasn't interested. "I'm surprised anyone studies this," he replied in an email.

Dr. Lahn says he isn't as eager as he once was to continue studying brain differences. P. Thomas Schoenemann, a professor of anthropology at the University of Michigan-Dearborn, says that at Dr. Lahn's request he collected DNA from 25 people whose brain sizes he had studied previously. But the two scientists haven't been in touch recently.

The university's patent office is also having second thoughts. Its director, Alan Thomas, says his office is dropping a patent application filed last year that would cover using Dr. Lahn's work as a DNA-based intelligence test. "We really don't want to end up on the front page...for doing eugenics," Mr. Thomas says.

More recently, Dr. Lahn says he was moved when a student asked him whether some knowledge might not be worth having. It is a notion to which he has been warming. Dr. Lahn says he once tried testing himself for which version of the brain genes he has. The experiment's outcome was blurry "but it wasn't looking good," he says. He hasn't tried testing himself again.

More null energy condition

hep-th/0606091

This is an extension of an earlier paper hep-th/0502203 (see blog post here). We show that in a broad class of models violation of the null energy condition indicates instability. The results are relevant to general relativity and to cosmology.

A paper by Dubovsky et al. (Ref. [6] in the new paper) exhibited a loophole in our earlier results involving superluminal (acausal) excitations. We traced this to an equation in our analysis (Eq. (47) in the new paper) that needs to be solved to find the unstable mode. In models with superluminal excitations this equation is solvable in some frames but not others (this is a sickness of acausality). Correspondingly, in some frames the Hamiltonian has no negative mode. In the appendix of the new paper we show that requiring causality is enough to restore the link between NEC violation and instability.

Coincidentally, the paper posted just before ours, hep-th/0606090 (Creminelli et al.) discusses some effective theories that can violate the NEC and be stable. Our results don't cover these models as they have four-derivative terms in the Lagrangian. We restrict ourselves to models which have classical equations of motion that are second order PDEs. I don't know what to make of third and higher order PDEs -- who knows what initial conditions are well-posed in those models.

However, the Creminelli et al. paper and the Dubovsky et al. paper are examples of how the creativity of model builders tends to evade the results of theorem-provers. No go theorems are only as good as their assumptions!


The null energy condition and instability

Authors: Roman V. Buniy, Stephen D. H. Hsu, Brian M. Murray

We extend previous work showing that violation of the null energy condition implies instability in a broad class of models, including gauge theories with scalar and fermionic matter as well as any perfect fluid. Simple examples are given to illustrate these results. The role of causality in our results is discussed. Finally, we extend the fluid results to more general systems in thermal equilibrium. When applied to the dark energy, our results imply that w is unlikely to be less than -1.

The origin of probability in quantum mechanics

hep-th/0606062

Of related interest, slides of a talk covering the same material, given at the Institute for Quantum Information at Caltech. (Check out Gork the robot!)

Title: Discreteness and the origin of probability in quantum mechanics
Authors: R. Buniy, S. Hsu, A. Zee

Attempts to derive the Born rule, either in the Many Worlds or Copenhagen interpretation, are unsatisfactory for systems with only a finite number of degrees of freedom. In the case of Many Worlds this is a serious problem, since its goal is to account for apparent collapse phenomena, including the Born rule for probabilities, assuming only unitary evolution of the wavefunction. For finite number of degrees of freedom, observers on the vast majority of branches would not deduce the Born rule. However, discreteness of the quantum state space, even if extremely tiny, may restore the validity of the usual arguments.

A relevant passage from a recent article by Steve Weinberg:

Einstein's Mistakes, Physics Today, November 2005

Bohr's version of quantum mechanics was deeply flawed, but not for the reason Einstein thought. The Copenhagen interpretation describes what happens when an observer makes a measurement, but the observer and the act of measurement are themselves treated classically. This is surely wrong: Physicists and their apparatus must be governed by the same quantum mechanical rules that govern everything else in the universe. But these rules are expressed in terms of a wavefunction (or, more precisely, a state vector) that evolves in a perfectly deterministic way. So where do the probabilistic rules of the Copenhagen interpretation come from?

Considerable progress has been made in recent years toward the resolution of the problem, which I cannot go into here. It is enough to say that neither Bohr nor Einstein had focused on the real problem with quantum mechanics. The Copenhagen rules clearly work, so they have to be accepted. But this leaves the task of explaining them by applying the deterministic equation for the evolution of the wavefunction, the Schrödinger equation, to observers and their apparatus. The difficulty is not that quantum mechanics is probabilistic—that is something we apparently just have to live with. The real difficulty is that it is also deterministic, or more precisely, that it combines a probabilistic interpretation with deterministic dynamics.

Outsourcing securities research

Sorry, don't have the link for the article below as it was sent to me by an intrepid correspondent, but it appeared on Bloomberg today. If you think carefully, it means that it is no longer the birthright of only slightly above average Ivy kids to glide into a cushy ($180k average compensation) analyst job. The really talented analysts (who are they? see the previous posts on the myth of expertise ;-) will still be very well compensated, but now the door is open to sharp kids in India, and eventually other countries.

Speaking of Bloomberg, I recommend a recent podcast (June 1) on Bloomberg On the Economy. They interview Robert Engle, a economics Nobelist in econometrics (ARCH models, volatility, etc). Engle was originally trained in physics. He talks about his transition into economics, vol, quants, etc. He mentions that he left the PhD program in physics (Cornell) because he didn't want to be working on something that "only 10 other people in the world could understand" (at the time he was working in a low-temperature physics lab in the basement). He said when he switched to econ he could "solve every problem they put in front of me," but it took a decade for him to understand which problems were the really interesting ones worth solving. Sounds like a realistic view of the technical advantages (but also economic and business naivete) that physicists and mathematicians bring to finance.

Wall Street Gets `Outsourced' as Analyst Jobs Shift to Mumbai
2006-06-05 00:37 (New York)


By Yalman Onaran
June 5 (Bloomberg) -- JPMorgan Chase & Co. had no analysts in India four years ago. Now, the third-largest U.S. bank has 80, including Naresh Bilandani, a 26-year-old London School of Economics graduate hired last year in Mumbai to help provide clients with investment recommendations on European lenders.

The group accounts for 14 percent of New York-based JPMorgan's research staff and illustrates a growing trend. Niket Patankar, who sells research services to investment banks in less-expensive markets, estimates that India's analyst ranks swelled to 5,700 from 300 in 2002. Merrill Lynch & Co., the second-largest U.S. securities firm by market value, and No. 3 Morgan Stanley employ more than 50 of them.

Securities firms are leaning on India's expanding pool of financial talent for number-crunching so they can afford to keep franchise analysts in New York and London. Wall Street's 2003 settlement with U.S. regulators cut off research departments from the revenue they got for helping investment bankers bring in fees. Now institutional customers such as Fidelity Investments are refusing to pay the inflated trading commissions that subsidized analyst reports for decades.

``We got outsourced,'' said Tom Larsen, who lost his job in London covering U.K. companies when Credit Suisse Group moved five of the seven analyst jobs in his group to India. ``Wall Street is aware that the old model, financed by investment banking, doesn't work any more. So it's trying different new models, including outsourcing.''

Larsen, 45, is now a senior policy analyst at the CFA Institute, the Charlottesville, Virginia-based organization that gives the required Chartered Financial Analyst designation to candidates who pass a grueling three-level set of once-a-year, half-day exams on everything from research ethics to discounted cash flow modeling.

CFA Exams

The number of people taking CFA tests in India climbed fivefold since 2002 to 3,178 this year, according to the CFA Institute. U.S. candidates fell by about 25 percent to 30,384. Patankar, co-founder of New York-based Adventity Inc., predicts India will have more than 20,000 analysts in 2011. That would put it ahead of the 15,229 securities analysts working at brokerages and investment banks in the U.S., according to Thomson Financial, a New York-based firm that tracks Wall Street research. The U.K. has 1,228 analysts.

``Research is probably the easiest investment-banking service that can be duplicated in India, where people are just as smart and educated as here,'' said Nejat Seyhun, a professor of finance at the University of Michigan in Ann Arbor. ``Technology has reduced the need for physical presence.''

The trend mirrors past shifts in industries from computers to automobiles, where companies from Dell Inc. to Ford Motor Co. moved production to low-cost centers such as Malaysia and Vietnam.

3,218 Miles Away

JPMorgan is keeping more-experienced analysts such as Michael Weinstein, ranked No. 1 in Institutional Investor's annual poll for his coverage of medical supply and device companies. Weinstein, based in New York, works less than an hour's drive from the biggest company in that industry, New Brunswick, New Jersey-based Johnson & Johnson.

Bilandini's Mumbai office is 3,218 miles from the headquarters of Athens-based National Bank of Greece, one of the companies that he tracks for JPMorgan.

Investment banks are ``salami-slicing their research activities and separating what needs to be at high-cost centers like New York from what doesn't,'' said Chris Gentle, director of financial-services research at Deloitte Services LP in London.
``Pressure to move offshore will grow as investment banks look for ways to cut costs while their budgets are squeezed.''

High-Cost Centers

Wall Street's research spending fell about 35 percent from 2001 to 2005, estimates Brad Hintz, a New York-based analyst at Sanford C. Bernstein & Co. who tracks the securities industry. Hintz's own firm relies mainly on bundling, or billing clients for research and trade execution in a single commission, for the revenue it needs to compensate analysts.

Total commissions paid for trading U.S. stocks dropped to $11.3 billion in 2005 from $13.4 billion in 2002, according to a survey of 239 fund managers by industry consultants at Greenwich Associates in Greenwich, Connecticut. The proportion allocated to research stayed constant at 40 percent, the survey found.

That decline made it impossible for the securities industry to maintain the same research staff in high-cost centers. The number of analysts working for the 10 biggest firms declined 21 percent to 2,641 as of November from 3,364 in 2001, according to Thomson figures.

India is helping to reverse the trend. Analysts in cities like Mumbai make as little as $20,000 a year, according to Absolute Return, a hedge fund newsletter. That compares with an average of $181,000 in the U.S. in 2005, a survey by the CFA Institute found.

Medical expertise

Previously I posted on the myth of expertise. Experts in many fields often perform no better than chance when making predictions.

This Businessweek article claims that no more than 25% of medical recommendations are supported by statistical data. Most of it is done by tradition, or according the doctor's intuition. The article profiles David Eddy, a heart surgeon who spent some time learning mathematics and earned a PhD in operations research. He revolutionized the field by pushing for "evidence-based" medicine. What is amazing to me is that this took so long and happened so recently.

...Even today, with a high-tech health-care system that costs the nation $2 trillion a year, there is little or no evidence that many widely used treatments and procedures actually work better than various cheaper alternatives.

This judgment pertains to a shocking number of conditions or diseases, from cardiovascular woes to back pain to prostate cancer. During his long and controversial career proving that the practice of medicine is more guesswork than science, Eddy has repeatedly punctured cherished physician myths. He showed, for instance, that the annual chest X-ray was worthless, over the objections of doctors who made money off the regular visit. He proved that doctors had little clue about the success rate of procedures such as surgery for enlarged prostates. He traced one common practice -- preventing women from giving birth vaginally if they had previously had a cesarean -- to the recommendation of one lone doctor. Indeed, when he began taking on medicine's sacred cows, Eddy liked to cite a figure that only 15% of what doctors did was backed by hard evidence.

A great many doctors and health-care quality experts have come to endorse Eddy's critique. And while there has been progress in recent years, most of these physicians say the portion of medicine that has been proven effective is still outrageously low -- in the range of 20% to 25%. "We don't have the evidence [that treatments work], and we are not investing very much in getting the evidence," says Dr. Stephen C. Schoenbaum, executive vice-president of the Commonwealth Fund and former president of Harvard Pilgrim Health Care Inc. "Clearly, there is a lot in medicine we don't have definitive answers to," adds Dr. I. Steven Udvarhelyi, senior vice-president and chief medical officer at Pennsylvania's Independence Blue Cross.

What's required is a revolution called "evidence-based medicine," says Eddy, a heart surgeon turned mathematician and health-care economist. Tall, lean, and fit at 64, Eddy has the athletic stride and catlike reflexes of the ace rock climber he still is. He also exhibits the competitive drive of someone who once obsessively recorded his time on every training run, and who still likes to be first on a brisk walk up a hill near his home in Aspen, Colo. In his career, he has never been afraid to take a difficult path or an unpopular stand. "Evidence-based" is a term he coined in the early 1980s, and it has since become a rallying cry among medical reformers. The goal of this movement is to pierce the fog that envelops the practice of medicine -- a state of ignorance for which doctors cannot really be blamed. "The limitation is the human mind," Eddy says. Without extensive information on the outcomes of treatments, it's fiendishly difficult to know the best approach for care.

The human brain, Eddy explains, needs help to make sense of patients who have combinations of diseases, and of the complex probabilities involved in each. To provide that assistance, Eddy has spent the past 10 years leading a team to develop the computer model that helped him crack the diabetes puzzle. Dubbed Archimedes, this program seeks to mimic in equations the actual biology of the body, and make treatment recommendations as well as figure out what each approach costs. It is at least 10 times "better than the model we use now, which is called thinking," says Dr. Richard Kahn, chief scientific officer at the American Diabetes Assn.

WASTED RESOURCES

Can one computer program offset all the ill-advised treatment options for a whole range of different diseases? The milestones in Eddy's long personal crusade highlight the looming challenges, and may offer a sliver of hope. Coming from a family of four generations of doctors, Eddy went to medical school "because I didn't know what else to do," he confesses. As a resident at Stanford Medical Center in the 1970s, he picked cardiac surgery because "it was the biggest hill -- the glamour field."

But he soon became troubled. He began to ask if there was actual evidence to support what doctors were doing. The answer, he was surprised to hear, was no. Doctors decided whether or not to put a patient in intensive care or use a combination of drugs based on their best judgment and on rules and traditions handed down over the years, as opposed to real scientific proof. These rules and judgments weren't necessarily right. "I concluded that medicine was making decisions with an entirely different method from what we would call rational," says Eddy.

About the same time, the young resident discovered the beauty of mathematics, and its promise of answering medical questions. In just a couple of days, he devoured a calculus textbook (now framed on a shelf in his beautifully appointed home and office), then blasted through the books for a two-year math course in a couple of months. Next, he persuaded Stanford to accept him in a mathematically intense PhD program in the Engineering-Economics Systems Dept. "Dave came in -- just this amazing guy," recalls Richard Smallwood, then a Stanford professor. "He had decided he wanted to spend the rest of his life bringing logic and rationality to the medical system, but said he didn't have the math. I said: 'Why not just take it?' So he went out and aced all those math courses."

To augment his wife's earnings while getting his PhD, Eddy landed a job at Xerox Corp.'s (XRX ) legendary Palo Alto Research Center. "They hired weird people," he says. "Here was a heart surgeon doing math. That was weird enough."

Eddy used his newfound math skills to model cancer screening. His Stanford PhD thesis made front-page news in 1980 by overturning the guidelines of the time. It showed that annual chest X-rays and yearly Pap smears for women at low risk of cervical cancer were a waste of resources, and it won the most prestigious award in the field of operations research, the Frederick W. Lanchester prize. Based on his results, the American Cancer Society changed its guidelines. "He's smart as hell, with a towering clarity of thought," says Stanford health economist Allan Enthoven.

Dr. William H. Herman, director of the Michigan Diabetes Research & Training Center, has a competing computer model that clashes with Eddy's. Nonetheless, he says, "Dr. Eddy is one of my heroes. He's sort of the father of health economics -- and he might be right."

..."At each meeting I would do the same exercise," he says. He would ask doctors to think of a typical patient and typical treatment, then write down the results of that treatment. For urologists, for instance, what were the chances that a man with an enlarged prostate could urinate normally after having corrective surgery? Eddy then asked the society's president to read the predictions.

The results were startling. The predictions of success invariably ranged from 0% to 100%, with no clear pattern. "All the doctors were trying to estimate the same thing -- and they all gave different numbers," he says. "I've spent 25 years proving that what we lovingly call clinical judgment is woefully outmatched by the complexities of medicine."