Pessimism of the Intellect, Optimism of the Will Favorite posts | Manifold podcast | Twitter: @hsu_steve
Thursday, September 18, 2008
Notional vs net: complexity is our enemy
The credit default swap (CDS) market, where AIG played, had notional outstanding value of about $45 trillion at the end of 2007 (about $60 trillion now). Of course many of these contracts are partially canceling, so the net value of contracts in the market is much smaller than the notional value.
Unfortunately, the network diagram (network of contracts) probably looks something like this:
Imagine removing -- due to insolvency, lack of counterparty confidence, lack of shareholder confidence, etc. -- one of the nodes in the middle of the graph with lots of connections. What does that do to the detailed cancellations that reduce the notional value of $45 trillion to something more manageable? Suddenly, perfectly healthy nodes in the system have uncanceled liabilities or unhedged positions to deal with, and the net value of contracts skyrockets. This is why some entities are too connected to fail, as opposed to too BIG to fail. Systemic risk is all about complexity.
Here's a simple example of a network of contracts whose notional value is much larger than its net value. Suppose A = AIG, B = Barclays and C = Citigroup have traded CDS contracts related to a particular pool of mortgages. If defaults in the pool exceed some threshold, A must pay B $1 billion, but will receive $1.1 billion from C. Now suppose there is a third contract in which B pays $1 billion to C if defaults exceed the threshold. The notional value of all contracts is $3.1 billion, but the net value that changes hands is only $.1 billion. So notional value is 31 times net.
B's position is completely neutral and A and C only have $.1 billion at risk. This may sound contrived, but it's actually not unrealistic.
Everything is fine until, say, A has a problem. Suppose A becomes insolvent and *poof* disappears. B and C are left with naked $1 billion bets on mortgages. Suddenly the notional value, which wasn't previously very representative of the amount at risk, due to the cancellations, isn't far off from the amount at risk ($3.1 vs 1 billion).
Now scale this little example up to, say, $45 trillion in notional value, thousands of bets and dozens of firms, and you've got systemic risk!
Subscribe to:
Post Comments (Atom)
Blog Archive
-
▼
2008
(254)
-
▼
09
(31)
- Human capital
- Why no bailout?
- Complexity illustrated: Lehman WAS too connected t...
- Clawbacks, fake alpha and tail risk
- CDOs, auctions and price discovery
- Mortgage securities oversold by 15-25 percent
- Survivor: theoretical physics
- The time to buy is when there is blood in the streets
- Ask the expert
- Academic trends in pictures
- The devil in the details
- The professor called the shot
- Treasury to socialize entire mortgage loss
- Phil Gramm, McCain and the CDS meltdown
- Notional vs net: complexity is our enemy
- Carly on Palin
- Devastation
- Orders of magnitude and timescales
- Armageddon
- Georgia and the balance of power
- Obama and race
- Babbage on economics and innovation
- A trillion in the balance
- Credit crisis: half way through?
- Anathem
- Hank in charge
- Bye bye Fannie and Freddie
- Venice photos
- Trento photos
- Palin, RNC, Romney: the view from Italy
- ECT fun
-
▼
09
(31)
Labels
- physics (420)
- genetics (325)
- globalization (301)
- genomics (295)
- technology (282)
- brainpower (280)
- finance (275)
- american society (261)
- China (249)
- innovation (231)
- ai (206)
- economics (202)
- psychometrics (190)
- science (172)
- psychology (169)
- machine learning (166)
- biology (163)
- photos (162)
- genetic engineering (150)
- universities (150)
- travel (144)
- podcasts (143)
- higher education (141)
- startups (139)
- human capital (127)
- geopolitics (124)
- credit crisis (115)
- political correctness (108)
- iq (107)
- quantum mechanics (107)
- cognitive science (103)
- autobiographical (97)
- politics (93)
- careers (90)
- bounded rationality (88)
- social science (86)
- history of science (85)
- realpolitik (85)
- statistics (83)
- elitism (81)
- talks (80)
- evolution (79)
- credit crunch (78)
- biotech (76)
- genius (76)
- gilded age (73)
- income inequality (73)
- caltech (68)
- books (64)
- academia (62)
- history (61)
- intellectual history (61)
- MSU (60)
- sci fi (60)
- harvard (58)
- silicon valley (58)
- mma (57)
- mathematics (55)
- education (53)
- video (52)
- kids (51)
- bgi (48)
- black holes (48)
- cdo (45)
- derivatives (43)
- neuroscience (43)
- affirmative action (42)
- behavioral economics (42)
- economic history (42)
- literature (42)
- nuclear weapons (42)
- computing (41)
- jiujitsu (41)
- physical training (40)
- film (39)
- many worlds (39)
- quantum field theory (39)
- expert prediction (37)
- ufc (37)
- bjj (36)
- bubbles (36)
- mortgages (36)
- google (35)
- race relations (35)
- hedge funds (34)
- security (34)
- von Neumann (34)
- meritocracy (31)
- feynman (30)
- quants (30)
- taiwan (30)
- efficient markets (29)
- foo camp (29)
- movies (29)
- sports (29)
- music (28)
- singularity (27)
- entrepreneurs (26)
- conferences (25)
- housing (25)
- obama (25)
- subprime (25)
- venture capital (25)
- berkeley (24)
- epidemics (24)
- war (24)
- wall street (23)
- athletics (22)
- russia (22)
- ultimate fighting (22)
- cds (20)
- internet (20)
- new yorker (20)
- blogging (19)
- japan (19)
- scifoo (19)
- christmas (18)
- dna (18)
- gender (18)
- goldman sachs (18)
- university of oregon (18)
- cold war (17)
- cryptography (17)
- freeman dyson (17)
- smpy (17)
- treasury bailout (17)
- algorithms (16)
- autism (16)
- personality (16)
- privacy (16)
- Fermi problems (15)
- cosmology (15)
- happiness (15)
- height (15)
- india (15)
- oppenheimer (15)
- probability (15)
- social networks (15)
- wwii (15)
- fitness (14)
- government (14)
- les grandes ecoles (14)
- neanderthals (14)
- quantum computers (14)
- blade runner (13)
- chess (13)
- hedonic treadmill (13)
- nsa (13)
- philosophy of mind (13)
- research (13)
- aspergers (12)
- climate change (12)
- harvard society of fellows (12)
- malcolm gladwell (12)
- net worth (12)
- nobel prize (12)
- pseudoscience (12)
- Einstein (11)
- art (11)
- democracy (11)
- entropy (11)
- geeks (11)
- string theory (11)
- television (11)
- Go (10)
- ability (10)
- complexity (10)
- dating (10)
- energy (10)
- football (10)
- france (10)
- italy (10)
- mutants (10)
- nerds (10)
- olympics (10)
- pop culture (10)
- crossfit (9)
- encryption (9)
- eugene (9)
- flynn effect (9)
- james salter (9)
- simulation (9)
- tail risk (9)
- turing test (9)
- alan turing (8)
- alpha (8)
- ashkenazim (8)
- data mining (8)
- determinism (8)
- environmentalism (8)
- games (8)
- keynes (8)
- manhattan (8)
- new york times (8)
- pca (8)
- philip k. dick (8)
- qcd (8)
- real estate (8)
- robot genius (8)
- success (8)
- usain bolt (8)
- Iran (7)
- aig (7)
- basketball (7)
- free will (7)
- fx (7)
- game theory (7)
- hugh everett (7)
- inequality (7)
- information theory (7)
- iraq war (7)
- markets (7)
- paris (7)
- patents (7)
- poker (7)
- teaching (7)
- vietnam war (7)
- volatility (7)
- anthropic principle (6)
- bayes (6)
- class (6)
- drones (6)
- econtalk (6)
- empire (6)
- global warming (6)
- godel (6)
- intellectual property (6)
- nassim taleb (6)
- noam chomsky (6)
- prostitution (6)
- rationality (6)
- academia sinica (5)
- bobby fischer (5)
- demographics (5)
- fake alpha (5)
- kasparov (5)
- luck (5)
- nonlinearity (5)
- perimeter institute (5)
- renaissance technologies (5)
- sad but true (5)
- software development (5)
- solar energy (5)
- warren buffet (5)
- 100m (4)
- Poincare (4)
- assortative mating (4)
- bill gates (4)
- borges (4)
- cambridge uk (4)
- censorship (4)
- charles darwin (4)
- computers (4)
- creativity (4)
- hormones (4)
- humor (4)
- judo (4)
- kerviel (4)
- microsoft (4)
- mixed martial arts (4)
- monsters (4)
- moore's law (4)
- soros (4)
- supercomputers (4)
- trento (4)
- 200m (3)
- babies (3)
- brain drain (3)
- charlie munger (3)
- cheng ting hsu (3)
- chet baker (3)
- correlation (3)
- ecosystems (3)
- equity risk premium (3)
- facebook (3)
- fannie (3)
- feminism (3)
- fst (3)
- intellectual ventures (3)
- jim simons (3)
- language (3)
- lee kwan yew (3)
- lewontin fallacy (3)
- lhc (3)
- magic (3)
- michael lewis (3)
- mit (3)
- nathan myhrvold (3)
- neal stephenson (3)
- olympiads (3)
- path integrals (3)
- risk preference (3)
- search (3)
- sec (3)
- sivs (3)
- society generale (3)
- systemic risk (3)
- thailand (3)
- twitter (3)
- alibaba (2)
- bear stearns (2)
- bruce springsteen (2)
- charles babbage (2)
- cloning (2)
- david mamet (2)
- digital books (2)
- donald mackenzie (2)
- drugs (2)
- dune (2)
- exchange rates (2)
- frauds (2)
- freddie (2)
- gaussian copula (2)
- heinlein (2)
- industrial revolution (2)
- james watson (2)
- ltcm (2)
- mating (2)
- mba (2)
- mccain (2)
- monkeys (2)
- national character (2)
- nicholas metropolis (2)
- no holds barred (2)
- offices (2)
- oligarchs (2)
- palin (2)
- population structure (2)
- prisoner's dilemma (2)
- singapore (2)
- skidelsky (2)
- socgen (2)
- sprints (2)
- star wars (2)
- ussr (2)
- variance (2)
- virtual reality (2)
- war nerd (2)
- abx (1)
- anathem (1)
- andrew lo (1)
- antikythera mechanism (1)
- athens (1)
- atlas shrugged (1)
- ayn rand (1)
- bay area (1)
- beats (1)
- book search (1)
- bunnie huang (1)
- car dealers (1)
- carlos slim (1)
- catastrophe bonds (1)
- cdos (1)
- ces 2008 (1)
- chance (1)
- children (1)
- cochran-harpending (1)
- cpi (1)
- david x. li (1)
- dick cavett (1)
- dolomites (1)
- eharmony (1)
- eliot spitzer (1)
- escorts (1)
- faces (1)
- fads (1)
- favorite posts (1)
- fiber optic cable (1)
- francis crick (1)
- gary brecher (1)
- gizmos (1)
- greece (1)
- greenspan (1)
- hypocrisy (1)
- igon value (1)
- iit (1)
- inflation (1)
- information asymmetry (1)
- iphone (1)
- jack kerouac (1)
- jaynes (1)
- jazz (1)
- jfk (1)
- john dolan (1)
- john kerry (1)
- john paulson (1)
- john searle (1)
- john tierney (1)
- jonathan littell (1)
- las vegas (1)
- lawyers (1)
- lehman auction (1)
- les bienveillantes (1)
- lowell wood (1)
- lse (1)
- machine (1)
- mcgeorge bundy (1)
- mexico (1)
- michael jackson (1)
- mickey rourke (1)
- migration (1)
- money:tech (1)
- myron scholes (1)
- netwon institute (1)
- networks (1)
- newton institute (1)
- nfl (1)
- oliver stone (1)
- phil gramm (1)
- philanthropy (1)
- philip greenspun (1)
- portfolio theory (1)
- power laws (1)
- pyschology (1)
- randomness (1)
- recession (1)
- sales (1)
- skype (1)
- standard deviation (1)
- starship troopers (1)
- students today (1)
- teleportation (1)
- tierney lab blog (1)
- tomonaga (1)
- tyler cowen (1)
- venice (1)
- violence (1)
- virtual meetings (1)
- wealth effect (1)
19 comments:
As I drove into work this morning, listening to a story on NPR about how much of a problem credit default swaps caused for AIG, I found myself wondering what you would think of all of this, Steve. It had been a while since I had read your blog. I'm glad you see you're still very much interested. It's way more than I can take in on my lunch break. ;-)
It's interesting to me that a significant part of the problem in the financial markets of late is related to the exact financial instruments that I studied with you a couple years ago -- CDSs and CDOs, etc. What are you hearing from your quant friends these days about how things look from their perspective? Does it sound like this may be just a passing phase or do they/you think it lead to a shift in how complicated financial instruments are built and traded?
Also, do you think now would be a good time for someone to consider beginning a career as a quant? Don't get me wrong, that's not my intention. I'd be curious to hear your thoughts, though.
A sea change is coming: more regulation, higher risk aversion, more aversion to math.
On CNBC you can already hear non-mathematical industry types trying to blame it all on models.
Nevertheless the long term trend is still to greater securitization and more complex derivatives -- i.e., more quants! But hopefully people will be much more skeptical of models and their assumptions. Personally I think it is the more mathematically sophisticated types (or, more specifically, perhaps those who come from physics and other mathematical but data driven subjects ;-) who are likely to be more skeptical about a particular model and how it can fail. People who don't understand math have to take the whole thing as a black box and can't look at individual moving parts.
Robert Shiller is still optimistic. See this recent interview:
http://www.econtalk.org/archives/2008/09/shiller_on_hous.html
Steve,
Exactly the right question. And I think the answer in simplest terms is "build an exchange". These transactions should go through a clearinghouse with margin requirements, etc. Also major CDS writers are effectively insurance companies and the math for doing insurance conservatively -- all talk of Archimedean copulas to one side -- isn't really new. But it requires honest oversight and a prudential culture.
Brian,
I think we were listening to the same interview -- Michael Greenberger on Fresh Air?
Actually, that was the wrong link. Here's the interview I had in mind. A couple of times I wanted to shout "those are NOTIONAL amounts!", but on the whole he had great insights to offer.
STS, thanks for the link.
I think my post was totally obvious to about half of the readership, but the point was still worth making.
I think a central exchange and stronger regulation would solve the systemic issues caused by complexity. A prudent regulator would have imposed this a few years ago! (People were keeping track of trades on slips of paper for a long time! I think I referenced some articles about this on the blog.)
But it still wouldn't prevent a speculative bubble like the one we had...
Back to Brian's original question: is it a good time to head into finance? certainly not. I think the fact that 50% of the Harvard graduating class headed into finance last year is a good signal for a market top ;-)
Oh no! It's that Greenberger guy again...
Let's hope he's read up on the subject since his last interview. Maybe Terri will understand more this time than before...
http://infoproc.blogspot.com/2008/04/credit-crisis-for-pedestrians.html
I guess I stepped in it with the Greenberger link ;) Sure, he's a lawyer and a regulator, not a quant. But he's talking to a pretty broad audience and expressing an understandable Cassandra complex: he feels he recommended regulatory changes that would have made a difference and was ignored out of complacency (at best) or conflicts of interest.
This was very illuminating to me, Steve. Thanks!
It seems to me that another job of regulators for the future is to constantly look for the weak links in such networks,i.e., ones whose failure can cause a lot of damage. It should be a very challenging mathematical problem to find good upper bounds on magnitude of potential losses, involving powerful ideas in graph theory, statistical physics and the like. I am surprised it was not done already...
MFA
No worries -- he was better this time!
I (may have) actually learned something! Greenberger claims that by statute (due to some deregulation passed by Congress -- maybe even by McCain's advisor Phil Gramm!) regulators were not allowed to intervene in CDS markets.
Apparently MotherJones is all over this story:
http://www.motherjones.com/news/feature/2008/07/foreclosure-phil.html
I may have to blog about it if I have some time...
http://bits.blogs.nytimes.com/2008/09/18/how-wall-streets-quants-lied-to-their-computers/
"In fact, most Wall Street computer models radically underestimated the risk of the complex mortgage securities, they said. That is partly because the level of financial distress is “the equivalent of the 100-year flood,” in the words of Leslie Rahl, the president of Capital Market Risk Advisors, a consulting firm.
But she and others say there is more to it: The people who ran the financial firms chose to program their risk-management systems with overly optimistic assumptions and to feed them oversimplified data. This kept them from sounding the alarm early enough. "
But look physicists get off free: quants are "mathematicians, computer scientists and economists." Wait, I'm one of those now....
I think Greenberger was referring to the Commodity Futures Modernization Act (CFMA) of 2000. Specifically Section 103 on pages 35-36 of this version.
Of course section 407 is nice too.
MFA - I think the math is pretty straightforward *if* you have access to the whole network of contracts. Unfortunately we don't! The Fed would give a lot for a map like the one above -- it would make cleaning up the mess much easier.
What I don't understand is why someone who buys a CDS as insurance thinks their counterparty will actually be there if/when the sh*t really hits the fan!
Steve,
"What I don't understand is why someone who buys a CDS as insurance thinks their counterparty will actually be there if/when the sh*t really hits the fan!"
You're unsure of this because the interesting mathematical question is precisely the correlation among defaults. There's some kind of a phase transition (not sure how rigorously I mean to apply that term) as the intensity of defaults increases. In finance, they talk vaguely of "contagion" -- but it's really sort of a percolation phenomenon on that network you put up.
Of course, being aware of this, I share your puzzlement at the behavior of CDS traders. It's particularly sad that AIG -- a veteran insurance firm -- didn't manage the risks better. Maybe it was a case of assuming that models that worked for products with greater natural diversification (from geographic range or demographic diversity) would apply without this characteristic "phase transition" being incorporated.
Dave Bacon: "The people who ran the financial firms chose to program their risk-management systems with overly optimistic assumptions and to feed them oversimplified data."
Sure. Because then you can optimize your PERSONAL profits:
"Your company makes assumptions about how bad the risk will be, and based on those assumptions, you determine that this trade is profitable for your employer. You then personally take a nice chunk of those profits in your next bonus as a reward for having been smart enough to get your company into this lucrative transaction. And because this upfront booking of expected profits from these transactions is so lucrative, not only do you get an enhanced bonus -- but so do the other members of your group, your supervisor, their supervisor, and the president and other senior officers of the firm....
"Now, it quickly becomes clear to any reasonable person that if you can double the profits your firm recognizes on a transaction by keying in four small assumptions changes on a computer model, each of which sounds individually reasonable, and the end result of those changes is to double the bonus you get paid this year – then the key to making some serious personal money is making the right assumptions! Something that is equally plain to your peers at competitive firms."
Steve,
I've enjoyed reading your blog the last couple days. As to my question about whether now is a good time to head into finance, what you said about 50% of the Harvard graduating class heading into finance last year being a good signal for a market top makes a lot of sense. I guess PhD physicists who decide to leave academia will find other things to do... ;-)
STS,
I appreciated your comment about a phase transition or a sort of a percolation phenomenon. Oh, and I was actually listening to Morning Edition yesterday morning.
This little loop with major players invalidates any Black-Scholes or Binomial pricing system they may have used for CDSs/CDOs. All such pricing formulas implicitly assume independence between transactional events for the underlying Gaussian statistics to be valid. A loop like this blows that out of the water.
It's literally like assuming you can calculate the temperature of a room temperature solid from a Boltzmann distribution when in fact you're dealing with a superconductor or superfluid operating under Bose-Einstein, at best, and non-ergodic quantum mechanics at worst. BS is based on condensed matter physics where price maps to temperature and you presume to have enough atoms (transactions) for the system to be in equilibrium. Dubiously at best!
No wonder bubbles were formed. A small error in pricing models (and I'm not talking about small errors above) feeds into a feedback loop with small delay and likely plenty of gain (greed)! Instability by any measure.
Let's be clear though. It's not the model that has the problem but the abuse of the model by ignoring the basic assumptions that must be met to allow the model to be valid. No different than trying to Newtonian physics in cases when Relatistic or Quantum Mechanics are the correct models - you know when to switch when the assumptions are violated for the simpler model.
A related issue is that this clearly shows the "zero sum" aspect of derivative insurance - there is not statistical pooling/portfolio effect to actually reduce expected risk but rather simply transferring the risk, in toto.
The presumption of derivatives being "insurance" is that the other party can better "handle" the risk is centrally dependent, again, on statistical independence of risk. "Derivative as insurance" is nothing more than presuming pooling risk dilution on a pool you don't even control, unlike explicitly pooled insurance!! Making the risk pool an externality when the outside world is too small to support an externality!
How independent can the risk be for another player in the same, small market performing essentially the same market function? About zero chance! And if you are really eating your own manure... yeah, insurance alright!
The thing is that with globalization, there really are no economic events that are independent anymore! So any risk assessment based on Gaussian distributions are suspect! Which is pretty much all modern quant finance.
It's possible to use alternate distributions that are better suited to this co-dependent reality. But most academic financial research has been "in the street under the street light because the light is better" rather than back in the "dark alley" where everyone knows the real answer is. In other words: "We used Gaussian distributions because there were easiest to use". Which is OK - most engineering is done with linear models where chosen because they are simple. The difference is that much of an engineer's training is related to 1) knowing when you aren't linear and can't assume your model is valid, and 2) learning ways of keeping systems linear as long as possible. No such self-discipline is apparently taught as Harvard or Yale business schools.
On top of that, the math that would be required is not what most folks learn about or can handle, making it frighteningly exotic even for quants.
All I can say is this stuff is and should be obvious to anyone playing with this stuff "for real" and the people involved in these businesses are either greedy and delusional, or educated but unknowledgeable.
im really glad I found a site where people are trying to understand the mechanics of cds.Im not a quant and am not even good at math.Maybe someone here can help me with a spread sheet I am trying to work out, concerning the percentage of notional net after fees paid or received.My goal is to see if the notional net on a given entity makes a sudden percentage move higher or lower as preceived risk decreases or increases.ie percentage of notional net suddenly increases=less preceived credit risk, notional net suddenly decreases=more precieved risk. Im thinking this could be tied to inside information.Less hedging would indicate higher notional net, less precieved risk, and vice versa.The dtcc newly released data would give me net weekly to track.One problem I am having is premiums received and paid. I dont know if the dtcc data takes into account these premiums when determining net notional.These premiums,not being constant, would corrupt or distort the percentage variables.Can anyone help me with this?
I'm actually doing a senior research thesis on this right now. My research question is to study the practice that banks, hedge funds, and AIG used, with respect to the CDS market. Forget that everyone is calling for regulation, that is coming. I want to study internal and external controls, and what is being done to today to make this instrument a useful and effective risk mitigation tool.
Post a Comment