{"id":685,"date":"2008-09-23T21:41:05","date_gmt":"2008-09-23T21:41:05","guid":{"rendered":"http:\/\/scientopia.org\/blogs\/goodmath\/2008\/09\/23\/bad-probability-and-economic-disaster-or-how-ignoring-bayes-theorem-caused-the-mess\/"},"modified":"2008-09-23T21:41:05","modified_gmt":"2008-09-23T21:41:05","slug":"bad-probability-and-economic-disaster-or-how-ignoring-bayes-theorem-caused-the-mess","status":"publish","type":"post","link":"http:\/\/www.goodmath.org\/blog\/2008\/09\/23\/bad-probability-and-economic-disaster-or-how-ignoring-bayes-theorem-caused-the-mess\/","title":{"rendered":"Bad Probability and Economic Disaster; or How Ignoring Bayes Theorem Caused the Mess"},"content":{"rendered":"<p> There is at least a little bit of interesting bath math<br \/>\nto learn from in the whole financial mess going on now. A couple<br \/>\nof commenters beat me to it, but I&#8217;ll go ahead and write about<br \/>\nit anyway.<\/p>\n<p> One of the big questions that comes up again and again is: how did they get away with this? How could they find any way of<br \/>\ntaking things that were worthless, and turn them into something that could be represented as safe? <\/p>\n<p> The answer is that they cheated in the math.<\/p>\n<p><!--more--><\/p>\n<p> The way that you assess risk for something like a mortgage bond is based on working out the probability of the underlying loans failing, and using that to compute the likelihood of the<br \/>\nentire bond package to end up losing.<\/p>\n<p> The biggest problem is that the whole system of ratings and<br \/>\ninsurance for mortgage (and other) bonds is based on probability<br \/>\ncomputations of how likely it is for the underlying loans to<br \/>\ndefault. The problem is in how they computed the probability of<br \/>\ndefault. They made the same mistake that we constantly see<br \/>\ncreationists making in some of their stupid arguments: false<br \/>\nindependence. They build up assessments of risk based on the the<br \/>\nassumption that for a given set of loans, the probabilities of<br \/>\ndifferent loans failing are completely independent of one another.<\/p>\n<p> Quick refresher on probability. Take two events &#8211; like<br \/>\ntwo loans defaulting. If the probability of the first<br \/>\nloan defaulting is p<sub>0<\/sub>, and the probability of the second<br \/>\nloan defaulting is p<sub>1<\/sub>. If the two events are independent, then the probability of both occuring &#8211; the probability of both loans defaulting &#8211; is p<sub>1<\/sub>&times;p<sub>2<\/sub>. But if they&#8217;re <em>not<\/em><br \/>\nindependent, that doesn&#8217;t work. Then the computation gets a<br \/>\nlot messier &#8211; because you need to work out the math describing<br \/>\nthe relationship &#8211; which generally involves lots of analysis,<br \/>\nand lots and lots of use of Bayes&#8217; theorem.<\/p>\n<p> It&#8217;s easiest to describe how this works by using an example.<br \/>\nSuppose we&#8217;ve got a package of 100 mortgages, each of which<br \/>\nborrowed $100,000. So we&#8217;ve got 10 million dollars worth of<br \/>\nmortgages. Suppose, for simplicity, that the total interest earned<br \/>\non the loans was going to be 150% &#8211; so at the end of the 30 year<br \/>\nterm of the loan, the bonds were expected to pay $25 million. <\/p>\n<p> Now, suppose that these were really lousy loans &#8211; they expected<br \/>\nthat each loan had a 10% probability of defaulting, and that they&#8217;d lose the entire amount of the loan on a default.<\/p>\n<p> By assuming that the probability of default for each of the loans is independent of the probability of default for any other loan, they can say that the probability of any particular loan defaulting is 10%. Assuming that defaults for loans are all independent, they can build an argument that probability predicts that only 10% of the loan will fail, and that it&#8217;s incredibly unlikely for the rate of failure to reach higher than 20%.<br \/>\nBased on that, they say that by using tranching to separate risk, they can claim that they&#8217;re being extra careful, and put 80% of<br \/>\nthe mortgage bonds into a top tranch fund, which is supposed to be<br \/>\nsuper safe.<\/p>\n<p> But the probability of defaults aren&#8217;t independent. Sure, there&#8217;s random failures, where someone gets sick and can&#8217;t work, and ends up defaulting on a loan. That kind of default generally<br \/>\nreally is an independent event. But that&#8217;s not the story behind <em>most<\/em> defaults in low-quality loans. The garbage loans are almost always variable interest rate, and the most common cause of default is interest rate changes, which cause the loan payments<br \/>\nto become too large for the borrowers to pay. When that happens,<br \/>\nthey&#8217;re not independent events. The same thing that causes one<br \/>\nloan to fail causes others to fail. Huge numbers fail at the same time, for the same cause. Depending on how the numbers work out,<br \/>\nyou can get very different results for what&#8217;s likely to happen.<br \/>\nIt&#8217;s not simple &#8211; there&#8217;s no one answer. And I don&#8217;t have the information that I would need to do the math. This isn&#8217;t back of<br \/>\nthe envelope stuff.<\/p>\n<p> But without doing anything complicated, I <em>can<\/em> say that they did it wrong. As I argued above, when you&#8217;ve got a huge collection of high-risk loans with variable interest rates, the pattern of default isn&#8217;t going to be independent. While the probability of any given loan defaulting, looked at individually, is only around 10%, the probability of 50% of the loans defaulting<br \/>\nisn&#8217;t 1 in 10<sup>something really big<\/sup> &#8211; because the same condition that causes one loan to fail is likely to cause many others to fail.<\/p>\n<p> As a result of this, tranching didn&#8217;t work. They set up the tranches so that they partitioned things so that the top tranch was safe given the assumption of independence. But if independence<br \/>\ndoesn&#8217;t hold &#8211; and it doesn&#8217;t in these &#8211; then even an extremely conservatively structured tranching package doesn&#8217;t guarantee<br \/>\nthe safety of the top tier.<\/p>\n<p> Plenty of people knew that this was wrong. But they were able to write up impressive looking risk assessments, full of pretty math showing how unlikely it was for anything bad to happen. The math was dreadful &#8211; but it looked good. And the fact that it looked good provided <em>enough<\/em> of an excuse for everyone to pretend that they believed it. (And for lots of people to actually really believe it; there&#8217;s no shortage of people who invested in this stuff without understanding it, who assumed that a &#8220;AAA&#8221; rating actually meant that someone had really checked to make sure that it was safe.)<\/p>\n","protected":false},"excerpt":{"rendered":"<p>There is at least a little bit of interesting bath math to learn from in the whole financial mess going on now. A couple of commenters beat me to it, but I&#8217;ll go ahead and write about it anyway. One of the big questions that comes up again and again is: how did they get [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":false,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[71],"tags":[],"class_list":["post-685","post","type-post","status-publish","format-standard","hentry","category-bad-economics"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_shortlink":"https:\/\/wp.me\/p4lzZS-b3","jetpack_sharing_enabled":true,"jetpack_likes_enabled":true,"_links":{"self":[{"href":"http:\/\/www.goodmath.org\/blog\/wp-json\/wp\/v2\/posts\/685","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/www.goodmath.org\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/www.goodmath.org\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/www.goodmath.org\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/www.goodmath.org\/blog\/wp-json\/wp\/v2\/comments?post=685"}],"version-history":[{"count":0,"href":"http:\/\/www.goodmath.org\/blog\/wp-json\/wp\/v2\/posts\/685\/revisions"}],"wp:attachment":[{"href":"http:\/\/www.goodmath.org\/blog\/wp-json\/wp\/v2\/media?parent=685"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/www.goodmath.org\/blog\/wp-json\/wp\/v2\/categories?post=685"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/www.goodmath.org\/blog\/wp-json\/wp\/v2\/tags?post=685"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}