{"id":708,"date":"2008-12-01T11:18:50","date_gmt":"2008-12-01T11:18:50","guid":{"rendered":"http:\/\/scientopia.org\/blogs\/goodmath\/2008\/12\/01\/if-you-measure-the-wrong-thing-you-get-the-wrong-answer-downs-syndrome-in-britain\/"},"modified":"2008-12-01T11:18:50","modified_gmt":"2008-12-01T11:18:50","slug":"if-you-measure-the-wrong-thing-you-get-the-wrong-answer-downs-syndrome-in-britain","status":"publish","type":"post","link":"http:\/\/www.goodmath.org\/blog\/2008\/12\/01\/if-you-measure-the-wrong-thing-you-get-the-wrong-answer-downs-syndrome-in-britain\/","title":{"rendered":"If you measure the wrong thing, you get the wrong answer: Down's syndrome in Britain"},"content":{"rendered":"

One of the blogs I read regularly is Ben Goldacre’s “Bad Science”. I recommend
\nit highly. (Which reminds me that I really<\/em> need to find some time to update my blogroll!) In saturday’s entry<\/a>, he discussed a BBC Radio documentary that described how Britain is becoming a much more welcoming place for Down’s syndrome babies.<\/p>\n

Ben did a good job of shredding it. But I also wanted to take a stab, focusing on
\nthe mathematical problem that underlies it, because it’s a great example of two very
\ncommon errors – first, the familiar confusing correlation and causation, and
\nsecond, using incorrect metrics.<\/p>\n

<\/p>\n

There’s one basic fact underlying this discussion: in England and Wales, the
\nnumber of live births of Down’s babies has risen by about four percent between 1989 and 2006.<\/p>\n

From this, the BBC’s documentary concluded that Great Britain has becoming more welcoming to Down’s babies. How do they conclude this? Well, since pre-natal testing
\nwas first introduced, the number of Down’s baby live births steadily decreased – until this most recent measurement, when the number started to trend upwards again. Based
\non this, they assume that it’s clear that more parents are deciding<\/em> to
\nhave Down’s babies.<\/p>\n

Right there, you can see the correlation\/causation problem. The number of
\nDown’s babies being born has increased; the main factor that reduces the number
\nof live Down’s births is abortion; therefore, the increase must be caused by people
\nchoosing not to have abortions.<\/p>\n

What’s wrong with that? To answer, we need to look at what other factors
\nare involved in this. First and foremost, what’s the absolute number of Down’s babies being conceived? If that rate has increased, then the number of live births could
\nincrease without the rate of abortion changing at all. Unfortunately, we don’t have
\nany real numbers for that; it’s not (as far as I know) reported publicly. <\/p>\n

But we can try to infer it, by considering what causes Down’s syndrome. Down’s
\nis a genetic disorder where the mother’s egg cell (it’s almost always the mother’s
\ngenetic contribution that causes Down’s) ends up with an extra copy of chromosome 21,
\nso that when it’s fertilized, the cell has three copies of that chromosome. That causes a large number of developement abnormalities; people with Down’s have distinctive facial features, tend to be severely retarded, have very thick tongues, and a host of other things. But what causes the egg cell to screw up during
\ndivision and wind up with an extra chromosome 21? We don’t know – but we know that
\nit correlates very<\/em> strongly with the mother’s age. A 25 year old mother has
\na risk of about 1 in 1600 of conceiving a Down’s baby. At 35 years old, the risk rises to around one in 350. (The reason why most doctor’s only recommend amniocentesis for
\nmothers 35 or older is because that 1 in 350 is the crossover point where the likelihood of the baby having Down’s corresponds to what most potiential parents
\nconsider an acceptable level of risk to the fetus from the procedure.)
\n(Note: in the original post, I screwed up and said Down’s was related to chromosome 23; it’s not 23, it’s 21. Thanks to commenter Alex for pointing that out!)<\/em><\/p>\n

The population of women having children in Great Britain has changed somewhat since 1989 – it’s decreased slightly; not dramatically, but slightly, because people on average are having fewer children. That should, arguably, decrease<\/em> the number of live Down’s births, since the overall pool of pregnant women has decreased. But the other factor that needs to be considered is the age of the women getting pregnant. And that has changed quite dramatically. Since 1989, the percentage of
\nwomen getting pregnant who are 35 or older have increased by two and a half times – from around 6% to around 15%!<\/p>\n

The upshot of this is that the number of Down’s pregnancies has almost certainly increased quite dramatically.<\/p>\n

The underlying error here is that the BBC documentary confused the number<\/em> of live births of Down’s babies with the percentage<\/em> of Down’s pregnancies that ended with live birth. Their argument is that the increase in the number of
\nlive births has increased, therefore more parents are deciding to have Down’s babies. But they’re using the wrong metric. The absolute number of people deciding to have Down’s babies has increased – but that doesn’t mean that “more people in society” are deciding to have Down’s babies. When you look carefully at the numbers, it actually
\nappears that there’s been an increase<\/em> in the percentage of Down’s babies
\nbeing aborted: the increase in number<\/em> of live births is smaller than<\/em>
\nthe increase in number of Down’s pregnancies. <\/p>\n

So in fact, more<\/em> parents are still choosing to abort Down’s babies – continuing the existing trend; as testing becomes more available and less risky, more
\nparents are opting to test, and to abort if they find out they’re carrying a Down’s baby. The rate of abortion for Down’s pregnancies has actually increased, not<\/em> decreased.<\/p>\n

This is what happens when you don’t really understand what you’re comparing.
\nTo do a meaningful comparison of a trend, you need to understand what the actual
\nthings being measured are, and make sure that you’re using a metric that
\nmeaningful measures the quantity you want to discuss. The BBC documentary fouled
\nthat up horribly: they looked at some data, chose an invalid measure for it,
\nand then using that measure, drew a conclusion based on a faulty correlation,
\nand used that faulty correlation to infer an invalid cause. Bad math on multiple
\nlevels.<\/p>\n","protected":false},"excerpt":{"rendered":"

One of the blogs I read regularly is Ben Goldacre’s “Bad Science”. I recommend it highly. (Which reminds me that I really need to find some time to update my blogroll!) In saturday’s entry, he discussed a BBC Radio documentary that described how Britain is becoming a much more welcoming place for Down’s syndrome babies. […]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":false,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[6],"tags":[],"class_list":["post-708","post","type-post","status-publish","format-standard","hentry","category-bad-probability"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_shortlink":"https:\/\/wp.me\/p4lzZS-bq","jetpack_sharing_enabled":true,"jetpack_likes_enabled":true,"_links":{"self":[{"href":"http:\/\/www.goodmath.org\/blog\/wp-json\/wp\/v2\/posts\/708","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/www.goodmath.org\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/www.goodmath.org\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/www.goodmath.org\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/www.goodmath.org\/blog\/wp-json\/wp\/v2\/comments?post=708"}],"version-history":[{"count":0,"href":"http:\/\/www.goodmath.org\/blog\/wp-json\/wp\/v2\/posts\/708\/revisions"}],"wp:attachment":[{"href":"http:\/\/www.goodmath.org\/blog\/wp-json\/wp\/v2\/media?parent=708"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/www.goodmath.org\/blog\/wp-json\/wp\/v2\/categories?post=708"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/www.goodmath.org\/blog\/wp-json\/wp\/v2\/tags?post=708"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}