{"id":302,"date":"2007-02-05T11:30:00","date_gmt":"2007-02-05T11:30:00","guid":{"rendered":"http:\/\/scientopia.org\/blogs\/goodmath\/2007\/02\/05\/once-again-sal-and-friends-butcher-information-theory\/"},"modified":"2007-02-05T11:30:00","modified_gmt":"2007-02-05T11:30:00","slug":"once-again-sal-and-friends-butcher-information-theory","status":"publish","type":"post","link":"http:\/\/www.goodmath.org\/blog\/2007\/02\/05\/once-again-sal-and-friends-butcher-information-theory\/","title":{"rendered":"Once again, Sal and Friends Butcher Information Theory"},"content":{"rendered":"<p> I haven&#8217;t taken a look at Uncommon Descent in a while; seeing the same nonsense<br \/>\nget endlessly rehashed, seeing anyone who dares to express disagreement with the<br \/>\nmoderators get banned, well, it gets old. But then&#8230; Last week, DaveScott (which is, incidentally, a psueudonym!) decided to retaliate against my friend and fellow ScienceBlogger Orac, by &#8220;outing&#8221; him, and publishing his real name and employer.<br \/>\nWhy? Because Orac had <em>dared<\/em> to <a href=\"http:\/\/scienceblogs.com\/insolence\/2007\/01\/in_which_my_words_will_be_misinterpreted.php\">criticize the way that a potential, untested<br \/>\ncancer treatment has been hyped recently<\/a> in numerous locations on the web, <a href=\"http:\/\/scienceblogs.com\/insolence\/2007\/02\/laying_the_cluestick_on_davescot_over_di_1.php\">including UD.<\/a><\/p>\n<p> While reading the message thread that led to DaveScott&#8217;s &#8220;outing&#8221; of Orac, I came<br \/>\nacross a claim by Sal Cordova about a new paper that shows how Greg Chaitin&#8217;s work in<br \/>\ninformation theory demonstrates the impossibility of evolution. He even promoted it to<br \/>\na top-level post on UD. I&#8217;m <em>not<\/em> going to provide a link to Sal&#8217;s introduction<br \/>\nof this paper; I refuse to send any more links UDs way. But you can find the paper at<br \/>\n<a href=\"http:\/\/progettocosmo.altervista.org\/index.php?option=content&amp;task=view&amp;id=87\">this<br \/>\nsite<\/a>.<\/p>\n<p><!--more--><\/p>\n<p> They start out with yet another rehash of the good old &#8220;Life is too complicated for evolution&#8221; shpiel. But from there, they go on to invoke not just Greg Chaitin, but Kurt G&ouml;del and Alan Turing as allegedly providing support for intelligent design:<\/p>\n<blockquote>\n<p>Why &#8211; in a sense &#8211; are the works of great mathematicians as K.G\u00f6del, A.Turing, G.Chaitin, J.Von Neumann &#8220;friends&#8221; of the Intelligent Design movement and &#8211; in the same time &#8211; &#8220;enemy&#8221; of Darwinism, the biological theory according to which life and species arose without the need of intelligence? As said above, biological complexity, organization and order need information at the highest degree. The works of G\u00f6del, Turing, Chaitin and Von Neumann all deal with mathematical information theory, from some point of view. So information is the link between the field of mathematics and the field of biology. For this reason some truths and results of mathematics can illuminate the field of biology, namely about the origin-of-biological-complexity in general and specifically the origin-of-life problem. Roughly biologists divide in two groups: design skeptics (Darwinists) and intelligent design theorists (ID supporters and creationists). The formers claim that life arose without need of an intelligent agency. The latters claim that life arose thanks to intelligent agency. IDers are developing a theory about that, which is called &#8220;Intelligent Design Theory&#8221; (IDT).<\/p>\n<p> To say it in few words, G\u00f6del&#8217;s works in metamathematics, Turing&#8217;s ideas in computability theory, Chaintin&#8217;s results in algorithmic information theory (AIT) and Von Neumann&#8217;s researches in informatics are friend to ID because all are different expressions of a unique universal truth: &#8220;more&#8221; doesn&#8217;t come from &#8220;less&#8221;; a lower thing cannot cause a higher thing; causes are more than effects; intelligence stays above and its results below.<\/p>\n<\/blockquote>\n<p> This is, of course, nonsense, from the start. (Really, what biologists support ID?)<br \/>\nBut the really annoying part to me is the abuse of math &#8211; and not just any math, but<br \/>\nthe work of three of the major figures in <em>my personal area of expertise<\/em>.<br \/>\nTuring, G&ouml;del, and Chaitin are three of the greats in what has become the theory<br \/>\nof computation. (And I&#8217;ll just briefly add that as much as I respect and admire Chaitin, I don&#8217;t quite think that he quite ranks with Turing and G&ouml;del.) <\/p>\n<p> The fact is, <em>none<\/em> of the work of G&ouml;del, Turing, or Chaitin can<br \/>\nlegitimately be read as saying <em>anything<\/em> remotely like &#8220;more doesn&#8217;t come from<br \/>\nless&#8221;. In fact, I would argue quite the opposite: G&ouml;del showed how logics could be<br \/>\nused to represent and reason about <em>themselves<\/em>; Turing showed how the entire<br \/>\nconcept of computation could be reduced to the capability of a remarkably simple<br \/>\nmachine &#8211; and yet that simple machine could do incredibly complex things. (In fact,<br \/>\nTuring was convinced that the human mind was nothing but a remarkably complicated<br \/>\ncomputing device &#8211; that all of the products of human minds were nothing but the result<br \/>\nof completely deterministic computations.)<\/p>\n<p> Let&#8217;s move on to see their specific descriptions of the works of these three<br \/>\ngreat thinkers.<\/p>\n<blockquote><p>\nG\u00f6del proved that, in general, a complete mathematical theory cannot be derived entirely from a finite number of axioms. In general mathematics is too rich to be derived from a limited number of propositions (what mathematicians name a &#8220;formal system&#8221;). In particular just arithmetic is too rich to be reducible in a finite set of axioms. What we can derive from a finite formal system is necessarily incomplete.\n<\/p><\/blockquote>\n<p> Bullshit and nonsense! That&#8217;s an astonishingly bad explanation of <a href=\"http:\/\/en.wikipedia.org\/wiki\/Godels_Incompleteness_Theorem\">G&ouml;del&#8217;s incompleteness theorem<\/a>. In fact, G&ouml;del&#8217;s theorem actually means something rather<br \/>\nopposite: that <em>mathematics itself<\/em> is limited. You <em>can<\/em> describe all<br \/>\nof arithmetic using a formal system with a finite set of axioms; in fact, G&ouml;del<br \/>\nhimself proved that, in his <a href=\"http:\/\/en.wikipedia.org\/wiki\/Godel%27s_completeness_theorem\"><em>completeness<\/em> theorem<\/a>. What you <em>cannot<\/em> do is something quite different. You cannot create a single formal system in which<br \/>\nevery true statement is provably true, and every false statement is provably false, and<br \/>\nno paradoxical statements can be written. This is a misrepresentation of G&ouml;del&#8217;s theorem, mis-stated in a way that attempts to make it look as if it supports their<br \/>\ncase.<\/p>\n<p> Moving on to Turing, here&#8217;s what they say:<\/p>\n<blockquote><p>\nTuring proved that, in general, there are functions not computable by means of<br \/>\nalgorithms. In other words, there are problems non solvable simply by means of sets of<br \/>\ninstructions. For example the &#8220;halting problem&#8221; is incomputable. This means that a<br \/>\nmechanical procedure, able to tell us if a certain computer program will halt after a<br \/>\nfinite number of steps, cannot exist. In general, information is too rich to be derived<br \/>\nfrom a limited number of instructions.\n<\/p><\/blockquote>\n<p> This is a thoroughly dreadful pile of crap. Turing <em>did<\/em> show that some<br \/>\nthings were non-computable &#8211; that&#8217;s <a href=\"http:\/\/en.wikipedia.org\/wiki\/Halting_problem\">the Halting Theorem<\/a>. But the<br \/>\nstep from that to &#8220;information is too rich&#8221; is a complete non-sequitur. Worse, it&#8217;s a<br \/>\n<em>meaningless<\/em> statement. &#8220;information is too rich&#8221; is an incomplete statement:<br \/>\n<em>what<\/em> information? A statement like that <em>cannot<\/em> stand on its own.<br \/>\n<em>Information<\/em> can be generated by <em>anything<\/em> &#8211; finite sets of<br \/>\ninstructions, noise on a telephone line, emissions of a particular wavelength from a<br \/>\nstar &#8211; all produce information. That statement is ill-formed &#8211; it has no meaning. And<br \/>\nthe description of Turing as a whole is, once again, thoroughly misleading. They quite<br \/>\ndeliberately leave Turing&#8217;s greatest contributions: the fundamental concept of the<br \/>\nuniversal computing machine, and the meaning of computation!<\/p>\n<p> On to Chaitin!<\/p>\n<blockquote>\n<p>Chaitin saw relations between the G\u00f6del&#8217;s results and Turing&#8217;s ones. G\u00f6del&#8217;s incompleteness and Turing&#8217;s incomputability are two aspects of the same problem. Chaitin expressed that problem yet another way. In AIT one defines the algorithmic complexity H(x) of a bit string &#8220;x&#8221; as the minimal computer program able to output it. When H(x) is near equal to &#8220;x&#8217; one says the &#8220;x&#8221; string is &#8220;uncompressible&#8221; or &#8220;irreducibly complex&#8221; (IC). In other words it contains &#8220;non-minimizable&#8221; information. Expressed in AIT terminology, the G\u00f6del&#8217;s and Turing&#8217;s theorems prove that the major part of information in different fields is in general uncompressible. In particular a Turing machine (a specialized computer) is an uncompressible system. The AIT definition of complexity can be related to the concepts of the ID theory. The information algorithmic content H(x) is related to &#8220;complex specified information&#8221; (CSI). Moreover the information incompressibility of AIT is related to the &#8220;irreducible complexity&#8221; concept (IC).<\/p>\n<\/blockquote>\n<p> Once again, we get a dreadful misrepresentation, full of errors.<\/p>\n<p> A Turing machine is <em>not<\/em> an uncompressible system. In fact, the statement<br \/>\nthat a Turing machine is uncompressible is, once again, an incomplete statement. A<br \/>\nTuring machine is <em>a general construct<\/em>: there are an infinite number of Turing<br \/>\nmachines that compute the same result. The <em>smallest<\/em> of those machines <em>might be<\/em> uncompressible &#8211; or their might be a smaller device that could compute the same result. (For example, a Turing machine that computes a decision<br \/>\nfunction on a simple regular language would likely be larger than an equivalent NFA; in that case, the Turing machine for the language would <em>not<\/em> be considered a non-compressible description of the language.)<\/p>\n<p> And they get worse. They claim that the information content described by Chaitin<br \/>\ntheory is related to CSI &#8211; when in fact, <a href=\"http:\/\/scientopia.org\/blogs\/goodmath\/2006\/06\/dembskis-profound-lack-of-comprehension-of-information-theory\">as I&#8217;ve argued before, CSI is <em>gibberish<\/em> in terms of Chaitin<\/a>; and they claim that non-compressibility is related to irreducible complexity. That last is true &#8211; except that that&#8217;s <em>not<\/em> a good thing for their argument: <a href=\"http:\/\/scientopia.org\/blogs\/goodmath\/2006\/06\/the-problem-with-irreducibly-complexity-revised-post-from-blogger\">as I&#8217;ve explained before<\/a>, Chaitin has proved in his theory that it is <em>impossible<\/em> to recognize when something is uncompressible &#8211; and in terms of irreducible complexity, that means that it is impossible to determine<br \/>\nwhether or not something is IC!<\/p>\n<p> Next, they get around to starting to make their real argument: that somehow,<br \/>\nthe kinds of incompleteness results that were proven by Turing, G&ouml;del, and Chaitin somehow imply that there must be an intelligent agent intervening to make life work:<\/p>\n<blockquote>\n<p>In the origin-of-life biological problem we have as inputs: matter (atoms of chemical elements), energy (in all its forms), natural laws and randomness. Evolutionists believe that these inputs are sufficient to obtain a living cell without the need of intelligence. Natural laws are a set of rules. ID theorists believe these laws are intelligently designed. Moreover they think the universe is fine tuned for life. Randomness is the simplest rule: a blind choice among atoms. If evolutionists were right, accordingly to the AIT terminology, the algorithmic complexity of cell would be compressible. Life would have an information content reducible.<\/p>\n<\/blockquote>\n<p> This is <em>absolutely<\/em> incorrect, on two levels. <\/p>\n<p> First, according to Chaitin, randomness is <b>by definition<\/b> uncompressible. In fact, per Chaitin, it&#8217;s remarkably easy to prove that <em>most things<\/em> are uncompressible. We <em>would not<\/em> expect the outcome of a purely random process to have a low (i.e., highly compressible) information content. <\/p>\n<p> Second, evolution <em>is not<\/em> a random process. It&#8217;s a highly <em>selective<\/em> process. So in fact, we would <em>expect<\/em> the results of<br \/>\nevolution to be <em>more<\/em> compressible that true randomness, and most likely<br \/>\n<em>less compressible<\/em> than something produced by a design process driven by<br \/>\nan intelligent agent.<\/p>\n<p> The rest of the paper just continually rehashes the same points made in the quoted sections. They repeat their mischaracterizations of the work of G&ouml;del,<br \/>\nTuring, and Chaitin. They repeat their errors concerning &#8220;the complexity of information&#8221;. They repeat their errors about randomness not being able to produce uncompressible information. And they add a few more long-winded non-sequiturs. But there&#8217;s no more actual content to this paper. In fact,  it&#8217;s a highly compressible mish-mash. Which is, in fact, the only part of their paper that actually supports their argument: because clearly this mess is <em>not<\/em> the result of intelligent design, and yet, it&#8217;s highly compressible.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>I haven&#8217;t taken a look at Uncommon Descent in a while; seeing the same nonsense get endlessly rehashed, seeing anyone who dares to express disagreement with the moderators get banned, well, it gets old. But then&#8230; Last week, DaveScott (which is, incidentally, a psueudonym!) decided to retaliate against my friend and fellow ScienceBlogger Orac, by [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":false,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[16,30,31],"tags":[],"class_list":["post-302","post","type-post","status-publish","format-standard","hentry","category-debunking-creationism","category-information-theory","category-intelligent-design"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_shortlink":"https:\/\/wp.me\/p4lzZS-4S","jetpack_sharing_enabled":true,"jetpack_likes_enabled":true,"_links":{"self":[{"href":"http:\/\/www.goodmath.org\/blog\/wp-json\/wp\/v2\/posts\/302","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/www.goodmath.org\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/www.goodmath.org\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/www.goodmath.org\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/www.goodmath.org\/blog\/wp-json\/wp\/v2\/comments?post=302"}],"version-history":[{"count":0,"href":"http:\/\/www.goodmath.org\/blog\/wp-json\/wp\/v2\/posts\/302\/revisions"}],"wp:attachment":[{"href":"http:\/\/www.goodmath.org\/blog\/wp-json\/wp\/v2\/media?parent=302"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/www.goodmath.org\/blog\/wp-json\/wp\/v2\/categories?post=302"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/www.goodmath.org\/blog\/wp-json\/wp\/v2\/tags?post=302"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}