|
|
| |
EDGE 21 — July 8, 1997
THE THIRD CULTUREDARWIN AMONG THE MACHINES;
OR, THE ORIGINS OF [ARTIFICIAL] LIFE
A Presentation by George DysonIn examining the prospects for artificial intelligence and artificial life Samuel Butler (1835-1902) faced the same mysteries that permeate these two subjects today. "I first asked myself whether life might not, after all, resolve itself into the complexity of arrangement of an inconceivably intricate mechanism," he recalled in 1880, retracing the development of his ideas. "If, then, men were not really alive after all, but were only machines of so complicated a make that it was less trouble to us to cut the difficulty and say that that kind of mechanism was 'being alive,' why should not machines ultimately become as complicated as we are, or at any rate complicated enough to be called living, and to be indeed as living as it was in the nature of anything at all to be? If it was only a case of their becoming more complicated, we were certainly doing our best to make them so."
THE REALITY CLUBResponses to George Dyson by Daniel C. Dennett, Lee Smolin, Jaron Lanier & Tim Race
Daniel C. Dennett, Jaron Lanier & Paolo Pignatelli on Charles Simonyi's "Intentional Programming"
Piet Hut & Lee Smolin: An Exchange
LETTERSLawrence Wilkinson & Stewart Brand
(13,387 words)
John Brockman, Editor and Publisher | Kip Parent, Webmaster
THE THIRD CULTURE
DARWIN AMONG THE MACHINES;
OR, THE ORIGINS OF [ARTIFICIAL] LIFE
A Presentation by George DysonI got to know George Dyson by attending several of Esther Dyson's PC Forum conferences, annual gatherings for the elite of the personal computer and software worlds. He was not a speaker, not even an industry player, just the younger brother. So why was I spending most of my free time hanging out and talking to him and not to the powers-that-be in the digital world?
An answer to this question can be gleaned by a reading of his new book about the evolution of mind and computers that derives both its title and outlook from Samuel Butler's 1863 essay "Darwin Among the Machines." Observing the beginnings of miniaturization, self reproduction, and telecommunication among machines, Butler predicted that Nature's intelligence, only temporarily subservient to technology, would resurface to reclaim our creations as her own. Updating Butler's arguments, George has distilled the historical record to chronicle the origins of digital telecommunications and the evolution of digital computers.
George views the World Wide Web as a globally networked, electronic, sentient being. In the evolution of mind in the electronic network, on a level transcending our own, he finds that nature is on the side of the machines. As Danny Hillis noted: "history with a future."-
JB
GEORGE DYSON as a young man lived in a tree house perched ninety-five feet off the ground in a Douglas fir in the British Columbia rain forest. He is the leading authority in the field of Russian Aleut kayaks and author of Baidarka. His work, and his relationship with his father, physicist Freeman Dyson, was portrayed in 1978 by Kenneth Brower in his classic book, The Starship and the Canoe. He has been a subject of the PBS television show Scientific American Frontiers. Dyson is the author of the recently published Darwin Among the Machines: the Evolution of Global Intelligence (Helix Books). He now lives in Bellingham, Washington.
DARWIN AMONG THE MACHINES;
OR, THE ORIGINS OF [ARTIFICIAL] LIFE
A Presentation by George Dyson
Exactly seven years ago, I found myself weaving through midtown Manhattan traffic with John Brockman, on our way to the Metropolitan Club, where Hugh Downs was to introduce my Reality Club debut presentation, "Baidarka: The Skin Boat as a Frame of Mind." I've been weaving in and out of traffic with Brockman ever since. Today he brings me back to the Reality Club to present some excerpts from my new book.The following selections concern the dual origins of (artificial) life. I choose this subject for three reasons (besides the origins of life being a question that so many of us have been asking ourselves):
1) the dual-origin theory allows me to credit my father, Freeman Dyson, with a hypothesis that may or may not apply correctly to the appearance of life the first time around. Right or wrong, the hypothesis deserves a second chance;2) the work of Nils Barricelli at the Institute for Advanced Study in the 1950s, summarized here, has not received the attention or recognition it deserves;
3) the speculations and misconceptions of an amateur such as myself are sure to provoke discussion among the many professionals who subscribe to Brockman's list.-George Dyson
p.s. BTW, I thought the conversation with Simonyi in EDGE 20 ("Intentional Programming: A Talk with Charles Simonyi") was great, and in a way the stuff I selected is a follow-up to his ideas.-
GEORGE DYSON: In examining the prospects for artificial intelligence and artificial life Samuel Butler (1835-1902) faced the same mysteries that permeate these two subjects today. "I first asked myself whether life might not, after all, resolve itself into the complexity of arrangement of an inconceivably intricate mechanism," he recalled in 1880, retracing the development of his ideas. "If, then, men were not really alive after all, but were only machines of so complicated a make that it was less trouble to us to cut the difficulty and say that that kind of mechanism was 'being alive,' why should not machines ultimately become as complicated as we are, or at any rate complicated enough to be called living, and to be indeed as living as it was in the nature of anything at all to be? If it was only a case of their becoming more complicated, we were certainly doing our best to make them so."
These questions can be distilled into one essential puzzle: the origin of life. "We wanted to know whence came that germ or those germs of life which, if Mr. Darwin was right, were once the world's only inhabitants," asked Butler "They could hardly have come hither from some other world; they could not in their wet, cold, slimy state have travelled through the dry ethereal medium which we call space, and yet remained alive. If they travelled slowly, they would die, if fast, they would catch fire." The only viable answer, without recourse to some higher being "at variance with the whole spirit of evolution," was that life "had grown up, in fact, out of the material substances and forces of the world"—as life might once again be growing up out of the material substances and forces of machines.
Freeman J. Dyson, a mathematical physicist better known as one of the architects of quantum electrodynamics, took a midcareer detour into theoretical biology that resulted in a thin volume titled Origins of Life. The essence of my father's hypothesis was that life began not once, but twice. "It is often taken for granted that the origin of life is the same thing as the origin of replication," he wrote, noting "a sharp distinction between replication and reproduction.Š Cells can reproduce but only molecules can replicate. In modern times, reproduction of cells is always accompanied by replication of molecules, but this need not always have been so.Š Either life began only once, with the functions of replication and metabolism already present in rudimentary form and linked together from the beginning, or life began twice, with two separate kinds of creatures, one kind capable of metabolism without exact replication, the other kind capable of replication without metabolism.ŠThe most striking fact which we have learned about life as it now exists is the ubiquity of dual structure, the division of every organism into hardware and software components, into protein and nucleic acid. I consider dual structure to be prima facie evidence of dual origin. If we admit that the spontaneous emergence of protein structure and of nucleic acid structure out of molecular chaos are both unlikely, it is easier to imagine two unlikely events occurring separately over a long period of time."
Over a period of twenty years, Dyson developed a toy mathematical model that "allows populations of several thousand molecular units to make the transition from disorder to order with reasonable probability." These self-sustaining—and haphazardly reproducing—autocatalytic systems then provide energy (and information) gradients hospitable to the development of replication, perhaps first of parasites infecting the metabolism of primitive precursors of modern cells. Once metabolism is infected by replication, as the Darwins showed us, natural selection will do the rest.
Natural selection does not require replication; statistically approximate reproduction, for simple creatures, is good enough. The difference between replication (producing an exact copy) and reproduction (producing a similar copy) is the basis of a broad generalization: genes replicate but organisms reproduce. As organisms became more complicated, they discovered how to replicate instructions (genes) that could help them reproduce; looking at it the other way around, as instructions became more complicated, they discovered how to reproduce organisms to help replicate the genes.
If organisms truly replicated, or reproduced even an approximate likeness of themselves without following a distinct set of inherited instructions, we would have Lamarckian evolution, with acquired characteristics transmitted to the offspring. According to the dual-origin hypothesis, natural selection may have operated in a purely statistical fashion for millions if not hundreds of millions of years before self-replicating instructions took control. This brings us back to Butler versus Darwin, because during this extended evolutionary prelude Lamarckian, not neo-Darwinian, selection would have been at work. We should think twice before dismissing Lamarck because Lamarckian evolution may have taken our cells the first—and most significant—step toward where we stand today. Genotype and phenotype may have started out synonymous and only later become estranged by the central dogma of molecular biology that allows communication from genotype to phenotype but not the other way. Life, however, arrives at distinctions by increments and rarely erases its steps. Remnants of Lamarckian evolution may be more prevalent, biologically, than we think—not to mention Lamarckian tendencies among machines.
My father asked three fundamental questions: "Is life one thing or two things? Is there a logical connection between metabolism and replication? Can we imagine metabolic life without replication, or replicative life without metabolism?" These same three questions surround the origin(s) of life among machines. Here, too, a dual-origin hypothesis can shift the balance of probabilities in life's favor once the distinction between reproduction and replication is understood. In looking for signs of artificial life, either on the loose or cooked up in the laboratory, however permeable this distinction may prove to be, one should expect to see signs of metabolism without replication and replication without metabolism first. If we look at the world around us, we see a prolific growth of electronic metabolism, populated by virulently replicating code—just as the dual-origin hypothesis predicts. The origins of this go back (at least) to the inauguration of John von Neumann's high-speed electronic digital computer at the Institute for Advanced Study in 1951.
"During the summer of 1951," according to Julian Bigelow, "a team of scientists from Los Alamos came and put a large thermonuclear calculation on the IAS machine; it ran for 24 hours without interruption for a period of about 60 days, many of the intermediate results being checked by duplicate runs, and throughout this period only about half a dozen errors were disclosed. The engineering group split up into teams and was in full-time attendance and ran diagnostic and test routines a few times per day, but had little else to do. So it had come alive."
The age of digital computers dawned over the New Jersey countryside while a series of thermonuclear explosions, led by the MIKE test at Eniwetok Atoll on 1 November 1952, corroborated the numerical results. In 1953, a series of experiments performed at the Institute for Advanced Study demonstrated that digital computers could be used not only to develop the means of destroying life, but to spawn lifelike processes of a form so far entirely unknown.
Italian-Norwegian mathematician Nils Aall Barricelli (1912-1993) arrived at the Institute as a visiting member for the spring term of 1953. Barricelli initiated extensive tests of evolution theories in 1953, 1954, and 1956, using the IAS computer to develop a working model of Darwinian evolution and to investigate the role of symbiogenesis in the origin of life. The theory of symbiogenesis was introduced in 1909 by Russian botanist Konstantin S. Merezhkovsky (1855-1921) and expanded by Boris M. Kozo-Polyansky (1890-1957) in 1924. "So many new facts arose from cytology, biochemistry, and physiology, especially of lower organisms," wrote Merezhkovsky in 1909, "that [in] an attempt once again to raise the curtain on the mysterious origin of organismsŠ I have decided to undertakeŠ a new theory on the origin of organisms, which, in view of the fact that the phenomenon of symbiosis plays a leading role in it, I propose to name the theory of symbiogenesis." Symbiogenesis offered a controversial adjunct to Darwinism, ascribing the complexity of living organisms to a succession of symbiotic associations between simpler living forms. Lichens, a symbiosis between algae and fungi, sustained life in the otherwise barren Russian north; it was only natural that Russian botanists and cytologists took the lead in symbiosis research. Taking root in Russian scientific literature, Merezhkovsky's ideas were elsewhere either ignored or declared unsound, most prominently by Edmund B. Wilson's dismissal of symbiogenesis as "an entertaining fantasyŠ that the dualism of the cell in respect to nuclear and cytoplasmic substance resulted from the symbiotic association of two types of primordial microorganisms, that were originally distinct."
Merezhkovsky viewed both plant and animal life as the result of a combination of two plasms: mycoplasm, represented by bacteria, fungi, blue-green algae, and cellular organelles; and amoeboplasm, represented by certain "monera without nuclea" that formed the nonnucleated material at the basis of what we now term eukaryotic cells. Merezhkovsky believed that mycoids came first. When they were eaten by later-developing amoeboids they learned to become nuclei rather than lunch. It is equally plausible that amoeboids came first, with mycoids developing as parasites later incorporated symbiotically into their hosts. The theory of two plasms undoubtedly contains a germ of truth whether the details are correct or not. Merezhkovsky's two plasms of biology were mirrored in the IAS experiments by embryonic traces of the two plasms of computer technology—hardware and software—that were just beginning to coalesce.
The theory of symbiogenesis assumes that the most probable explanation for improbably complex structures (living or otherwise) lies in the association of less complicated parts. Sentences are easier to construct by combining words than by combining letters. Sentences then combine into paragraphs, paragraphs combine into chapters, and, eventually, chapters combine to form a book—highly improbable, but vastly more probable than the chance of arriving at a book by searching the space of possible combinations at the level of letters or words. It was apparent to Merezhkovsky and Kozo-Polyansky that life represents the culmination of a succession of coalitions between simpler organisms, ultimately descended from not-quite-living component parts. Eukaryotic cells are riddled with evidence of symbiotic origins, a view that has been restored to respectability by Lynn Margulis in recent years. But microbiologists arrived too late to witness the symbiotic formation of living cells.
Barricelli enlarged on the theory of cellular symbiogenesis, formulating a more general theory of "symbioorganisms," defined as any "self-reproducing structure constructed by symbiotic association of several self-reproducing entities of any kind." Extending the concept beyond familiar (terrestrial) and unfamiliar (extraterrestrial) chemistries in which populations of self-reproducing molecules might develop by autocatalytic means, Barricelli applied the same logic to self-reproducing patterns of any nature in space or time—such as might be represented by a subset of the 40,960 bits of information, shifting from microsecond to microsecond within the memory of the new machine at the IAS. "The distinction between an evolution experiment performed by numbers in a computer or by nucleotides in a chemical laboratory is a rather subtle one," he observed.
Barricelli saw the IAS computer as a means of introducing self-reproducing structures into an empty universe and observing the results. "The Darwinian idea that evolution takes place by random hereditary changes and selection has from the beginning been handicapped by the fact that no proper test had been found to decide whether such evolution was possible and how it would develop under controlled conditions," he reported in a review of the experiments performed at the IAS. "A test using living organisms in rapid evolution (viruses or bacteria) would have the serious drawback that the causes of adaptation or evolution would be difficult to state unequivocally, and Lamarckian or other kinds of interpretation would be difficult to exclude. However if, instead of using living organisms, one could experiment with entities which, without any doubt could evolve exclusively by 'mutations' and selection, then and only then would a successful evolution experiment give conclusive evidence; the better if the environmental factors also are under control as for example if they are limited to some sort of competition between the entities used."
After forty-three years, Barricelli's experiments appear as archaic as Galileo's first attempt at a telescope—less powerful than half a pair of cheap binoculars—although Galileo's salary was doubled by the Venetian Senate in 1609 as a reward. The two Italians compensated for their primitive instruments with vision that was clear. Barricelli tailored his universe to fit within the limited storage capacity of the IAS computer's forty Williams tubes: a total of one two-hundredth of a megabyte, in the units we use today. Operating systems and programming languages did not yet exist. "People had to essentially program their problems in 'absolute'," James Pomerene explained, recalling early programming at the IAS, when every single instruction had to be hand-coded to refer to an absolute memory address. "In other words, you had to come to terms with the machine and the machine had to come to terms with you."
Working directly in binary machine instruction code, Barricelli constructed a cyclical universe of 512 cells, each cell occupied by a number (or the absence of a number) encoded by 8 bits. Simple rules that Barricelli referred to as "norms" governed the propagation of numbers (or "genes"), a new generation appearing as if by metamorphosis after the execution of a certain number of cycles by the central arithmetic unit of the machine. These reproduction laws were configured "to make possible the reproduction of a gene only when other different genes are present, thus necessitating symbiosis between different genes." The laws were concise, ordaining only that each number shift to a new location (in the next generation) determined by the location and value of certain genes in the current generation. Genes depended on each other for survival, and cooperation (or parasitism) was rewarded with success. A secondary level of norms (the "mutation rules") governed what to do when two or more different genes collided in one location, the character of these rules proving to have a marked effect on the evolution of the gene universe as a whole. Barricelli played God, on a very small scale.
The empty universe was inoculated with random numbers generated by drawing playing cards from a shuffled deck. Robust and self-reproducing numerical coalitions (patterns loosely interpreted as "organisms") managed to evolve. "We have created a class of numbers which are able to reproduce and to undergo hereditary changes," Barricelli announced. "The conditions for an evolution process according to the principle of Darwin's theory would appear to be present. The numbers which have the greatest survival in the environmentŠ will survive. The other numbers will be eliminated little by little. A process of adaptation to the environmental conditions, that is, a process of Darwinian evolution, will take place." Over thousands of generations, Barricelli observed a succession of "biophenomena," such as successful crossing between parent symbioorganisms and cooperative self-repair of damage when digits were removed at random from an individual organism's genes.
The experiments were plagued by problems associated with more familiar forms of life: parasites, natural disasters, and stagnation when there were no environmental challenges or surviving competitors against which organisms could exercise their ability to evolve. To control the parasites that infested the initial series of experiments in 1953, Barricelli instituted modified shift norms that prevented parasitic organisms (especially single-gened parasites) from reproducing more than once per generation, thereby closing a loophole through which they had managed to overwhelm more complex organisms and bring evolution to a halt. "Deprived of the advantage of a more rapid reproduction, the most primitive parasites can hardly compete with the more evolved and better organized speciesŠ and what in other conditions could be a dangerous one-gene parasite may in this region develop into a harmless or useful symbiotic gene."
Barricelli discovered that evolutionary progress was achieved not so much through chance mutation as through sex. Gene transfers and crossing between numerical organisms were strongly associated with both adaptive and competitive success. "The majority of the new varieties which have shown the ability to expand are a result of crossing-phenomena and not of mutations, although mutations (especially injurious mutations) have been much more frequent than hereditary changes by crossing in the experiments performed." Echoing the question that Samuel Butler had asked seventy years earlier in Luck, or Cunning? Barricelli concluded that "mutation and selection alone, however, proved insufficient to explain evolutionary phenomena." He credited symbiogenesis with accelerating the evolutionary process and saw "sexual reproduction [as] the result of an adaptive improvement of the original ability of the genes to change host organisms and recombine."
Symbiogenesis leads to parallel processing of genetic code, both within an individual multicellular organism and across the species as a whole. Given that nature allows a plenitude of processors but a limited amount of time, parallel processing allows a more efficient search for those sequences that move the individual, and the species, ahead.
Efficient search is what intelligence is all about. "Even though biologic evolution is based on random mutations, crossing and selection, it is not a blind trial-and-error process," explained Barricelli in a later retrospective of his numerical evolution work. "The hereditary material of all individuals composing a species is organized by a rigorous pattern of hereditary rules into a collective intelligence mechanism whose function is to assure maximum speed and efficiency in the solution of all sorts of new problemsŠ and the ability to solve problems is the primary element of intelligence which is used in all intelligence tests.Š Judging by the achievements in the biological world, that is quite intelligent indeed."
A century after On the Origin of Species pitted Charles Darwin and Thomas Huxley against Bishop Wilberforce, there was still no room for compromise between the trial and error of Darwin's natural selection and the supernatural intelligence of a theological argument from design. Samuel Butler's discredited claims of species-level intelligence—neither the chance success of a blind watchmaker nor the predetermined plan of an all-knowing God—were reintroduced by Barricelli, who claimed to detect faint traces of this intelligence in the behavior of pure, self-reproducing numbers, just as viruses were first detected by biologists examining fluids from which they had filtered out all previously identified living forms.
"The notion that no intelligence is involved in biological evolution may prove to be as far from reality as any interpretation could be," Barricelli argued later, in 1963. "When we submit a human or any other animal for that matter to an intelligence test, it would be rather unusual to claim that the subject is unintelligent on the grounds that no intelligence is required to do the job any single neuron or synapse in its brain is doing. We are all agreed upon the fact that no intelligence is required in order to die when an individual is unable to survive or in order not to reproduce when an individual is unfit to reproduce. But to hold this as an argument against the existence of an intelligence behind the achievements in biological evolution may prove to be one of the most spectacular examples of the kind of misunderstandings which may arise before two alien forms of intelligence become aware of one another." Likewise, to conclude from the failure of individual machines to act intelligently that machines are not intelligent may represent a spectacular misunderstanding of the nature of intelligence among machines.
The evolution of digital symbioorganisms took less time to happen than to describe. "Even in the very limited memory of a high speed computer a large number of symbioorganisms can arise by chance in a few seconds," Barricelli reported. "It is only a matter of minutes before all the biophenomena described can be observed." The digital universe had to be delicately adjusted so that evolutionary processes were not immobilized by dead ends. Scattered among the foothills of the evolutionary fitness landscape were local maxima from which "it is impossible to change only one gene without getting weaker organisms." In a closed universe inhabited by simple organisms, the only escape to higher ground was by exchanging genes with different organisms or by local shifting of the rules. "Only replacements of at least two genes can lead from a relative maximum of fitness to another organism with greater vitality," noted Barricelli, who found that the best solution to these problems (besides the invention of sex) was to build a degree of diversity into the universe itself.
"The Princeton experiments were continued for more than 5,000 generations using universes of 512 numbers," Barricelli reported. "Moreover, the actual size of the universe was usually increased far beyond 512 numbers by running several parallel experiments with regular interchanging of several (50 to 100) consecutive numbers between two universes.Š Within a few hundred generations a single primitive variety of symbioorganism invaded the whole universe. After that stage was reached no collisions leading to new mutations occurred and no evolution was possible. The universe had reached a stage of 'organized homogeneity' which would remain unchanged for any number of following generations.Š In many instances a new mutation rule would lead to a complete disorganization of the whole universe, apparently due to the death by starvation of a parasite, which in this case was the last surviving organism.Š Homogeneity problems were eventually overcome by using different mutation rules in different sections of each universe. Also slight modifications of the reproduction rule were used in different universes to create different types of environmentŠ by running several parallel experiments and by exchanging segments between two universes every 200 or 500 generations it was possible to break homogeneity whenever it developed in one of the universes."
As Alan Turing had blurred the distinction between intelligence and non-intelligence by means of his universal machine, so Barricelli's numerical symbioorganisms blurred the distinction between living and nonliving things. Barricelli cautioned his audience against "the temptation to attribute to the numerical symbioorganisms a little too many of the properties of living beings," and warned that "the author takes no responsibility for inferences and interpretations which are not rigorous consequences of the facts presented." He stressed that although numerical symbioorganisms and known terrestrial life forms exhibited parallels in evolutionary behavior, this did not imply that numerical symbioorganisms were alive. "Are they the beginning of, or some sort of, foreign life forms? Are they only models?" he asked. "They are not models, not any more than living organisms are models. They are a particular class of self-reproducing structures already defined." As to whether they are living, "it does not make sense to ask whether symbioorganisms are living as long as no clear-cut definition of 'living' has been given." A clear-cut definition of "living" remains elusive to this day.
Barricelli's numerical organisms were like tropical fish in an aquarium, confined to an ornamental fragment of a foreign ecosystem, sealed behind the glass face of a Williams tube. The perforated cards that provided the only lasting evidence of their existence were lifeless imprints, skeletons preserved for study and display. The numerical organisms consisted of genotype alone and were far, far, simpler than even the most primitive viruses found in living cells (or computer systems) today. Barricelli knew that "something more is needed to understand the formation of organs and properties with a complexity comparable to those of living organisms. No matter how many mutations occur, the numbersŠ will never become anything more complex than plain numbers." Symbiogenesis—the forging of coalitions leading to higher levels of complexity—was the key to evolutionary success, but success in a closed, artificial universe has only fleeting meaning in our own. Translation into a more tangible phenotype (the interpretation or execution, whether by physical chemistry or other means, of the organism's genetic code) was required to establish a presence in our universe, if Barricelli's numerical symbioorganisms were to become more than laboratory curiosities, here one microsecond and gone the next.
Barricelli wondered "whether it would be possible to select symbioorganisms able to perform a specific task assigned to them. The task may be any operation permitting a measure of the performance reached by the symbioorganisms involved; for example, the task may consist in deciding the moves in a game being played against a human or against another symbioorganism." In a later series of experiments (performed on an IBM 704 computer at the AEC computing laboratory at New York University in 1959 and at Brookhaven National Laboratory in 1960) Barricelli evolved a class of numerical organisms that learned to play a simple but non-trivial game called "Tac-Tix," played on a 6-by-6 board and invented by Piet Hein. The experiment was configured so as to relate game performance to reproductive success. "With present speed, it may take 10,000 generations (about 80 machine hours on the IBM 704Š) to reach an average game quality higher than 1," Barricelli estimated, this being the quality expected of a rank human beginner playing for the first few times. In 1963, using the large Atlas computer at Manchester University, this objective was achieved for a short time, but without further improvement, a limitation that Barricelli attributed to "the severe restrictionsŠ concerning the number of instructions and machine time the symbioorganisms were allowed to use."
In contrast to the IAS experiments, in which the numerical symbioorganisms consisted solely of genetic code, the Tac-Tix experiments led to "the formation of non-genetic numerical patterns characteristic for each symbioorganism. Such numerical patterns may present unlimited possibilities for developing structures and organs of any kind to perform the tasks for which they are designed." A numerical phenotype had taken form. This phenotype was interpreted as moves in a board game, via a limited alphabet of machine instructions to which the gene sequence was mapped, just as sequences of nucleotides code for an alphabet of amino acids in translating proteins from DNA. "Perhaps the closest analogy to the protein molecule in our numeric symbioorganisms would be a subroutine which is part of the symbioorganism's game strategy program, and whose instructions, stored in the machine memory, are specified by the numbers of which the symbioorganism is composed," Barricelli explained. In coding for valid instructions at the level of phenotype rather than genotype, evolutionary search is much more likely to lead to meaningful sequences, for the same reason that a meaningful sentence is far more likely to be evolved by choosing words out of a dictionary than by choosing letters out of a hat.
A purely numerical sequence could, in principle (and in time) evolve to be translated, through any number of intermediary languages, into anything else. "Given a chance to act on a set of pawns or toy bricks of some sort the symbioorganisms will 'learn' how to operate them in a way which increases their chance for survival," Barricelli explained. "This tendency to act on any thing which can have importance for survival is the key to the understanding of the formation of complex instruments and organs and the ultimate development of a whole body of somatic or non-genetic structures." Once the concept of translation from genotype to phenotype is given form, Darwinian evolution picks up speed—not just the evolution of organisms, but the evolution of the genetic language and translation system that provide the flexibility and redundancy to survive in a noisy, unpredictable world. A successful interpretive language not only tolerates ambiguity, it takes advantage of it. "It is almost too easy to imagine possible uses for phenotype structures—because the specifications for an effective phenotype is so sloppy," wrote A. G. Cairns-Smith, in his Seven Clues to the Origin of Life . "A phenotype has to make life easier or less dangerous for the genes that (in part) brought it into existence. There are no rules laid down as to how this should be done."
Barricelli's pronouncements had a vaguely foreboding, Butler-ish air about them, despite the disclaimer about confusing "life-like" with "alive." Samuel Butler had warned that Darwin's irresistible logic applied not only to the kingdom of nature but to the kingdom of machines; Nils Barricelli now demonstrated that it was the kingdom of numbers that held the key to that "Great First Cause" of Erasmus Darwin's "one living filament," whether encoded as strings of nucleotides or as strings of electronic bits. Barricelli saw that electronic digital computers heralded an unprecedented change of evolutionary pace, just as Butler had seen evolution quickened by the age of steam.
Barricelli's use of biological terminology to describe self-reproducing code fragments is reminiscent of early pronouncements about artificial intelligence, when machines that processed information with less intelligence than a pocket calculator were referred to as machines that think. A relic from the age of vacuum tubes and giant brains, Barricelli's IAS experiments strike the modern reader as naïve—until you stop and reflect that numerical symbioorganisms have, in less than fifty years, proliferated explosively, deeply infiltrating the workings of life on earth. With our cooperation as symbiotic hosts, self-reproducing numbers are managing (Barricelli would say learning) to exercise increasingly detailed and far-reaching control over the conditions in our universe that are helping to make life more comfortable in theirs. Are the predictions of Samuel Butler and Nils Barricelli turning out to be correct?
"Since computer time and memory still is a limiting factor, the non-genetic patterns of each numeric symbioorganism are constructed only when they are needed and are removed from the memory as soon as they have performed their task," explained Barricelli, describing the Tac-Tix-playing organisms of 1959. He might as well have been describing that class of numerical symbioorganisms —computer software—that we execute and terminate from moment to moment today. "This situation is in some respects comparable to the one which would arise among living beings if the genetic material got into the habit of creating a body or a somatic structure only when a situation arises which requires the performance of a specific task (for instance a fight with another organism), and assuming that the body would be disintegrated as soon as its objective had been fulfilled."
The precursors of symbiogenesis in the von Neumann universe were order codes, conceived (in the Burks-Goldstine-von Neumann reports) before the digital matrix that was to support their existence had even taken physical form. Order codes constituted a fundamental alphabet that diversified in association with the proliferation of different hosts. In time, successful and error-free sequences of order codes formed into subroutines—the elementary units common to all programs, just as a common repertoire of nucleotides is composed into strings of DNA. Subroutines became organized into an expanding hierarchy of languages, which then influenced the computational atmosphere as pervasively as the oxygen released by early microbes influenced the subsequent course of life.
By the 1960s complex numerical symbioorganisms known as operating systems had evolved, bringing with them entire ecologies of symbionts, parasites, and coevolving hosts. The most successful operating systems, such as OS/360, MS-DOS, and UNIX, succeeded in transforming and expanding the digital universe to better propagate themselves. It took five thousand programmer-years of effort to write and debug the OS/360 code; the parasites and symbionts sprouted up overnight. There was strength in numbers. "The success of some programming systems depended on the number of machines they would run on," commented John Backus, principal author of Fortran, a language that has had a long and fruitful symbiosis with many hosts. The success of the machines depended in turn on their ability to support the successful languages; those that clung to dead languages or moribund operating systems became extinct.
The computational ecology grew by leaps and bounds. In 1954, IBM's model 650 computer shipped with 6,000 lines of code; the first release of OS/360 in 1966 totaled just under 400,000 instructions, expanding to 2 million instructions by the early 1970s. The total of all system software provided by the major computer manufacturers reached 1 million lines of code by 1959, and 100 million by 1972. The amount of random access memory in use worldwide, costing an average $4.00 per byte, reached a total of 1,000 megabytes in 1966, and a total of 10,000 megabytes, at an average cost of $1.20 per byte, in 1971. Annual sales of punched cards by U. S. manufacturers exceeded 200 billion cards (or 500,000 tons) in 1967, after which the number of cards began to decline in favor of magnetic tapes and disks.
In the 1970s, with the introduction of the microprocessor, a second stage of this revolution was launched. The replication of processors thousands and millions at a time led to the growth of new forms of numerical symbioorganisms, just as the advent of metazoans sparked a series of developments culminating in an explosion of new life-forms six hundred million years ago. New species of numerical symbioorganisms began to appear, reproduce, and become extinct at a rate governed by the exchange of floppy disks rather than the frequency of new generations of mainframes at IBM. Code was written, copied, combined, borrowed, and stolen among software producers as freely as in a primordial soup of living but only vaguely differentiated cells. Anyone who put together some code that could be executed as a useful process—like Dan Fylstra's Visicalc in 1979—was in for a wild ride. Businesses sprouted like mushrooms, supported by the digital mycelium underneath. Corporations came and went, but successful code lived on.
Twenty years later, fueled by an epidemic of packet-switching protocols, a particularly virulent strain of symbiotic code, the neo-Cambrian explosion entered a third and even more volatile phase. Now able to propagate at the speed of light instead of at the speed of circulating floppy disks, numerical symbioorganisms began competing not only for memory and CPU cycles within their local hosts but within a multitude of hosts at a single time. Successful code is now executed in millions of places at once, just as a successful genotype is expressed within each of an organism's many cells. The possibilities of complex, multicellular digital organisms are only beginning to be explored.
The introduction of distributed object-oriented programming languages (metalanguages, such as Java, that allow symbiogenesis to transcend the proprietary divisions between lower-level languages in use by different hosts) is enabling numerical symbioorganisms to roam, reproduce, and execute freely across the computational universe as a whole. Through the same hierarchical evolution by which order codes were organized into subroutines and subroutines into programs, objects, being midlevel conglomerations of code, will form higher-level structures distributed across the net. Object-oriented programming languages were first introduced some years ago with a big splash that turned out to be a flop. But what failed to thrive on the desktop may behave entirely differently on the Internet. Nils Barricelli, in 1985, drew a parallel between higher-level object-oriented languages and the metalanguages used in cellular communication, but he put the analogy the other way: "If humans, instead of transmitting to each other reprints and complicated explanations, developed the habit of transmitting computer programs allowing a computer-directed factory to construct the machine needed for a particular purpose, that would be the closest analogue to the communication methods among cells of various species."
But aren't these analogies deeply flawed? Software is designed, engineered, and reproduced by human beings; programs are not independently self-reproducing organisms selected by an impartial environment from the random variation that drives other evolutionary processes that we characterize as alive. The analogy, however, is valid, because the analog of software in the living world is not a self-reproducing organism, but a self-replicating molecule of DNA. Self-replication and self-reproduction have often been confused. Biological organisms, even single-celled organisms, do not replicate themselves; they host the replication of genetic sequences that assist in reproducing an approximate likeness of themselves. For all but the lowest organisms, there is a lengthy, recursive sequence of nested programs to unfold. An elaborate self-extracting process restores entire directories of compressed genetic programs and reconstructs increasingly complicated levels of hardware on which the operating system runs. That most software is parasitic (or symbiotic) in its dependence on a host metabolism, rather than freely self-replicating, strengthens rather than weakens the analogies with life.
In 1953, Nils Barricelli observed a digital universe in the process of being born. There was only a fraction of a megabyte of random access memory on planet Earth, and only part of it was working at any given time. "The limited capacity of even the largest calculating machines makes it impossible to operate with more than a few thousand genes at a time instead of the thousands of billions of genes and organisms with which nature operates," he wrote in 1957. "This makes it impossible to develop anything more than extremely primitive symbioorganisms even if the most suitable laws of reproduction are chosen." Not so today. Barricelli's universe has expanded explosively, providing numerical organisms with inexhaustible frontiers on which to grow.
"Given enough time in a sufficiently varied universe," predicted Nils Barricelli, "the numeric symbioorganisms might be able to improve considerably their technique in the use of evolutionary processes." In later years, Barricelli continued to apply the perspective gained through his IAS experiments to the puzzle of explaining the origins and early evolution of life. "The first language and the first technology on Earth was not created by humans. It was created by primordial RNA molecules almost 4 billion years ago," he wrote in 1986. "Is there any possibility that an evolution process with the potentiality of leading to comparable results could be started in the memory of a computing machine and carried on to a stage giving fundamental information on the nature of life?" He endeavored "to obtain as much information as possible about the way in which the genetic language of the living organisms populating our planet (terrestrial life forms) originated and evolved."
Barricelli viewed the genetic code "as a language used by primordial 'collector societies' of [transfer] RNA moleculesŠ specialized in the collection of amino acids and possibly other molecular objects, as a means to organize the delivery of collected material." He drew analogies between this language and the languages used by other collector societies, such as social insects, but warned that "trying to use the ant and bee languages as an explanation of the origin of the genetic code would be a gross misunderstanding." Languages are, however, the key to evolving increasingly complex, self-reproducing structures through the cooperation of simpler component parts.
According to Simen Gaure, Nils Barricelli "balanced on a thin line between being truly original and being a crank." Most cranks turn out to be cranks; a few cranks turn out to be right. "The scientific community needs a couple of Barricellis each century," added Gaure. As Barricelli's century draws to a close, the distinctions between A-life (represented by strings of electronic bits) and B-life (represented by strings of nucleotides) are being traversed by the first traces of a language that comprehends them both. Does this represent the gene's learning to manipulate the power of the bit, or does it represent the bit's learning to manipulate the power of the gene? As algae and fungi became lichen, the answer will be both. And it is the business of symbiogenesis to bring such coalitions to life.
Notes:
1. Samuel Butler, Unconscious Memory (London: David Bogue, 1880), reprinted as vol. 6 of The Shrewsbury Edition of the Works of Samuel Butler (London: Jonathan Cape, 1924), 13, 15.
2. Butler, Unconscious Memory, 13.
3. Freeman J. Dyson, Origins of Life (Cambridge: Cambridge University Press, 1985), 8-9.
4. Freeman J. Dyson, "A Model for the Origin of Life," Journal of Molecular Evolution 18 (1982): 344.
5. Dyson, Origins of Life, 5.
6. Julian Bigelow, "Computer Development at the Institute for Advanced Study," in Nicholas Metropolis, J. Howlett, and Gian-Carlo Rota, eds., A History of Computing in the Twentieth Century (New York: Academic Press, 1980), 308.
7. Konstantin S. Merezhkovsky, Theory of two Plasms as the Basis of Symbiogenesis, A New Study on the Origin of Organisms (in Russian; Kazan, 1909); Boris M. Kozo-Polyansky, A New Principle of Biology: Essay on the Theory of Symbiogenesis (in Russian; Moscow, 1924). The theory is most accessible in English in Liya N. Khakhina's Concepts of Symbiogenesis: A Historical and Critical Study of the Research of Russian Botanists (in Russian; Moscow, 1979) translated by Stephanie Merkel and edited by Lynn Margulis and Mark McMenamin (New Haven: Yale University Press, 1992).
8. Merezhkovsky, Theory of two Plasms as the Basis of Symbiogenesis, 8; after Khakina, Concepts of Symbiogenesis, ii.
9. Edmund B. Wilson, The Cell in Development and Heredity, 3d ed. (New York: Macmillan, 1925), 738.
10. Nils A. Barricelli, "Numerical Testing of Evolution Theories: Part I," Acta Biotheoretica, 16 (1962): 94.
11. Nils A. Barricelli, "Numerical Testing of Evolution Theories: Part II," Acta Biotheoretica, 16 (1962): 122.
12. Barricelli, "Numerical Testing of Evolution Theories: Part I," 70.
13. James Pomerene, interview by Nancy Stern, 26 September 1980, OH 31, Charles Babbage Institute, University of Minnesota, Minneapolis, MN.
14. Nils A. Barricelli, "Symbiogenetic Evolution Processes Realized by Artificial Methods," Methodos 9, nos. 35-36 (1957): 152.
15. Nils A. Barricelli, "Numerical Testing of Evolution Theories: Part I," 72.
16. Barricelli, "Symbiogenetic Evolution Processes Realized by Artificial Methods," 169.
17. Barricelli, "Symbiogenetic Evolution Processes Realized by Artificial Methods," 164.
18. Barricelli, "Numerical Testing of Evolution Theories: Part I," 70.
19. Barricelli, "Numerical Testing of Evolution Theories: Part I," 76.
20. Nils A. Barricelli, "Numerical Testing of Evolution Theories," Journal of Statistical Computation and Simulation 1 (1972): 123-124.
21. Nils Barricelli, "The Intelligence Mechanisms behind Biological Evolution," Scientia 98 (September 1963): 178-179.
22. Barricelli, "Numerical Testing of Evolution Theories: Part I," 94.
23. Barricelli, "Symbiogenetic Evolution Processes Realized by Artificial Methods," 159.
24. Barricelli, "Numerical Testing of Evolution Theories: Part I," 89.
25. Ibid., 69, 99.
26. Ibid., 94.
27. Ibid., 73.
28. Barricelli, "Numerical Testing of Evolution Theories: Part II," 100.
29. Ibid., 116.
30. Barricelli, "Numerical Testing of Evolution Theories," (1972), 122.
31. Barricelli, "Numerical Testing of Evolution Theories: Part II," 100.
32. Barricelli, "Numerical Testing of Evolution Theories," (1972), 126.
33. Barricelli, "Numerical Testing of Evolution Theories: Part II," 117.
34. G. Cairns-Smith, Seven Clues to the Origin of Life (Cambridge: Cambridge University Press, 1985), 106.
35. Barricelli, "Numerical Testing of Evolution Theories: Part II," 101.
36. John Backus, "Programming in America in the 1950sQSome Personal Impressions," in Metropolis, Howlett, and Rota, eds., A History of Computing in the Twentieth Century, 127.
37. Data in this paragraph are from Montgomery Phister, Jr., Data Processing Technology and Economics, second edition (Bedford, MA: Digital Press, 1979), 19, 26, 27, 215, 277, 531, 611.
38. Nils A. Barricelli, "The Functioning of Intelligence Mechanisms Directing Biologic Evolution," in Theoretic Papers 3, no. 7 (1985): 126.
39. Barricelli, "Symbiogenetic Evolution Processes Realized by Artificial Methods," 147.
40. Barricelli, "Numerical Testing of Evolution Theories," (1972) 126.
41. Nils Barricelli, "Genetic Language, its Origins and Evolution," Theoretic Papers 4, no. 6 (1986): 106-107.
42. Nils A. Barricelli, "On the Origin and Evolution of the Genetic Code, II: Origin of the Genetic Code as a Primordial Collector Language; The Pairing-Release Hypothesis," BioSystems 11 (1979): 19, 21.
THE REALITY CLUB
Responses to George Dyson by Daniel C. Dennett, Lee Smolin, Jaron Lanier & Tim Race
Daniel C. Dennett, Jaron Lanier & Paolo Pignatelli on Charles Simonyi's "Intentional Programming"
Piet Hut & Lee Smolin: An Exchange
Responses to George Dyson by Daniel C. Dennett, Lee Smolin, Jaron Lanier & Tim Race
From: Daniel Dennett
Submitted: 7.6.97I'm delighted to be introduced to Barricelli's pioneering work on Artificial Life. The obvious parallel is to Art Samuel's checkers program, a pioneering work in Artificial Intelligence from the same paleozoic era of computers. I wish there had been more details in Dyson's account of the actual program. I couldn't make out just how Barricelli's cells might be different from the cellular automata of today's Alife hackers. And I particularly wondered about the "self-repair of damage when digits were removed at random from an individual organism's genes." There is a big difference between "removing" and "replacing with zero." If Barricelli's self-repair phenomenon could re-insert a value, enlarging a genome that had shrunk by one locus, this is spectacular. If the self-repair is just editorially restoring a value that had been mistakenly set to zero, this is good, but not so spectacular. Most contemporary Alife models have genomes that are backstage--not really in the world being modeled. For this reason, there is no way for genomes to get larger, or otherwise change their system of phenotype-specification, which is, as it were, God-given. Almost paradoxically, the genome system cannot itself evolve in these models. John Holland's ECHO system is an exception; it has at least the possibility in principle of genome evolution, since the genome itself is in the world, built up of materials at an energetic cost. But in order to avail itself of this opportunity, the ECHO system would have to be much, much larger than it currently is.
One of the traps of simple modeling, it is now becoming all too clear, is that many phenomena observed in them are strictly artifactual, a product of the simplifying assumptions of the model. For instance, iterated Prisoner's Dilemma scenarios that assume panmixia or random "mating" produce dramatically different outcomes from those that complicate themselves in various plausible ways to include the costs and benefits of getting from place to place, recognizing individuals from prior encounters, and so forth. Which of Barricelli's tantalizing phenomena are false friends and which are glimpses of deep truths will take some sorting out. In Darwin's Dangerous Idea, I quote John Maynard Smith's confession of his early entrancement with Alan Turing's elegant ideas (1952) about morphogenesis:
"for years he was convinced that 'my fingers must be Turing
waves; my vertebrae must be Turing waves'--but he eventually
came to realize, reluctantly, that it could not be that
simple and beautiful." (p207n)Thanks to Lynn Margulis' work, symbiogenesis does now appear to be one of the established cranes of evolutionary lifting; what remains controversial is just how ubiquitous, powerful or even obligatory a crane it is. -
Dan Dennett
DANIEL C. DENNETT, a philosopher, is Director of the Center for Cognitive Studies, and Distinguished Arts and Sciences Professor at Tufts University. He is author of Darwin's Dangerous Idea: Evolution and the Meanings of Life, Consciousness Explained, Brainstorms, and coauthor with Douglas Hofstadter of The Mind's I.
From: Lee Smolin
Submitted: 7.6.97The story George Dyson tells is both beautiful and provocative, but on reflection I find I have doubts about the central metaphor, which is the analogy between software and the genetic code. There is of course something right about this: the sequence of bases in DNA or RNA is variable and can be seen as symbolically stored information that codes for the production of enzymes. As such they are something like a computer code that controls the robots in a factory that produce cars.
However, there are also differences between DNA and a computer program. The convenience of the metaphor connecting them, for those of us who have grown used to how computers work, may blind us to some of the complexities and realities of the real biological world. First of all, as Evelyn Fox Keller has been recently emphasizing, what is inherited in real biology is more than just a naked sequence of DNA. The new organism inherits also all the machinery of the cell, including that required to produce proteins as specified by the DNA. The recent cloning of a sheep was done by fusing two cells together, in one of which the nucleus had been destroyed, rather than simply replacing the DNA of one with that of the other. Second, the DNA itself functions as a kind of "computer" through the genetic regulatory networks that turn genes on and off. Some of this may even involve how the DNA molecule curls itself up into a knotted struccture. So the DNA itself is part hardware and part software.
Third, the genetic code is not able to run on arbitrary hardware. The code which governs which proteins are produced cannot "run" on any "machine" other than the cell of which it is a part. (Of course, it can exist as a record on a page or a memory that we manufacture, but as such it is sterile, for we know of no way to use the information to build actual enzymes except when it is expressed in terms of real RNA or DNA.) One way to see this is to ask whether the 64 kinds of molecules that implement the code by binding to both the RNA and the amino acids are part of the hardware or part of the software? Their structures code information as surely as does DNA, and they surely have evolved, and might even do so in the future. But over the life of a single cell they may as well be seen as part of the hardware. This suggests, I think, that the distinction between hardware and software in biology is at best a matter of time scale, and at worst greatly oversimplifies what is really happening.
The point, I think, is that in spite of what George Dyson so eloquently says,
there are real differences between a system that really did construct itself over time and computer programs that we write running on hardware that we build. The logic of natural selection requires self-replication, it does not really apply to the trivial fact that brands of cars or computers that people like better, or find most useful, are more common.This is not to say that DNA does not store information, or that there is not a code matching triads of bases to amino acids. Nor is it to say that natural selection cannot be modeled in a computer, as Dyson describes. But real DNA is a component of a system which is both hardware and software, instructions and machine. Analogizing the processes that go on in real biology to the running of a program on a digital computer may suggest some useful ideas, but it may just as well retard progress by giving us the impression that we understand biology, when there may very well be concepts that we will need to understand fully how life spontaneously arose and organized itself.
As an example of this, we may note that of the ideas that George Dyson describes, the ones that really illuminate the question of the origin of life are the proposals for dual origin and symbiosis, and these loose none of their content or interest if we divorce them from the analogy between software and the genetic code. -
LEE SMOLIN is a theoretical physicist; professor of physics and member of the Center for Gravitational Physics and Geometry at Pennsylvania State University; author of the recently published The Life of The Cosmos (Oxford).
From: Jaron Lanier
Submitted: 7.6.97Dyson's description of early A-life and origin-of-life ideas is wonderful. I love the research direction itself (such as the dual origins hypothesis).
I sometimes wonder if the A-life community isn't relying too much on one extreme of the spectrum of evolutionary theorists, the Dawkins side. At other points on the spectrum are found interesting thinkers, like Niles Eldredge or Stephen Jay Gould, who might contribute important ideas — about how species become stabilized for long periods of time, for instance.
The ideas about the possible early role of Lamarckian inheritance are fascinating. Lamarckian processes have come to the fore much more recently in the history of life on Earth, in the phenomena of human culture and ideas. How odd to find Darwin sandwiched between a Lamarckian origin and destination.
I must say that I'm a little bothered when A-life terminology is applied to the computer world at large.
The language of artificial life implicitly centers on an ontological claim, not an empirical one. One could state any hypothesis in either A-life terms or not without impeding the process of experimentation. One could say, "these organisms can evolve to understand this problem", or "this software could be adjusted through a trial and error process to become more efficient at this problem". In either case the same science can be done, but with different ontological costuming.
Is a virus alive? This question can have implications of an ethical, moral, or spiritual nature perhaps, but scientists who study viruses aren't loosing sleep over it. At one point Dyson says, "The perforated cards that provided the only lasting evidence of their existence were lifeless imprints, skeletons preserved for study and display." Surely one could argue these cards are more alive than a skeleton — after all they could still be read and run today, while a skeleton could not be resuscitated. Life is always in the eye of the beholder — there is no use in empirical science for an absolute definition of it.
But the definition of life can be important in other spheres of human activity. There's an odd, contradictory tendency in the A-life community — to on the one hand want to deny that humans have been sprinkled with some kind of "magic dust" of life or spirit, but at the same time to try to sprinkle the same magic dust on machines.
Software isn't being developed in laboratory conditions today so often as it's being created for use by people out in the world at large. It seems to me that the only ethical basis for engineering decisions has to be to improve the lives of humans. If we choose a humanistic ontology we'll have clearer heads for accomplishing that task.
The hallmark of bad computer design is that the engineers made decisions for the benefit of the computer, not for the people. If the way we think about software does effect its usefulness in the real world, but is neutral in the laboratory, then we should be pragmatic and choose the language of humanism.-
JARON LANIER, a computer scientist and musician, is a pioneer of virtual reality, and founder and former CEO of VPL.
From: Tim Race
Submitted: 7.8.97George Dyson, in considering the parallels between the origins, replication and reproduction of natural life and life-like machine output, is addressing a set of crucial questions about technology. His work reminds us that humans have long wrestled with issues like "Who or what created me?" and "Why am I here?" These are not only biological questions. They are essentially theological.
That's why it's important that writers like Dyson are pondering the larger implications of the artificial life that modern technology is spawning.
Through technology, humankind is increasingly becoming the Creator — of hardware (representing protein, in the Dyson thesis) and software (nucleic acid, for Dyson). The created machinery, in mimicking the evolution and even structure of natural life forms, may provide new insights into our own origins — and to the godlike role that technology can let us play.
At the same time, though, there is still so much we don't understand, as Dyson notes: "A clear cut definition of 'living' remains elusive to this day."
I recall a recent conversation I had with Terry Winograd, a professor of computer science at Stanford and co-author of "Understanding Computers and Cognition," who spent years researching and writing about artificial intelligence and now concentrates on the concepts behind the interaction of people and computing machinery.
"I am a materialist," Winograd told me. "Thought is electrical and chemical." And yet, he quickly added, "We don't really yet understand how people think." That's why seeming parallels between human thought and artificial intelligence almost inevitably prove themselves to be divergent lines. "Neural networks," for example, says Winograd, "are a very weak approximation of how human neurons really work."
I couldn't help thinking about this as I read Dyson's excerpts from "Darwin Among the Machines." It is a fascinating and useful thesis that natural life and machine life can both evolve through either reproduction or replication — or a combination of the two. But it is still difficult to extend very far the parallels between what we as humans create and experience and what machines may create and experience.
A premise of Enlightenment thinkers in the 18th century was that the universe was a mechanism — a watch, in which all the parts served necessary and interdependent parts. In the mechanical age, this was a useful metaphor, because it was based on the scientific and technological principles of that era. So, too, does digital technology today provide useful metaphors for our understanding of biology and the nature of life. But there are limits to that understanding — and thus, limits to the metaphor.
There are useful analogies to draw, for example, between computer code and genetic code. In fact, it was a comparison I brought up in my recent conversation with Winograd — who left me with something to ponder.
"Genetic code," he pointed out, "is an extremely indirect code. Computers encode behaviors. But DNA does not encode behaviors; it sets up protein processes. It's a very long way away from how an animal gets built."-
TIM RACE is business technology editor for The New York Times where he oversees a group of the nation's best technology writers — including Denise Caruso, Mark Landler, Lawrence M. Fisher, Steve Lohr, John Markoff, Seth Schiesel and Laurence Zuckerman — and is privy to the latest technological trends and developments well before the reading public becomes aware of them.
Daniel C. Dennett, Jaron Lanier & Paolo Pignatelli on Charles Simonyi's "Intentional Programming"
From: Daniel C. Dennett
Submitted: 7.6.97I was struck by a claim Charles Simonyi makes in passing in his fascinating discussion of Intentional Programming. He says that "languages used to be the only carriers of abstractions." This is a deceptively simple, straightforward claim, but it unpacks into a large set of issues. On the one hand, it draws attention to a problem that has long frustrated me, which might be called promiscuous linguaphilia: as soon as you discover something really wonderful, you express your admiration by saying it is [like] a language. So music is a language and art is a language, and body language is a language, and the way the brain represents reality is a language (Fodor's so-called Language of Thought, with which I have been doing battle for years). Is there anything wonderful and meaningful that ISN'T a language? Simonyi's claim draws attention to this by inviting (I can almost hear the chorus) the response: "Languages are STILL the only carriers of abstractions; your Intentional Programming is really just a sort of language--not audible or linear or with the syntax of a natural language, but still a language." Since I don't know enough about what Intentional Programming IS from the tantalizing description given I can only guess at how to support his insistence that it isn't just another [computer] language.
I want to know more. Is Simonyi or anybody else writing articles about Intentional Programming? It sounds almost too good to be true to my ears (including its name, of course), but one of the great virtues of computers is that they keep you honest sooner or later (because either you can come up with the code or you can't) and transmit that pressure inwards to the pronouncements, so I figure Simonyi has to be on to something good.
Has Brian Cantwell Smith's thinking played a role in Simonyi's? I think Brian's new book, ON THE ORIGINS OF OBJECTS, is as deep and original as any book by a philosopher (or computer scientist) on the topics of representation, ontology, and meaning, and since I think he arrived at PARC at about the same time Simonyi did I wouldn't be at all surprised to learn of another messenger RNA transfer here. Brian and I have been talking about these issues since his graduate student days at the MIT AI Lab in the early 70's, but it also strikes me that Brian's intellectual temperament is nearly opposite to Simonyi's. Did he, perhaps, "provoke" some of Simonyi's ideas instead of inspiring them?-
Dan Dennett
From: Jaron Lanier
Submitted: 7.6.97Everyone who has worked for a sustained period of time to improve information technology dreams of changing the way software is created. Software is really awful stuff to work with, but it comes on seductively at first. It seems at first to be a universal transmuter of pure ideas — which are made manifest and useful in the world once expressed through a machine. What could be more exciting to a young mind than that? Some of the brightest minds in the world are attracted by this freedom and they create marvels. And then when it comes time to get these marvels to connect together, or to keep them updated, or to fix mistakes in them, or even to understand fully what they do, the ugly, dark side of programming appears. I like to call the dark side "brittleness", meaning that software will rarely bend, while it will often break. The terminology varies, but most computer scientists would agree that the core task of the field is to change the character of software so that it becomes less brittle, more malleable.
The interview only describes Intentional Programming in a general way, so it's hard to tell much about the approach Charles is taking to this problem. But make no mistake, this is the hard stuff, the summit which every ambitious computer scientist tries to scale. I hope he finds some success. Maybe he'll even make it all the way to the top. I'd love to know more about his plan.
I spent many years on my own approach to this problem of problems. The language and metaphors I used were quite different, but I know the problem and the passion well. I didn't make it to the summit myself, though I think I might have glimpsed it for a moment. I still have dreams of trying again someday.
Meanwhile, if Charles should succeed, he might just shoot Microsoft itself in the foot. While it's true that Microsoft is a massive powerhouse of smart people who can turn on a dime, it's also true that the company benefits from the tendency of the software marketplace to create near-monopolies. Why do categories of software tend to become dominated by a single product over time? The answer is found in our old friend brittleness. The Microsoft empire largely rests on the fact that any lead will be automatically compounded in the software business, especially for an underlying layer of software, like an operating system. The more standard a solution a customer chooses (or a software developer), the less they'll have to spend confronting brittleness on their own. While this is true to a lesser degree in other businesses, it is the overwhelming factor in the software business. Beats me how Apple could have failed to understand it.
If Charles finds a way to translate backwards from abstractions expressed in a generic form to an arbitrary platform, and it really works, then Windows will have to compete just like a model of a car or some other product. Please succeed, Charles.
From: Paolo Pignatelli
Submitted: 7.8.97You say, "So an abstraction may be looked at from one side as a compression of many instances into one generality." What comes first, the instance(es) or the abstraction? As I am writing this, I am listening to Bach's Goldberg Variations (played by Glenn Gould). For you, is the aria the abstraction of the instances, the variations, or does the aria give rise to the 30 variations, abstractions on the main theme? What is there of temporal in abstraction? Perhaps the whole piece an abstraction of a transcending esthetic, the esthetic containing the (temporal) or (logical possibility) potentiation of the its subclasses? Now assume that not only the music but also a work of El Greco give rise the same neuron firing pattern in the brain, the esthetic response, (neuropsychologists in the audience, anything in the literature?), are both "esthetics", already called "abstract" both instances of a next higher level of abstraction? No, is there one peak, or are there many peaks? Are peaks absolute? We have beautiful concepts like transfinite numbers, or Godel's work, or the aesthetic beauty of a discovery in the experiential sciences, giving the same pleasure as my listening right now to Bach. What is there in common between the intellectual sets of abstraction peaks and that of abstractions? Can we even talk about abstraction without falling pray to self-referential paradoxes?
Language is yet another abstraction, of an experiential phenomenon, but it is also the result of the brain's language center acting as a result of inputs and rules. So we do have an instance of an abstraction machine. Other guests of John Brockman have talked about possible math centers and emotion centers, candidates again for other abstractions leading to an abstraction machine. Let's assume there exits an abstraction machine, does this machine create successors to itself or does it just grow?-
PAOLO PIGNATELLI, a cyber-entrepreneur, is proprietor of the virtual Corner Store. He is a linguist, translator and scientist who previously worked in image processing algorithms at Bell Labs.
Piet Hut & Lee Smolin: An Exchange
From: Piet Hut
Submitted: 6.25.97I like Stu Kauffman's and Lee Smolin's idea of resisting the one-way-street program of reducing biology to physics, by looking for ways in which biology might provide insights useful for physics. Much as I enjoy their cosmological speculations, I wonder whether we can allow full two-way traffic, by looking for applications squarely within established physics as well.
A few years ago, reflecting on the notion of path integrals, related to the principle of least action, I realized that quantum mechanics can be described as selecting the "fittest" path from along a "population" of paths, resulting in a behavior that looks law-like in the classical limit.
In classical mechanics, a particle follows the path it does as the result of its inertia propelling it forwards while external forces act to bend its path. In quantum mechanics, in contrast, a particle goes literally every which way, simultaneously, but most paths interfere destructively with each other. The actual trajectory emerges as the result of active and ongoing competition in an enormous field of competitors. The properties of the "winner" can be directly derived from this process of competition.
Here is an example of a "trait" that nature selects within the population of all possible paths: smoothness. We know from experience that throwing a tennis ball makes it fly through a smooth path, without abrupt changes of direction. Why are there no sudden kinks in its trajectory? Newton invoked a property called inertia, "propelling" the ball along a smooth path. In quantum mechanics, however, inertia is not put in by hand, but arises as an emergent property. Here is how it works.
For every orbit with a kink, there are neighboring orbits with a somewhat larger or somewhat smaller kink. Each of these orbits have a very different phase, and as a result they interfere destructively. In contrast, a kink-free, smooth orbit has at least a chance that its nearby orbits have almost the same phase, resulting in constructive interference. Which smooth orbit is selected by nature depends on the system under consideration, but the point is this: nature has no preference for smooth, rather than kinky orbits. In fact, in the shimmering realm of quantum mechanics, there where actuality and potentiality mingle, kinky orbits are equally present with equal status as smooth orbits. As soon as we make the transition to larger scales, we can see how the whole population of kinky orbits collectively self-destructs, leaving only smooth orbits behind in the classical limit.
It would be an interesting project to write a physics text book from a biological point of view, from scratch. Instead of starting with classical mechanics, and then going to quantum-mechanical wonderland, we could look through the other end of the actuality-potentiality telescope. Starting with the fundamental contingency associated with measurements in quantum mechanics, we could arrive at our normal field of experience as the result of a form of natural selection.
PIET HUT is professor of astrophysics at the Institute for Advanced Study, since 1985. Not satisfied with the performance of existing computers, he joined a group of astronomers in Tokyo to develop a special-purpose computer for star cluster simulations, the GRAPE-4, at 1 Teraflops the world's fastest computer in 1995. He is now working with them to produce and use a Petaflops- class machine by the year 2000.
From: Lee Smolin
Submitted: 7.6.97Piet's idea is pretty interesting and imaginative. I've often wondered whether there could be something like self-organized critical behavior that naturally accounted for the existence of the classical limit from path integrals in quantum gravity or even ordinary quantum field theory. This would be analogous to the way that equilibrium critical phenomena like second order phase transitions are mathematically analogous to the continuum limit in what is called Euclidean field theory, which is quantum field theory with the modification that the time dimension is treated exactly like space, so spacetime is just an ordinary four dimensional Euclidean space.
I'm not sure whether the ordinary process in which the classical limit emerges from the path integral through interference effects is really analogous to natural selection. For natural selection to be applied there needs to be reproduction, variation and selection. Ordinarily I don't think we have these components. True there are the many paths, and their actions do vary, but I think this is still not really analogous to the schema of natural selection. But still, what Piet writes is worth thinking about, and it may lead to something interesting.
LETTERS
Lawrence Wilkinson & Stewart Brand
From: Lawrence Wilkinson
Submitted: 6.4.97I've been a grateful lurker since your founding of EDGE, reading each installment (usually in arrears) with fascination and great pleasure. This quick note of long-overdue thanks is both for including me, and more specifically, for the pieces in 19 on and by James Lee Byars. Your memories and the work you did together were moving, in the truest sense of that word, and in many ways. Thank you.
LAWRENCE WILKINSON is cofounder, president, and CEO of Global Business Network.
Before joining GBN full-time in 1990, Lawrence was president of Colossal Pictures, responsible for all activities of Colossal, its USFX division and Big Pictures subsidiary, and its affiliated companies globally.
From: Stewart Brand
Submitted: 6.26.97John, congratulations on how this service is developing. I particularly appreciated the recent Simonyi and Smolin material. Reality Club lives, better than ever.-
STEWART BRAND is founder of The Whole Earth Catalog, cofounder of The Well, cofounder of Global Business Network, and author of The Media Lab: Inventing the Future at MIT (1987) and How Buildings Learn (1994).
Copyright ©1997 by Edge Foundation, Inc.
|
Home | Digerati | Third Culture | The Reality Club | Edge Foundation, Inc. |
| |||
