UCNC 2013 Milan Draft 1 Morphological Computing and Physical Levels of Computation Gordana Dodig-Crnkovic 1 and Mark Burgin 2 1 Mälardalen University, Västerås, Sweden gordana.dodig-crnkovic@mdh.se 2 Department of Mathematics, UCLA, Los Angeles, USA mburgin@math.ucla.edu Abstract We expect future robots to behave intelligently, to learn and to be able to communicate with humans in human ways. Morphological computing emerged newly as a programme in robotics for using physical properties of the robotic body (including learning by information self-structuring) to automatically produce behaviour. The idea is that morphology of an agent (living organism or a machine) constrains possible interactions within the body of the agent, together with constraining agent’s interactions with the environment, as well as its possible development such as growth or reconfiguration. Natural computation in general can be seen as morphological computation on a variety of levels of organization of physical matter. It is a computational model of the physical world that provides a basis for framing, parameter studies, optimizations and simulations of physical systems – from nano-scale up to (cognitive) robots. Computation. The Computing Nature The Tuscan physicist, mathematician, astronomer, and philosopher Galileo Galilei in his book The Assayer - Il Saggiatore (1623) declared that “the book of nature is written in the language of mathematics” and that the way to understand nature is through mathematics. Today we understand nature not only in terms of symbolic languages like mathematics but also through 2 computational physical representations such as simulations which provide different (usually visual) rendering of natural phenomena in form of interactive models. Thus we can paraphrase Galileo by saying that the great book of nature is written in the programming languages of natural computing. Computer scientist Konrad Zuse was the first to suggest (in 1967) that the physical behavior of the entire universe is being computed on a fundamental level, possibly on cellular automata, by the universe itself which he called The Computing Space/ Cosmos. Subsequently emerging Naturalist computationalism (pan- computationalism), developed among others by (Zuse, 1969) (Fredkin, 1992) (Wolfram, 2002), (Chaitin, 2007), (Lloyd, 2006) takes the universe to be a system that constantly computes its own next state from the current one. Hierarchy of Levels of Physical Computation If the whole of Nature computes (Dodig Crnkovic and Giovagnoli 2013, forthcoming), this computation happens on many different levels of organization of the physical matter. In Burgin_Dodig-Crnkovic_2011 three generality levels of computations are introduced, from the most general to the most specific/particular one:. 1. 2. 3. Computation as any transformation of information and/or information representation. (This leads to natural computationalism in its most general form) Computation as a discrete transformation of information and/or information representation. (This leads to natural computationalism in the Zuse and Wolfram form with discrete automata as basis) Computation as symbol manipulation. (This is Turing model of computation and its equivalents). There are also spatial levels or scales of computations: 1. 2. The macrolevel includes computations performed by current computational systems in global computational networks and physical computations of macro-objects. The microlevel includes computations performed by integrated circuits. 3 3. 4. 5. The nanolevel includes computations performed by fundamental parts that are not bigger than a few nanometers. The molecular level includes computations performed by molecules. The quantum level includes computations performed by atoms and subatomic particles. Morphological Computing in Nanoscale Morphological Computing in Biology: Morphogenesis as Computation (Information Processing) Morphology is a theory of the formative principles of a structure. (from the Greek morphê - shape) Morphogenesis is a study of the creation of shape during the development of an organism. It includes one of the following four processes in the development: Patterning - the setting up of the positions of future events across space at a variety of scales; Regulation of timing - the 'clock' mechanisms that regulate when events happen and Cell differentiation: changes in a cell's set of expressed genes (its molecular phenotype). Interesting to note is that in 1952 Alan Turing wrote a paper proposing a chemical model as the basis of the development of biological patterns such as the spots and stripes on animal skin, (Turing 1952). Turing did not originally claim that physical system producing patterns actually performs computation through morphogenesis. Nevertheless, from the perspective of info-computationalism (Dodig Crnkovic 2009) we can argue that morphogenesis is a process of morphological computing. Physical process – even though not „computational“ in the traditional sense, it presents natural (unconventional), physical, morphological computation. Essential element in this process is the interplay between the informational structure and the computational process - information self-structuring (including information integration), both synchronic and diachronic, going on in different time and space scales. Process of computation imple- 4 ments/executes physical laws which act on informational structures. Through process of computation, structures change their forms. All of computation on some level of abstraction is morphological computation – a form-changing/ form-generating process. Morphological Computing in Robotics and Embodied AI In recent years, morphological computing emerged as a new idea in robotics, (Pfeifer 2011), (Pfeifer and Iida 2005), (Pfeifer and Gomez 2009) (Paul 2004). This presents a fundamental change compared with traditional robotics which, based on the Cartesian tradition, treated separately the body/machine and its control (computer) as completely independent elements of a robot. However, successively it has become evident that embodiment itself is essential for cognition, intelligence and generation of behaviour. In a most profound sense, embodiment is vital because cognition (and consequently intelligent behaviour) results from the interaction of the brain, body, and environment. (Pfeifer 2011) Instead of specifically controlling each movement of a robot, one can instead use morphological features of a body to automatically perform movements. Here we can take the advantage of learning from biological forms and materials developed in nature. Specific forms of physical bodies of existing life forms have developed evolutionary through optimization of their function in the environment. In the development of an organism, based on the DNA code, body of a living being is created through morphogenesis, which is governing a short time scale formation of life. (Morphogenesis (from the Greek - “generation of the shape"), is the biological process that causes an organism to develop its shape.) On a long-time scale, morphological computing governs evolution of species. From an evolutionary perspective it is central that the environment provides a physical source of biological body of an organism as well as a source of energy and matter for its metabolism. Nervous system and the brain of an organism evolve gradually through interactions (computational 5 processes) of a living agent with the environment. This process of mutual shaping is a result of information self-structuring (Dodig Crnkovic 2008). Here both physical environment and the physical body of an agent can in every time instant be described by their informational structures. The environment provides a variety of inputs in the form of both information and matter-energy, where the difference between information and matter-energy is not in kind, but in type of use organism makes out of it. As there is no information without representation, all information is carried by some physical carrier (light, sound, radio-waves, chemical molecules able to trigger smell receptors etc.). The same object can be used by an organism as a source of information and a source of nourishment/matter/energy. Some signals (say light) are used by some organisms just as information necessary for orientation in the environment, while the others use the light for photosynthetic processes in their metabolism. Thus the question what will be used “only” as information and what as food/ energy source depends on the type of organism. In general, the simpler the organism, the simpler the information structures of its body, the simpler information carriers it relies on, and simpler interactions with the environment. The environment is not only a resource but at the same time it imposes constraints which limit the space of possibilities for an agent. In an agent that can be described as a complex informational structure, constraints imposed by the environment are driving time development (the computation) of the structure, and thus even agent’s shape and behaviour, to specific trajectories. This relationship between an agent and its environment is called structural coupling by (Maturana & Varela 1980) and described by (Quick and Dautenhahn 1999) as “non-destructive perturbations between a system and its environment, each having an effect on the dynamical trajectory of the other, and this in turn effecting the generation of and responses to subsequent perturbations.” This mutual coupling between living systems and the environment can be followed on the geological time scale, through the development of the first life on Earth. It is believed that the first most primitive photosynthetic or- 6 ganisms contributed to the change of the environment and produced oxygen and other compounds necessary for life on earth. Catling et al. (2001) explain how photosynthesis splits water into O2 and H, and methanogenesis transfers the H into CH4. Hydrogen escape after CH4 photolysis therefore causes a net gain of oxygen. This process may help explain how Earth's surface environment became irreversibly oxidized which enabled the development of life on Earth. When it comes to human development, Clark (1997) p. 163 talks about "the presence of continuous mutually modulatory influences linking brain, body and world." When talking about living beings in general, it would be the presence of continuous mutually shaping interactions between body and environment, where body in some organisms developed nervous system and brain as control mechanisms. Morphological Computing in Robotics In morphological computing modelling of the agents behaviour (such as locomotion and sensory-motor coordination) proceeds by abstracting the principles via information self-structuring and sensory-motor coordination, (Matsushita et al. 2005), (Lungarella et al. 2005) (Lungarella and Sporns 2005) (Pfeifer, Lungarella and Iida 2007). Brain control is decentralized based on the sensory-motor coordination through the interaction with environment. Through the embodied interaction with the environment, in particular through sensory-motor coordination, information structure is induced in the sensory data, thus facilitating perception, learning and categorization. The same principles of morphological computing (physical computing) and data self-organization apply to biology and robotics. Morphology is the central idea in understanding of the connection between computation and information. Materials also represent morphology, just on the more basic level of organization – the arrangements of molecular and atomic structures. What appears as a form on a more fundamental level of organization (e.g. an arrangement of atoms), represents “matter” as a higher-order phenomenon (e.g. a molecule). 7 Isomers show how morphological forms are critical in pharmacology where matching of a “drug” to a “receptor” is sought, which only is found if forms are the right ones. Info-computational naturalism (Dodig Crnkovic 2009) describes nature as informational structure – a succession of levels of organization of information. Morphological computing on that informational structure leads to new informational structures via processes of self-organization of information. Evolution itself is a process of morphological computation on structures of organisms on a long-term scale. It will be instructive within the info-computational framework to study in detail processes of self organization of information in an agent (as well as in population of agents) able to re-structure themselves through interactions with the environment as a result of morphological (morphogenetic) computation. As an example of morphologicl computing phyllotaxis can be mentioned that in botany is the arrangement of leaves on a plant stem (from ancient Greek phýllon "leaf" and táxis "arrangement"). “A specific crystalline order, involving the Fibonacci series, had until now only been observed in plants (phyllotaxis). Here, these patterns are obtained both in a physics laboratory experiment and in a numerical simulation. They arise from self-organization in an iterative process. They are selected depending on only one parameter describing the successive appearance of new elements, and on initial conditions. The ordering is explained as due to the system’s trend to avoid rational (periodic) organization, thus leading to a convergence towards the golden mean.” Douady and Couder (1992) Morphological computing is information (re)structuring through computational processes which follow/implement physical laws. It is physical computing or natural computing in which physical objects perform computation. Symbol manipulation in this case is physical object manipulation. Different types of morphological computing interesting in AI and robotics: 1) Physical objects as “models of themselves”; physics directly providing behavior of robotic body instead of detailed control of 8 movement (passive walker, grasping hand, etc.). Physical equivalent of symbolic computational control. 2) Subsymbolic computing performed by information-processing adaptive learning system instead of advanced detailed planned centrally-controlled pre-programmed behavior that has problems in unpredictable environments. Understanding computational nature of continuous sub-symbolic information processing that enables living agents to survive in the environment. 3) Complementarity of discrete and continuous representations. Cognition as Restructuring of an Agent in the Interaction with the Environment As a result of evolution, increasingly complex living organisms arise that are able to survive and adapt to their environment. It means that they are able to register inputs (data) from the environment, to structure those into information, and in more complex organisms to structure information into knowledge. The evolutionary advantage of using structured, componentbased approaches such as data – information – knowledge is improving response-time and efficiency of cognitive processes of an organism. All cognition is embodied cognition in all living beings – microorganisms as well as humans. In more complex cognitive agents, knowledge is built upon not only direct reaction to input information, but also on intentional information processes governed by choices, dependent on value systems stored and organized in agent’s memory which is “implemented” in the agent’s body. Information and its processing are essential structural and dynamic elements which characterize structuring of input data (data information knowledge) by an interactive computational process going on in the agent during the adaptive interplay with the environment. There is a continuum of morphological development from simplest living organism’s automaton-like structures to most complex life form’s elaborate interplay between body, nervous system and brain and the environment. Cognition thus proceeds through restructuring of an agent in the in- 9 teraction with the environment where this restructuring can be identified as morphological computing. Info-computationalism Information and computation are two interrelated and mutually defining phenomena – there is no computation without information (computation understood as information processing), and vice versa, there is no information without computation (information as a result of computational processes). (Dodig Crnkovic 2006) Being interconnected, information is studied as a structure, while computation presents a process on an informational structure. In order to learn about foundations of information, we must also study computation. In (Dodig-Crnkovic, 2011) the dynamics of information is defined in general as natural computation. With the universe represented as a network of computational processes at different scales or levels of granularity, information is both a substrate and a result of natural computation (Dodig Crnkovic 2011). Computation is generally defined as information processing, see (Burgin, 2005) Conclusions The process of modeling, designing and creating robots that are more lifelike in their morphological properties, can both advance our understanding of biological life and improve embodied and embedded cognition and intelligence in artificial agents. Morphological computing is a model of computing, i.e. data/information processing, a type of natural (physical) computing and as a model it has both important practical and theoretical implications. References Black M. (1962) Models and Metaphors: Studies in Language and Philosophy, Cornell, Ithaca. Burgin, M. (2005) Super-Recursive Algorithms, Springer Monographs in Computer Science. @inbook{Burgin_Dodig-Crnkovic_2011, place={New York/London/Singapore}, title={Information and Computation – Omnipresent and Pervasive}, booktitle={Information and Computation}, publisher={World Scientific Pub Co Inc}, 10 author={Burgin, Mark and Dodig-Crnkovic, Gordana}, year={2011}, pages={vii –xxxii}} Catling D. C., Zahnle K. J., McKay C. P. (2001) Biogenic Methane, Hydrogen Escape, and the Irreversible Oxidation of Early Earth. Science, Vol. 293, Issue 5531. Chaitin G. (2007) Epistemology as Information Theory: From Leibniz to Ω. In Computation, Information, Cognition – The Nexus and The Liminal (Dodig Crnkovic, G., Ed.), pp 2-17, Cambridge Scholars Pub., Newcastle UK. Clark A. (1997). Being There: putting brain, body and world together again. Oxford University Press. Dodig Crnkovic G. (2006) Investigations into Information Semantics and Ethics of Computing, Mälardalen University Press. Dodig Crnkovic G. (2008) Knowledge Generation as Natural Computation, Journal of Systemics, Cybernetics and Informatics, Vol 6, No 2. Dodig Crnkovic G. (2009) Information and Computation Nets. Investigations into Info-computational World. Saarbrucken: Vdm Verlag. pp 1-96. Dodig Crnkovic G. (2011) Info-Computational Philosophy of Nature: An Informational Universe With Computational Dynamics. In: From First to Third via Cybersemiotics. A Festschrift for Prof. Søren Brier (Thellefsen T., Sørensen B. and Cobley P. Eds.), CBS. pp 97-127. Dodig-Crnkovic G. (2011) Dynamics of Information as Natural Computation, Information, 2(3), Selected Papers from FIS 2010 Beijing. pp 460-477. Douady S. and Couder Y. (1992) Phyllotaxis as a physical self-organized growth process Phys. Rev. Lett. 68, pp 2098–2101. Dulos, E., Boissonade, J., Perraud, J. J.Rudovics, B., Kepper, P. (1996) Chemical morphogenesis: Turing patterns in an experimental chemical system, Acta Biotheoretica, Volume: 44, Issue: 3, pp 249 -261 Fredkin E. (1992) Finite Nature. In XXVIIth Rencotre de Moriond. Ladyman J. and Ross D., with Spurrett D. and Collier J. (2007) Every Thing Must Go: Metaphysics Naturalized, Oxford UP Lloyd S. (2006) Programming the universe: a quantum computer scientist takes on the cosmos 1st ed., Knopf, New York. Lungarella M. and Sporns O. (2005) Information Self-Structuring: Key Principle for Learning and Development, Proceedings of 2005 4th IEEE Int. Conference on Development and Learning, pp 25-30 11 Lungarella M., Pegors T., Bulwinkle D. and Sporns O. (2005) Methods for Quantifying the Informational Structure of Sensory and Motor Data, Neuroinformatics Volume 3, pp 243-262 Matsushita K., Lungarella M., Paul C., Yokoi H. (2005) Locomoting with Less Computation but More Morphology, Proc. 2005 IEEE Int. Conf. on Robotics and Automation, pp 2008-2013 Maturana, H. R. & Varela, F. J. (1980). Autopoiesis and Cognition - The Realization of the Living. Dordrecht, The Netherlands: D. Reidel Publishing. Paul C. (2004) Morphology and Computation, Proceedings of the International Conference on the Simulation of Adaptive Behaviour Los Angeles, CA, USA, pp 33–38 Pfeifer R. (2011) http://www.eucognition.org/index.php?page=tutorial-onembodiment Tutorial on embodiment Pfeifer R. and Iida F. (2005) Morphological computation: Connecting body, brain and environment. Japanese Scientific Monthly, Vol. 58, No. 2, 48–54 Pfeifer R. and Gomez G. (2009) Morphological computation - connecting brain, body, and environment. In B. Sendhoff, O. Sporns, E. Körner, H. Ritter, & K. Pfeifer R., Lungarella M. & Iida F. (2007) Self-organization, embodiment, and biologically inspired robotics, Science 318, 1088-1093. Quick T. and Dautenhahn K. (1999) Making embodiment measurable. Proceedings of ‘4. Fachtagung der Gesellschaft für Kognitionswissenschaft’. Bielefeld, Germany. http://supergoodtech.com/tomquick/phd/kogwis/webtext.html Turing A. M. (1952) Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences, Vol. 237, No. 641. (Aug. 14, 1952), pp. 37-72. Wolfram S. (2002) A New Kind of Science, Wolfram Media. Zuse K. (1969) Rechnender Raum, Friedrich Vieweg & Sohn, Braunschweig. Floridi L. (2008) A defence of informational structural realism, Synthese 161, 219-253. Sayre K. M. (1976) Cybernetics and the Philosophy of Mind, Routledge & Kegan Paul, London. Some additional threads: 12 We can see all of natural computing as based on computational agents exchanging messages (information). Elementary particles communicate via force carriers. In physics (quantum field theory) the exchange of energy in interactions is explained by force carriers – bosons: graviton and the photon for the long range forces of gravitation and electromagnetic force. The W+, W- and Z bosons are the carriers for the weak force, and the gluon for the strong force. Within an atom, nucleons in an atomic nucleus communicate via strong and weak force carriers. Nucleus (positively charged) and electrons (negatively charged) of an atom are kept together by exchange of electromagnetic force carriers. Externally atoms communicate via electromagnetic force carriers. Molecules consist of atoms and communicate via messages of many different kinds – from atoms to electrical and chemical force carriers. Cells of an organism communicate internally through metabolic networks, protein–protein interaction networks and with the DNA code translated into proteins. At the same time cells are communicating externally by exchanging molecules and other electrochemical signals and so on. Humans are complex organisms consisting of numerous subsystems with their own ways of internal communication all of it can be seen as natural computing of different sorts. Externally, humans communicate via different languages and various signals. Communication between humans is mediated by very complex messages, unlike messaging in the physical substrate which is significantly simpler and more predictable. However, study of network behavior of humans reveals much regularity as well. Black Hole Computers In keeping with the spirit of the age, researchers can think of the laws of physics as computer programs and the universe as a computer By Seth Lloyd and Y. Jack Ng 13 What is the difference between a computer and a black hole? This question sounds like the start of a Microsoft joke, but it is one of the most profound problems in physics today. Most people think of computers as specialized gizmos: streamlined boxes sitting on a desk or fingernail-size chips embedded in high-tech coffeepots. But to a physicist, all physical systems are computers. Rocks, atom bombs and galaxies may not run Linux, but they, too, register and process information. Every electron, photon and other elementary particle stores bits of data, and every time two such particles interact, those bits are transformed. Physical existence and information content are inextricably linked. As physicist John Wheeler of Princeton University says, "It from bit." Black holes might seem like the exception to the rule that everything computes. Inputting information into them presents no difficulty, but according to Einstein's general theory of relativity, getting information out is impossible. Matter that enters a hole is assimilated, the details of its composition lost irretrievably. In the 1970s Stephen Hawking of the University of Cambridge showed that when quantum mechanics is taken into account, black holes do have an output: they glow like a hot coal. In Hawking's analysis, this radiation is random, however. It carries no information about what went in. If an elephant fell in, an elephant's worth of energy would come out--but the energy would be a hodgepodge that could not be used, even in principle, to re-create the animal. Molecular evolution is in part a process of evolution at the scale of DNA, RNA, and proteins. Molecular evolution emerged as a scientific field in the 1960s as researchers from molecular biology, evolutionary biology and population genetics sought to understand recent discoveries on the structure and function of nucleic acids and protein. Some of the key topics that spurred development of the field have been the evolution of enzyme function, the use of nucleic acid divergence as a "molecular clock" to study species divergence, and the origin of noncoding DNA. (Wiki) 14 “I claim that Weinberg cannot deduce or simulate the coming into existence of the heart in the universe. Nor is it obvious in what sense, if any, is the coming into existence in the universe of the heart “entailed” by the laws of physics.” Stuart Kauffman in the Introduction to the book "A Third Window: Natural Life beyond Newton and Darwin" page A Third Window: Natural Life beyond Newton and Darwin by Robert E. Ulanowicz, Stuart A. Kauffman http://www.scoop.co.nz/stories/HL1211/S00005/stu-kauffman-europes-origin-oflife-summit.htm