| Both sides previous revisionPrevious revisionNext revision | Previous revision |
| public:t720-atai-2012:emergence [2012/10/19 15:03] – thorisson | public:t720-atai-2012:emergence [2024/04/29 13:33] (current) – external edit 127.0.0.1 |
|---|
| //course notes// \\ | //course notes// \\ |
| \\ | |
| \\ | |
| {{ public:emergence-cartoon-1.png?500 }} | |
| \\ | \\ |
| \\ | \\ |
| |
| ====== What is Self-Organization? ====== | ====== Self-Organization & Emergence ====== |
| | |
| | ===== What is Self-Organization? ===== |
| |
| With a requirement of a constructivist approach we must come up with principles for how a system can manage its own growth. What we are essentially talking about are meta-construction principles that can be imparted to the system, "top-level" goals and methods for how the system should change over time. If we are to do this while at the same time building a system that addresses an enormous amount of functions, many of which are not very well understood, we better enlist some of the more subtle and surprising tricks of nature. | With a requirement of a constructivist approach we must come up with principles for how a system can manage its own growth. What we are essentially talking about are meta-construction principles that can be imparted to the system, "top-level" goals and methods for how the system should change over time. If we are to do this while at the same time building a system that addresses an enormous amount of functions, many of which are not very well understood, we better enlist some of the more subtle and surprising tricks of nature. |
| |
| * Reflectivity - the system can inspect its own operation and evaluate it, using mechanisms embodied in the system itself | * Reflectivity - the system can inspect its own operation and evaluate it, using mechanisms embodied in the system itself |
| | |
| | While reflectivity is not necessary for self-organization to occur, it may be argued that it is critical for any //informed// self-organization to occur. If we want to use reason and inference to come up with an organization that better achieves some particular goal, in a complex world where the size of possible mind+world (<m>S_Psi+S_E</m>) state combinations is virtually infinitely large (or, in practical terms, vastly bigger than we have time to explore), then this system that is rearranging itself to attain an improved version of its future self //must// be able to inspect its own state and compare its own structure at various points in time, compare them to the state of the world, and evaluate the effects of the changes that have been made. |
| |
| \\ | \\ |
| \\ | \\ |
| |
| === What is Emergence?=== | {{ public:emergence-cartoon-1.png?500 }} |
| | |
| | \\ |
| | \\ |
| | ===== What is Emergence?===== |
| |
| "Emergence" is what we call the result of auto-catalytic processes. A good example is the [[http://www.youtube.com/watch?v=3JAqrRnKFHo|Belusov-Zhabotinsky]] reaction. Emergent phenomena are often surprising, because it is a classical case of the equation "the whole is more than the sum of the parts": How the parts interact is not obvious from looking at them in isolation. Emergent phenomena with which are are very familiar are for example automobile engines, lightbulbs, human beings, and societies. | "Emergence" is what we call the result of auto-catalytic processes. A good example is the [[http://www.youtube.com/watch?v=3JAqrRnKFHo|Belusov-Zhabotinsky]] reaction. Emergent phenomena are often surprising, because it is a classical case of the equation "the whole is more than the sum of the parts": How the parts interact is not obvious from looking at them in isolation. Emergent phenomena with which are are very familiar are for example automobile engines, lightbulbs, human beings, and societies. |
| The principles of self-organization have been systematically studied for close to a century in biology, physics, and cybernetics. While this seems like a long time, very few researchers have in fact made it their primary subject. As a result there are not a lot of fundamental results to discuss in this field, at least not in the sense of strongly affecting other research fields. Some attempts have been made to use discoveries like attractors – the study of which belongs to the filed of Dynamic Systems – to understand and explain the operation of minds, neural networks, social systems, and various other phenomena. But since attractors, and in fact many of the ideas and results coming out of complexity research and self-organization, is //descriptive// in nature: Instead of supplying us with good ideas for how to build systems to achieve thought, for example, this work has not lead to any fundamental insights into how to design thinking minds, or how the human mind works. In general, approaches based on fundamentally descriptive principles can only be used //after// a system has been built, to compare it to its natural counterpart: It allows us to ask questions about the similarity of the engineered system and the natural system. For example, it can allow us to hypothesize that the artificial system, if correctly implementing principles of a human brain, should exhibit the same attractor behavior when subjected to a particular set of inputs, contexts, or training regime. | The principles of self-organization have been systematically studied for close to a century in biology, physics, and cybernetics. While this seems like a long time, very few researchers have in fact made it their primary subject. As a result there are not a lot of fundamental results to discuss in this field, at least not in the sense of strongly affecting other research fields. Some attempts have been made to use discoveries like attractors – the study of which belongs to the filed of Dynamic Systems – to understand and explain the operation of minds, neural networks, social systems, and various other phenomena. But since attractors, and in fact many of the ideas and results coming out of complexity research and self-organization, is //descriptive// in nature: Instead of supplying us with good ideas for how to build systems to achieve thought, for example, this work has not lead to any fundamental insights into how to design thinking minds, or how the human mind works. In general, approaches based on fundamentally descriptive principles can only be used //after// a system has been built, to compare it to its natural counterpart: It allows us to ask questions about the similarity of the engineered system and the natural system. For example, it can allow us to hypothesize that the artificial system, if correctly implementing principles of a human brain, should exhibit the same attractor behavior when subjected to a particular set of inputs, contexts, or training regime. |
| |
| | \\ |
| | \\ |
| | ===== The Relevance of Emergence & Self-Organization to AGI ===== |
| | |
| | While it is clear that these concepts must be relevant to all efficient complex systems, the specifics of how they relate to AGI is not obvious. In fact, it may be argued that the study of self-organization presents no principles of construction because an emergentist view on the world represents a //descriptive// view of systems: Given that some particular phenomenon, say the natural phenomenon of intelligence, exhibits some features of self-organization and emergence, while we may be able to describe these features in detail, whether they be the control of cognitive development stages or the recall of the right things at the right time when performing a task such as playing tennis or assembling furniture, they tells us little if anything about what kinds of designs could produce such emergent properties. |
| | |
| | Nevertheless it seems obvious that when we are dealing with a system that //must// implement self-organizing principles, via complex nested feedback loops at many levels of detail, it would seem irresponsible at best, and quite possibly self-defeating, to ignore the research on these phenomena so far. We should anticipate having to extend the current work on emergence and self-organization to a point where these concepts can become highly useful for comparisons with naturally intelligent systems, and possibly help us in our design efforts. They are especially relevant to issues of bootstrapping, and to control of ongoing auto-catalytic processes and management of self-organized architectural structures. |
| | |
| | A key problem with present methodologies, and especially constructionist approaches, is that they blind us to the importance, and perhaps sometimes even the //possibility//, of self-organizing auto-catalytic loops. Going beyond current traditions of constructionist methodologies requires us to identify the //need// for intricate feedback loops and self-organizing principles. A constructionist approach will always try to eliminate complex feedbacks and force our architecture into a linear, pipelined model. Even blackboard architectures do not help us think in loops, as it tends to emphasize the activity of the agents or daemons in using the blackboard and hide the fact that incrementally knowledge builds up via feedback loops between the various types of agents. So, to some extent, the blackboard metaphor augmented with the insight of //types// of agents, occupying various points along at least two dimensions: level of detail and temporal scope. And we could add a third dimension of data types. A spread-spectrum of agents, each occupying some point, or possibly more than one point, along these dimensions, will at runtime implement feedback loops that produce knowledge in opportunistic ways, in accordance with what the world exposes the system to over time. |
| |
| \\ | \\ |
| \\ | \\ |
| //2012(c)Kristinn R. Thórisson// | //2012(c)Kristinn R. Thórisson// |
