This is an old revision of the document!
What is Emergence?
With a requirement of a constructivist approach we must come up with principles for how a system can manage its own growth. What we are essentially talking about are meta-construction principles that can be imparted to the system, “top-level” goals and methods for how the system should change over time. If we are to do this while at the same time building a system that addresses an enormous amount of functions, many of which are not very well understood, we better enlist some of the more subtle and surprising tricks of nature.
Any complex system, e.g. a living being, will over millennia have evolved to trim unnecessary features – features are unnecessary if they don't contribute to the being's ultimate purpose for being – their top-level goal of survival. Of course there will be some minor, possibly strange, remnants of functions that used to be useful but are no longer (yet may become so again). Mainly, though, a living being of any species will have have a good reason to sport its various features. Intelligence is clearly one such survival advantage of human beings: if it was not useful it would have been eliminated. Of course, if humanity destroys itself it will have proven that intelligence – at least as it has been implemented in humans – is not that useful, or tends to be only useful for a limited period of time. In any case, we can identify a need for holistic architectures, as inefficiencies in a complex system are likely to be detrimental to a number of related functions, reducing the efficiency of the whole system to meet its top-level goal. For intelligent architectures this would essentially mean that (a) many cognitive functions are likely to support each other in the day-to-day operation of the mind, and (b) the functions are integrated in efficient ways, they are for example likely to share a number of operations or implement operations in similar ways to other cognitive functions, because this means lower complexity for the underlying implementation code (genetic program). So, an AGI is likely to implement:
- Holistic operation - the system works effectively and efficiently as a unified whole (not a lot of extra “fat”)
Living systems are open systems, which means energy flows through them to maintain their order, which are constantly being built and re-built by the energized processes. Many of the processes of living systems are auto-catalytic. In auto-catalytic processes, some of the “fuel” needed for reactions is actually produced by the process itself; something starts – bootstraps – the auto-catalytic process, and once started it “runs itself”. Such a process takes no energy from the “outside” it uses up energy in the process itself, or from outside itself – from its environment. The process runs until the energy runs out; for processes using outside energy this could be a very long time. An example are species: Crocodiles are very long running species. While one could argue that there is no obvious reason for individuals of a species to die, since they implement processes that take energy from the outside, the reason the individuals exist is because of the species, whose blueprint is imprinted in the species' genome.
Since living systems are heavily based on constructivist principles, and brains, and thus natural minds, are essentially a sub-process of life, it is not unlikely that (natural) cognitive architectures employ auto-catalytic principles, either at their core or on the periphery. And since
- Auto-catalysis - the system's operation is catalyzed (initiated, triggered, started) and maintained (managed) by mechanisms embodied in the system itself
- Endogenous operation - “self-motivated” progression from present state to future states
A methodology that proposes holism in the construction of a complex architecture, while requiring constructivist approach, complexity must be addressed somehow. We must get a handle on the principles of self-organization, for without some understanding of some minimum of self-organizing principles we are not likely to achieve our goal of designing and implementing a comprehensive cognitive architecture. One principle we can be sure of is that the architecture's structure must be, to some degree, input to itself. This is evidenced for example in that when the system needs to evaluate its own growth over time – changes in its own construction – it must be able to inspect its own structures. This requires reflectivity.
- Reflectivity - the system can inspect its own operation and evaluate it, using mechanisms embodied in the system itself
The principles of self-organization have been systematically studied for close to a century in biology, physics, and cybernetics. While this seems like a long time, very few researchers have in fact made it their primary subject. As a result there are not a lot of fundamental results to discuss in this field, at least not in the sense of strongly affecting other research fields. Some attempts have been made to use discoveries like attractors – the study of which belongs to the filed of Dynamic Systems – to understand and explain the operation of minds, neural networks, social systems, and various other phenomena. But since attractors, and in fact many of the ideas and results coming out of complexity research and self-organization, is descriptive in nature: Instead of supplying us with good ideas for how to build systems to achieve thought, for example, this work has not lead to any fundamental insights into how to design thinking minds, or how the human mind works. In general, approaches based on fundamentally descriptive principles can only be used after a system has been built, to compare it to its natural counterpart: It allows us to ask questions about the similarity of the engineered system and the natural system. For example, it can allow us to hypothesize that the artificial system, if correctly implementing principles of a human brain, should exhibit the same attractor behavior when subjected to a particular set of inputs, contexts, or training regime.
2012©Kristinn R. Thórisson