| Both sides previous revisionPrevious revisionNext revision | Previous revision |
| public:t-720-atai:atai-22:task-environment [2022/09/01 10:18] – [Task-Environment Constraints on Tasks] thorisson | public:t-720-atai:atai-22:task-environment [2024/04/29 13:33] (current) – external edit 127.0.0.1 |
|---|
| ====Determinism vs. Non-Determinism==== | ====Determinism vs. Non-Determinism==== |
| | Is our universe deterministic? | This is a major question for physics, but ultimately is not of much consequence for those building GMI (general machine intelligence). This is because any agent situated in the physical world will never know the precise position, direction and momentum of all its smallest particles, and thus must always deal with uncertainty. | | | Is our universe deterministic? | This is a major question for physics, but ultimately is not of much consequence for those building GMI (general machine intelligence). This is because any agent situated in the physical world will never know the precise position, direction and momentum of all its smallest particles, and thus must always deal with uncertainty. | |
| | Regularity | A world with no regularity is pure noise. In such a world no intelligence makes sense. | | | Regularity | A world with no regularity is pure noise. In such a world intelligence is useless. | |
| | Pure Determinism | A world that is completely deterministic is pre-determined at all levels for all eternity; in such a world there is no concept of choice, and hence there can be no relevance for intelligence. | | | Pure Determinism | A world that is completely deterministic is pre-determined at all levels for all eternity; in such a world there is no concept of choice, and hence there can be no relevance for intelligence. | |
| | Non-Axiomatism | Some mathematicians believe the universe to be fundamentally mathematical, and see the role of science (and mathematics) to find its "ultimate formula". We'll come back to that in a bit. | | | "Axiomatic AI" | Some mathematicians believe the universe to be fundamentally mathematical, and see the role of science (and mathematics) to find its "ultimate formula". Many AI folks seem to subscribe to such a view. We'll come back to that in a bit. | |
| |
| \\ | \\ |
| |
| ====Maxwell's Demon==== | ====Maxwell's Demon==== |
| | {{public:t-720-atai:510px-maxwell_s_demon.svg.png?500}} \\ Source: [[https://en.wikipedia.org/wiki/Maxwell%27s_demon|Wikipedia]] || | | {{public:t-720-atai:maxwellsdemon.png?500}} \\ Source: [[https://en.wikipedia.org/wiki/Maxwell%27s_demon|Wikipedia]] \\ By User:Htkym - Own work, CC BY 2.5, [[https://commons.wikimedia.org/w/index.php?curid=1625737|REF]] || |
| | \\ A Thought Experiment | Imagine a container divided into two parts, A and B. Both parts are filled with the same gas at equal temperatures and placed next to each other. Observing the molecules on both sides, an imaginary demon guards a trapdoor between the two parts. When a faster-than-average molecule from A flies towards the trapdoor, the demon opens it, and the molecule will fly from A to B. Likewise, when a slower-than-average molecule from B flies towards the trapdoor, the demon will let it pass from B to A. The average speed of the molecules in B will have increased while in A they will have slowed down. Since average molecular speed corresponds to temperature, the temperature decreases in A and increases in B, contrary to the second law of thermodynamics. A heat extractor operating between the thermal reservoirs A and B could extract energy from this temperature difference, creating a perpetual motion machine. [ Adapted from [[https://en.wikipedia.org/wiki/Maxwell%27s_demon|Wikipedia]] ] | | | \\ A Thought Experiment | Imagine a container divided into two parts, A and B. Both parts are filled with the same gas at equal temperatures and placed next to each other. Observing the molecules on both sides, an imaginary demon guards a trapdoor between the two parts. When a faster-than-average molecule from A flies towards the trapdoor, the demon opens it, and the molecule will fly from A to B. Likewise, when a slower-than-average molecule from B flies towards the trapdoor, the demon will let it pass from B to A. The average speed of the molecules in B will have increased while in A they will have slowed down. Since average molecular speed corresponds to temperature, the temperature decreases in A and increases in B, contrary to the second law of thermodynamics. A heat extractor operating between the thermal reservoirs A and B could extract energy from this temperature difference, creating a perpetual motion machine. [ Adapted from [[https://en.wikipedia.org/wiki/Maxwell%27s_demon|Wikipedia]] ] | |
| | \\ The Error | The thought experiment is flawed because the demon must be part of the same system that the container is part of; thinking (or computation, if the demon is a robot) requires time and energy, and so whatever heat is saved in the container will be spent to run the demon's thinking processes. (This was first proposed in 1929 by Leo Szilard.) | | | \\ The Error | The thought experiment is flawed because the demon must be part of the same system that the container is part of; thinking (or computation, if the demon is a robot) requires time and energy, and so whatever heat is saved in the container will be spent to run the demon's thinking processes. (This was first proposed in {{/public:t-720-atai:szilard-1929-entropy-intelligent-beings.pdf|1929 by Leo Szilard}}.) | |
| | |
| |
| \\ | \\ |
| | | Instructions of varying detail are possible. | | | | Instructions of varying detail are possible. | |
| | \\ Novelty | Novelty is unavoidable. \\ In other words, unforeseen circumstances will be encountered by any AI operating in such circumstances. Accordingly, it should be able to handle it, since that is essentially why intelligence exists in the first place. | | | \\ Novelty | Novelty is unavoidable. \\ In other words, unforeseen circumstances will be encountered by any AI operating in such circumstances. Accordingly, it should be able to handle it, since that is essentially why intelligence exists in the first place. | |
| | \\ What that means | 1. Since no agent will ever know everything, no agent (artificial or natural) must assume non-axiomatic knowledge. \\ 2. It cannot be assumed that all knowledge that the AI system needs to know is known by its designer up front. This means it must acquire its own knowledge. All advanced AI systems must be //cumulative learners//. \\ 3. Since it must acquire its own knowledge, incrementally, knowledge acquisition will introduce //knowledge gaps and inconsistencies//. \\ 4. A cumulative learning agent will continuously live in a state of //insufficient knowledge and resources// (with respect to perfect knowledge), due to the physical world's //limited time and energy//. | | | \\ What that means | 1. Since no agent will ever know everything, no agent (artificial or natural) can assume axiomatic knowledge. \\ 2. It cannot be assumed that all knowledge that the AI system needs to know is known by its designer up front. This means it must acquire its own knowledge. All advanced AI systems must be //cumulative learners//. \\ 3. Since it must acquire its own knowledge, incrementally, knowledge acquisition will introduce //knowledge gaps and inconsistencies//. \\ 4. A cumulative learning agent will continuously live in a state of //insufficient knowledge and resources// (with respect to perfect knowledge), due to the physical world's //limited time and energy//. | |
| |
| \\ | \\ |
