| |
| public:t-720-atai:atai-20:understanding [2020/10/18 16:30] – [In the Vernacular] thorisson | public:t-720-atai:atai-20:understanding [2024/04/29 13:33] (current) – external edit 127.0.0.1 |
|---|
| | Why It Is Important | Seems to be connected to "real intelligence" - when a machine does X reliably and repeatedly we say that it is "capable" of doing <m>X</m> qualify it with "... but it doesn't 'really' understand what it's doing". | | | Why It Is Important | Seems to be connected to "real intelligence" - when a machine does X reliably and repeatedly we say that it is "capable" of doing <m>X</m> qualify it with "... but it doesn't 'really' understand what it's doing". | |
| | What Does It Mean? | No well-known scientific theory exists. \\ Normally we do not hand control of anything over to anyone who doesn't understand it. All other things being equal, this is a recipe for disaster. | | | What Does It Mean? | No well-known scientific theory exists. \\ Normally we do not hand control of anything over to anyone who doesn't understand it. All other things being equal, this is a recipe for disaster. | |
| | Evaluating Understanding | Understanding any <m>X</m> can be evaluated along four dimensions: \\ 1. Being able to predict <m>X</m>, \\ 2. being able to achieve goals with respect to <m>X</m>, \\ 3. being able to explain <m>X</m>, and \\ 4. being able to "re-create" <m>X</m> ("re-create" here means e.g. creating a simulation that produces X and many or all its side-effects.) | | | Evaluating Understanding | Understanding any <m>X</m> can be evaluated along four dimensions: \\ 1. Being able to predict <m>X</m>, \\ 2. being able to achieve goals with respect to <m>X</m>, \\ 3. being able to explain <m>X</m>, and \\ 4. being able to "re-create" <m>X</m> \\ ("re-create" here means e.g. creating a simulation that produces X and many or all its side-effects.) | |
| |
| \\ | \\ |
| |
| ====It Used To Be "Common Sense"==== | ====It Used To Be Called "Common Sense"==== |
| |
| | Status of Understanding in AI | Since the 70s the concept of //understanding// has been relegated to the fringes of research. The only AI contexts it regularly appears in are "language understanding", "scene understanding" and "image understanding". | | | Status of Understanding in AI | Since the 70s the concept of //understanding// has been relegated to the fringes of AI research. The only AI contexts the term regularly appears in are "language understanding", "scene understanding" and "image understanding". | |
| | What Took Its Place | What took the place of understanding in AI is //common sense//. Unfortunately the concept of common sense does not capture at all what we generally mean by "understanding". | | | What Took Its Place | What took the place of understanding in AI is //common sense//. Unfortunately the concept of common sense does not necessarily capture at all what we generally mean by "understanding". | |
| | Projects | The best known project on common sense is the CYC project, which started in the 80s and is apparently still going. It is the best funded, longest running AI project in history. | | | Projects | The best known project on common sense is the CYC project, which started in the 80s and is apparently still going. It is the best funded, longest running AI project in history. | |
| | Main Methodology | The foundation of CYC is formal logic, represented in predicate logic statements and structures. | | | Main Methodology | The foundation of CYC is formal logic, represented in predicate logic statements and compound structures. | |
| | Key Results | Results from the CYC project are similar to the expert systems of the 80s - these systems are brittle and unpredictable. \\ Apparently the CYC system is being commercialized by a company called Lucid [[https://www.technologyreview.com/s/600984/an-ai-with-30-years-worth-of-knowledge-finally-goes-to-work/|REF]]. | | | Key Results | Results from the CYC project are similar to the expert systems of the 80s - these systems are brittle and unpredictable. \\ The state of the CYC system in 2016 is provided in this nicely written essay: [[https://www.technologyreview.com/s/600984/an-ai-with-30-years-worth-of-knowledge-finally-goes-to-work/|REF]]. | |
| | | \\ Two Problems | Upon further scrutiny, no good analysis or arguments exist of why 'understanding' should be equated with 'common sense'. The two are simply not the same thing. \\ Furthermore, progress under the rubric of 'common sense' in AI has neither produced any grand results nor evidence that the methodology followed is a promising one. | |
| \\ | \\ |
| |
| | \\ Phenomenon \\ <-> \\ Model | Phenomenon <m>Phi</m>: Any group of inter-related variables in the world, some or all of which can be measured.\\ Models <m>M</m>: A set of information structures that reference the variables of <m>Phi</m> and their relations <m>R</m> such that they can be used, applying processes <m>P</m> that manipulate <m>M</m>, to \\ (a) predict, \\ (b) achieve goals with respect to, \\ (c ) explain, and \\ (d) (re-)create <m>Phi</m>. | | | \\ Phenomenon \\ <-> \\ Model | Phenomenon <m>Phi</m>: Any group of inter-related variables in the world, some or all of which can be measured.\\ Models <m>M</m>: A set of information structures that reference the variables of <m>Phi</m> and their relations <m>R</m> such that they can be used, applying processes <m>P</m> that manipulate <m>M</m>, to \\ (a) predict, \\ (b) achieve goals with respect to, \\ (c ) explain, and \\ (d) (re-)create <m>Phi</m>. | |
| | \\ Definition of Understanding | An agent's **understanding** of a phenomenon <m>Phi</m> to some level <m>L</m> when it posses a set of models <m>M</m> and relevant processes <m>P</m> such that it can use <m>M</m> to \\ (a) predict, \\ (b) achieve goals with respect to, \\ (c ) explain, and \\ (d) (re-)create <m>Phi</m>. \\ \\ Insofar as the nature of relations between variables in <m>Phi</m> determine their behavior, the level <m>L</m> to which the phenomenon <m>Phi</m> is understood by the agent is determined by the //completeness// and the //accuracy// to which <m>M</m> matches the variables and their relations in <m>Phi.</m> | | | \\ Definition of Understanding | An agent's **understanding** of a phenomenon <m>Phi</m> to some level <m>L</m> when it posses a set of models <m>M</m> and relevant processes <m>P</m> such that it can use <m>M</m> to \\ (a) predict, \\ (b) achieve goals with respect to, \\ (c ) explain, and \\ (d) (re-)create <m>Phi</m>. \\ \\ Insofar as the nature of relations between variables in <m>Phi</m> determine their behavior, the level <m>L</m> to which the phenomenon <m>Phi</m> is understood by the agent is determined by the //completeness// and the //accuracy// to which <m>M</m> matches the variables and their relations in <m>Phi.</m> | |
| | \\ Why \\ 'Cumulative' \\ ? | According to the theory, 'understanding' is a learning process: A dynamic process that creates knowledge of a particular functional kind, namely the kind that can be used to predict, achieve goals, explain and (re-)create (see the point above in this table). \\ Unlike 'learning', however, in the vernacular the term 'understanding' is also used to describe a state - the state reached when the process is done (the output of 'learning' is 'knowledge' - the output of the 'understanding' is '//an// understanding'). We can see the difference if we replace 'understanding' with the term 'know': "A understands X" vs. "A //knows// X". \\ The term 'cumulative' emphasizes the 'learning' part of understanding - that it's a //process of creation//. | | | \\ Why \\ 'Cumulative' \\ ? | According to the theory, 'understanding' is a learning process: A dynamic process that creates knowledge of a particular functional kind, namely the kind that can be used to predict, achieve goals, explain and (re-)create (see the point above in this table). \\ Unlike 'learning', however, in the vernacular the term 'understanding' is also used to describe a //state// - the state reached when the process completes (the output of 'learning' is 'knowledge' - the output of the 'understanding' is '//an// understanding'). We can see the difference if we replace 'understanding' with the term 'know': "A understands X" vs. "A //knows// X". \\ The term 'cumulative' emphasizes the 'learning' part of understanding - a //process of creation//. \\ This generation process is key to human understanding because \\ (a) it is used many times a day - every time we learn anything new: It is an integral part of the //learning process// proper, and \\ (b) it a //general// process of knowledge acquisition that builds knowledge graphs incrementally, from experience, relying on reasoning processes as well as existing knowledge, and \\ ( c) the processes that //build// the knowledge and those that //use it// are the //**same **// processes. | |
| | REF | [[http://alumni.media.mit.edu/~kris/ftp/AGI16_understanding.pdf|About Understanding]] by Thórisson et al. | | | REF | [[http://alumni.media.mit.edu/~kris/ftp/AGI16_understanding.pdf|About Understanding]] by Thórisson et al. | |
| \\ | \\ |
