[[http://cadia.ru.is/|CADIA Main Page]]
======T-720-ATAI, ADVANCED TOPICS IN ARTIFICIAL GENERAL INTELLIGENCE, FALL 2012======

**Instructor: Kristinn R. Thórisson** \\
**Teaching Assistant: Deon Garrett** \\
**8 ECTS Units, full Master's-level course** \\
**Days: Tuesdays & Fridays** \\
**Time: 12:20 - 14:00** \\
**Classroom: M112**

\\
\\
====Course Description====

The course focuses on recent advances in holistic intelligence architectures, often called artificial general intelligence (AGI). At the core are questions originally asked by the founders of the field, such as Turing, Minsky and others, in the very early days of the field: //What is intelligence?// and //How can we implement intelligence in a machine?//  Issues related to intelligence architecture, system autonomy, realtime attention, anytime planning, and model-based knowledge representation, with concepts from systems theory, autopoiesis, constructivist AI, and cybernetics providing key foundational concepts. Historical background and relevant topics from constructionist AI (good old-fashioned AI) provide a backdrop to the challenge building of more autonomous and self-contained intelligent systems; relevance of AGI to autonomous robotics and systems operating in the real-world will be discussed.

===Prerequisites===

  * Programming experience necessary, LISP, Prolog or Haskel a plus
  * A prior introductory class in one or more of the following is recommended: Artificial intelligence, Simulation techniques, cognitive science

=== Goals ===
After taking the course, diligently attended the classes, thoroughly read reading and homework assignments, 

  * students should be able to:
    * identify key challenging research questions related to AGI;
    * list the methodological difficulties and known solutions to building AGI systems;
    * apply presently-known techniques and methodologies for building complex AI systems;
    * explain some key components of AGI architectures and how these relate to the creation of truly intelligent machines of the future;
  * furhermore, students should have a good idea of:
    * how AGI differs from "narrow AI";
    * what requirements exist for building complete minds;
    * what methodologies are available for building complete minds;
    * how software architecture plays a central role in AGI (and AI);
    * some AGI projects in progress;
  * and finally, students should have some experience with:
    * one programming environment targeting AGI;
    * the phenomenon of emergence, and why it is relevant to AGI.

\\
====Readings====

  * [[public:t-720-atai:readings|Readings and Study Material page]] - readings and material organized by topic. 
  * To see readings in temporal order, see [[#schedule|schedule]] below on this page.
  * Readings for the class will be published incrementally, as needed. 

\\

====Assignments====
//Note: This assignment outline is indicative only; until September 31st some details of these assignments, and their percentage of total grade, may be changed.//

  * Students should hand in their assignments (using MySchool) on time; if there will be any unnecessary delay in handing in the assignment then students may assume a lower grade as a result.

=== Class Discussions ===

  * Regular Discussions of reading material will be held, for 30-40 minutes every Friday.
  * For discussions we will use the forum on [[http://ru-t-720-atai.proboards.com/index.cgi?board=t720atai2012|proboards]].
  * After most Tuesday classes the instructor will post a link on the course online forum to a paper or article on an interesting aspect of Artificial General Intelligence (which may or may not be directly related to the topic being covered that week). You need to read this paper or article by Thursday at midnight and post, under the same forum thread, 2 questions you have about the contents of the reading. This post has to arrive by 23:59 on Thursday night to count towards your paper discussion grade. The questions can point out concepts that you have difficulty understanding, but preferably they should be questions that provoke discussion from the material. In the discussion section of the following Tuesday class, chosen questions from those submitted will be discussed by the group as a whole and you are expected to participate.
  * Participation is mandatory
  * **Grading: 20%** of final grade
    * each topic counts equally towards the grade
    * 2 discussions may be omitted with no effect on grade
    * in-person attendance at 2 discussion classes may be omitted with no effect on grade

=== Small Programming Projects ===

  * Four small programming projects in the [[http://code.google.com/p/open-nars/|NARS environment]] (see [[http://code.google.com/p/open-nars/source/browse/trunk/nars-dist/Examples/|examples]]).
  * **Grading: 25%** of final grade.
  * [[:public:t-720-atai:prog-projs|Programming Projects Resources Page]]


=== Short Essay ===

  * One short essay.
  * **Grading: 15%** of final grade.
  * [[:public:short-essay-page|Short essay page]]

  * **Draft Due**: //Nov 6// (Mandatory, but not part of grade)
  * **Final Version Due**: //Before midnight Nov 30//

===Final Exam===

  * Final Exam will **count 40%** of final grade (includes 2 bonus points, each counting 0,25 out of 10,0).
    * A grade of 4,75 or higher is required to pass the course. 
    * Handing in the assignments is not a requirement to get permission to take the final exam.
    * All material covered may be subject of the Final Exam.
    * Assume to be able to draw architectural diagrams, write pseudo-code, and write (short) essays.
    * No helping material is allowed.
    * [[:public:t-720-atai:final_exam_examples|Example Final Exam Questions]]

=== Schedule for Hand-Ins ===

  * **Programming assignments**
    * Prog Assignm 1: Due before //**midnight Nov 27**//
    * Prog Assignm 2: Due before //**midnight Dec 3**//
  * **Short essay**: 
    * Choice of topic: //by noon, Tuesday September 18//
    * Draft Due: //Nov 6// (Mandatory, but not part of grade)
    * Final Version Due: //Before midnight Nov 30//


\\
\\
==== Schedule ====

===August===				
**Aug Tue 22**:  Introduction to T-720-ATAI \\
**Aug Fri 24**:  [[public:t720-atai-2012:what_is_agi| What is artificial general intelligence?]] | Readings:  \\
  * [[http://www.agiri.org/wiki/Artificial_General_Intelligence| Artificial General Intelligence Research Institute]]
  * [[http://journal.agi-network.org/AimandScope/tabid/91/Default.aspx| Journal of Artificial General Intelligence]] home page.
  * [[http://www.iiim.is/2010/05/agi-cognitive-synergy-goertzel/| Does the Future of AGI Lie in Cognitive Synergy?]] by B. Goertzel
  * [[http://www.iiim.is/2010/05/questions-about-artificial-intelligence/| Four Basic Questions about Artificial Intelligence]] by P. Wang
**Aug Tue 28**:  [[public:t720-atai-2012:whatisintelligence| What is intelligence?]] | Readings:  \\
  * [[http://en.wikipedia.org/wiki/General_intelligence_factor| The g factor]] on Wikipedia.
  * [[http://en.wikipedia.org/wiki/Theory_of_multiple_intelligences| Multiple theory of intelligence]] on Wikipedia.
  * [[http://en.wikipedia.org/wiki/Strong_AI| Strong AI]] on Wikipedia.
**Aug Fri 31**:  [[public:t720-atai-2012:whatisintelligence| What is intelligence?]] | Remember to post 2 questions to [[http://ru-t-720-atai.proboards.com/index.cgi?action=display&board=t720atai2012&thread=1&page=1|the forum]] | Readings:  \\
  * [[http://en.wikipedia.org/wiki/Cognition| Cognition]] on Wikipedia. 
  * [[http://en.wikipedia.org/wiki/Situated_cognition| Situated cognition]] on Wikipedia.
  * [[http://en.wikipedia.org/wiki/Animal_cognition| Animal cognition]] on Wikipedia.
  * [[http://consc.net/papers/computation.html| A Computational Foundation for the Study of Cognition]] by D. Chalmers
\\


===September===				
**Sep Tue 04**:  [[public:t720-atai-2012:Requirements| Requirements: How do we build an intelligent machine?]] | Readings: \\
  * [[http://www.cs.bham.ac.uk/research/projects/cogaff/misc/fully-deliberative.html|Requirements for deliberative systems]] by A. Sloman -- key sections: from 8 onwards.
  * [[http://www.atlantis-press.com/php/download_paper.php?id=1900|Cognitive Architecture Requirements for Achieving AGI]] by J.E. Laird et al. 
  * [[http://www.cs.bham.ac.uk/research/projects/cogaff/Sloman.kd.pdf|Architectural Requirements for Human-like Agents Both Natural and Artificial]] by A. Sloman
**Sep Fri 07**:  [[public:t720-atai-2012:methodology| Methodology: How do we build an intelligent machine?]] | Readings:  \\
  * {{:public:intro_to_software_arch.pdf| Introduction to Software Architecture}} by Garlan & Shaw
  * [[http://pespmc1.vub.ac.be/Papers/Cybernetics-EPST.pdf| Second-Order Cybernetics]] by Heylighen, F. & C. Joslyn
**Sep Tue 11**:  [[public:t720-atai-2012:constructionistai| What is constructionist AI?]] | Readings: \\
  * [[http://xenia.media.mit.edu/%7Ekris/ftp/AIMag-CDM-ThorissonEtAl04.pdf| Constructionist Design Methodology]] paper by K.R. Thórisson
  * [[http://xenia.media.mit.edu/%7Ekris/ftp/IJAAI.pdf| A Mind Model for Multimodal Communicative Creatures and Humanoids]] by K.R. Thórisson
  * [[http://en.wikipedia.org/wiki/Belief–desire–intention_software_model| Beliefs, Desires, Intentions - model for agents]] on Wikipedia
  * [[http://dspace.mit.edu/bitstream/handle/1721.1/6432/AIM-864.pdf| Subsumption architecture]] by R. Brooks.
**Sep Fri 14**:  [[public:t720-atai-2012:architecture| Why is architecture critical in AI?]] | Readings:  \\
  * [[http://act-r.psy.cmu.edu/papers/403/IntegratedTheory.pdf| An integrated theory of mind]] by Anderson et al.
  * [[http://www.agiri.org/docs/CognitiveArchitectures.pdf| AGI architecture review]] by Duch et al.
**Sep Tue 18**:  [[public:t720-atai-2012:architecture| How is architecture important in AI?]]   \\
  * {{:public:archmismatch-icse17.pdf| Architectural Mismatch}} by Garlan, Alan & Ockerbloom
  * [[http://alumni.media.mit.edu/~kris/ftp/PeeweeGranularity-Thorisson-Nivel-09.pdf| Achieving Artificial General Intelligence Through Peewee Granularity]] By K.R. Thórisson & E. Nivel.
  * [[http://alumni.media.mit.edu/~kris/ftp/agi-09-self-programming-Nivel-Thorisson.pdf| Self-Programming: Operationalizing Autonomy]] by E. Nivel & K.R. Thórisson. 
**Sep Fri 21**:  What architectures have been built? | Readings: \\
  * [[http://versita.metapress.com/content/052t1h656614848h/fulltext.pdf| JAGI paper on Autonomy]] by K.R. Thórisson & H.P. Helgason 
**Sep Tue 25**:  NC \\
**Sep Fri 28**:  NC \\
\\
\\

===October===				
**Oct Tue 02**:  [[public:t720-atai-2012:nars| What is NARS?]] | Readings: \\
  * [[http://www.cis.temple.edu/~wangp/Writing/NARS-Intro.html| Online intro to NARS]] by P. Wang
  * [[http://www.cis.temple.edu/~wangp/Publication/unifiedAI.pdf| NARS intro paper]] by P. Wang

**Oct Fri 05**:  Intro to Prolog and NARS | //Instructor: Deon Garrett// | Readings: \\
  * Unification and deduction in Prolog; Prolog can only make deductions it can prove correct
  * [[public:t-720-atai:prog-projs#prolog| Prolog & NARS materials]]

**Oct Tue 09**:  Intro to NARS | //Instructor: Deon Garrett// | Readings: \\
  * [[http://www.cis.temple.edu/~wangp/demos.html| NARS demos]] by P. Wang
  * **NAL-1**, and major extensions to NAL-1: the new copula like equivalence, sets, and higher-order representation
  * Intro to Progr. assignments
  * [[public:t-720-atai:prog-projs#assignment_1|Programming Assignment 1]]

**Oct Fri 12**:  [[public:t720-atai-2012:constructivistai| What is constructivist AI?]] | Remember to post 3 questions to [[http://ru-t-720-atai.proboards.com/index.cgi?action=display&board=t720atai2012&thread=5&page=1#35|the forum]] | Readings: \\
  * [[http://xenia.media.mit.edu/~kris/ftp/Thorisson_chapt9_TFofAGI_Wang_Goertzel_2012.pdf|A New Constructivist AI]] by K.R. Thórisson

**Oct Tue 16**:  [[public:t720-atai-2012:constructivistai| What is constructivist AI? - part 2]] | Readings: \\
  * [[http://xenia.media.mit.edu/~kris/ftp/Thorisson_chapt9_TFofAGI_Wang_Goertzel_2012.pdf|A New Constructivist AI]] by K.R. Thórisson

**Oct Fri 19**:  [[public:t720-atai-2012:emergence| What is emergence and how is it relevant to AGI?]] | Readings: \\
  * [[http://en.wikipedia.org/wiki/Emergence| Emergence explained]] on Wikipedia
  * [[http://www.evolutionofcomputing.org/Multicellular/FourPrinciples.html| Four principles of multi-cellular systems]] on evolutionofcomputing.org

**Oct Tue 23**:  [[public:t720-atai-2012:constructivistai|More on constructivist AI]] | Readings: \\
  * (No new readings)

**Oct Fri 26**:  AGI Programming Assignments session | //Instructor: Deon Garrett// 

**Oct Tue 30**:  [[public:t720-atai-2012:attention| Attention]]  | //Instructor: Helgi Páll Helgason//  | Readings: \\
  * [[http://en.wikipedia.org/wiki/Attention| Overview of human attention]] on Wikipedia.
  * [[http://en.wikipedia.org/wiki/Broadbent's_filter_model_of_attention| Broadbent's filter model of attention]] on Wikipedia.
  * [[http://www.scholarpedia.org/article/Computational_models_of_visual_attention| Computational models of primate visual attention]] on Scholarpedia.
  * {{:public:attention.pptx|Attention slides}} by Helgi Páll Helgason

\\

===November===				

**Nov Fri 02**:  Flexible resource management: Attention for AGIs | //Instructor: Helgi Páll Helgason//  | Readings: \\
  * [[http://www.tcts.fpms.ac.be/publications/papers/2007/wcaa2007_mmbgbm.pdf| A three-layer model of selective attention]] by Mancas et al.
  * [[http://web.mit.edu/torralba/www/josa.pdf| A model of attention that takes global scene factors into account]] by Torralba.
  * [[http://www.perseptio.com/publications/Helgason-AGI-2012.pdf| On Attention Mechanisms for AGI Architectures : A Design Proposal]] by H.P. Helgason, E. Nivel & K.R. Thórisson
  * {{public:controlmechanisms.pptx|Attention part II slides}} by Helgi Páll Helgason

**Nov Tue 06**:  Autonomy | //Instructor: Helgi Páll Helgason// | Readings: \\
  * [[http://versita.metapress.com/content/052t1h656614848h/fulltext.pdf| JAGI paper on Autonomy]] by K.R. Thórisson & H.P. Helgason 
  * [[http://xenia.media.mit.edu/~kris/ftp/agi-09-self-programming-Nivel-Thorisson.pdf|Self Programming: Operationalizing Autonomy]] by Nivel & Thórisson
  * [[http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.77.6352&rep=rep1&type=pdf|A Framework for Autonomy Levels For Unmanned Systems (ALFUS)]] by Huang et al
  * [[http://tierra.aslab.upm.es/~sanz/old/docs/ISIC-2000.pdf|Fridges, Elephants and the Meaning of Autonomy and Intelligence]] by Ricardo Sanz et al
  * {{public:autonomy.pptx|Autonomy slides}} by Helgi Páll Helgason

**Nov Tue 09**:  //No Class//  \\ 


**Nov Fri 13**:  [[public:t-720-atai-2012:creativity| Topics in AGI: What is creativity?]] | Readings: \\
  * [[http://www.aeonmagazine.com/being-human/david-deutsch-artificial-intelligence/| The very laws of physics imply that artificial intelligence must be possible. What's holding us up?]] by David Deutch
  * [[http://cadia.ru.is/wiki/_media/public:publications:creativity-summaryreport-final.pdf|Evolution of Creativity: A Summary Report]] by Thorisson & Thórisson

**Nov Fri 16**:  [[public:t720-atai-2012:situatedness| Situatedness, embodiment, and embededness]] | Readings: \\
  * [[http://www.sciencedirect.com/science/article/pii/S1389041702000463#BIB10| When is a cognitive system embodied?]] by Riegler
  * [[http://cogprints.org/2517/1/Lindblom.pdf| Social situatedness]] by Lindblom and Ziemke
  * Don't forget to post three questions to the [[http://ru-t-720-atai.proboards.com/index.cgi?action=display&board=t720atai2012&thread=9|pboard]] before 11 am Friday Nov 16.

**Nov Tue 20**:  [[public:t720-atai-2012:selfrepresentation| Topics in constructivist AI architectures: Self-representation]] | Readings: \\
  * [[http://www.cse.unl.edu/~ylu/csce896/papers/remote-agent.pdf|Remote Agent: to boldly go where no AI system has gone before]] by Muscoletta et al. 

**Nov Fri 23**: AGI Programming Assignments session | //Instructor: Deon Garrett// 
  * The second half of the programming assignment will be presented
  * NARS refresher + Q&A: Bring some questions of your own!

**Nov Tue 27**:  How do we measure and evaluate AGIs? | Readings:  \\
  * [[http://kryten.mm.rpi.edu/Bringsjord_Licato_PAGI_071512.pdf | Psychometric Artificial General Intelligence:  The Piaget-MacGuyver Room]] by Bringsjord, S. & Licato, J. (2012). In Theoretical Foundations of Artificial General Intelligence, edited by P. Wang and B. Goertzel (Atlantis Press). 
  * Don't forget to post three questions to the [[http://ru-t-720-atai.proboards.com/index.cgi?action=display&board=t720atai2012&thread=10&page=1|pboard]] before 10 am Friday Nov 27.

**Nov Fri 30**: [[public:t720-atai-2012:area| What is the AERA system?]] & **//Course Review//** | Readings:
  * [[http://wiki.humanobs.org/public:publications:proj-videos|Videos of S1/AERA]] on the HUMANOBS.org website wiki. 
  * Take a close look at the course notes


\\

===December===				
**Dec Wed 05**:  **Final Exam, 14:00-16:00, in V201**

\\
\\
EOF