Center for Analysis and Design of Intelligent Agents

This material is ordered (roughly) by specificity, starting with the general topic of what intelligence is, progressing towards good old-fashioned AI (aka constructionist AI) and then onward towards artificial general intelligence. Within each topic the papers are ordered by importance, the most important first.

The recommended minimum number of papers to be read in each category is listed in brackets [ a,b ] after the title, where a refers to the necessary mandatory number of papers to be read, and b refers to the recommended absolute minimum number (papers are ordered from most to least important, so start counting from the top). This means you are expected to read at the very least around 30 papers in this course, so that comes out to at least 2-3 papers per week. Keep at it and you'll be fine! (Slack and you will reap the consequences.)

Note: Assigned readings should be read before class. Alternatively, as a less desirable alternative, readings may be read after class. Reading the assigned readings not at all should generally be avoided.

[ 3 ]

• The g factor on Wikipedia.
• Multiple theory of intelligence on Wikipedia.
• A Collection of Definitions of Intelligence by Legg & Hutter.
• Evolution, Learning & Culture: Computational Metaphors for Adaptive Algorithms by R. K. Belew

[ 3,5 ]

• What Is AI? by J. McCarthy.
• Four Basic Questions about Artificial Intelligence by P. Wang.
• Artificial General Intelligence on Wikipedia.
• Requirements for deliberative systems by A. Sloman – key sections: from 8 onwards.
• Computing Machinery and Intelligence by A. Turing.
• Three Fundamental Misconceptions of Artificial Intelligence by Pei Wang.
• What Do You Mean by “AI”? by P. Wang.
• A Computational Foundation for the Study of Cognition by D. Chalmers
• An integrated theory of mind by Anderson et al.
• Universal Intelligence: A Definition of Machine Intelligence by Shane Legg and Marcus Hutter.

[ 2,3 ]

• Introduction to Software Architecture by Garlan & Shaw.
• Constructionist Design Methdology paper by K.R. Thórisson.
• Introduction to RL video by D. Silvers.
• A Mind Model for Multimodal Communicative Creatures and Humanoids by Thórisson, K. R.

[ 1,1 ]

• Reinforcement Learning in the Encyclopedia of Cognitive Science by Peter Dayan and Christopher Watkins.
• Reinforcement Learning: An Introduction by Rich Sutton and Andrew Barto (1998) is the introductory text on RL.
• Algorithms for Reinforcement Learning by Csaba Szepesvári (2010) is a much more recent, shorter book that discusses the strengths and weaknesses of various RL algorithms. See also: Rich Sutton's FAQ.
• Machine Super Intelligence is Shane Legg's 2008 PhD thesis. While it is not on reinforcement learning, it does connect the concepts of RL to artificial general intelligence (or “universal AI” as they call it).
• Machine Learning: Reinforcement Learning is taught by Charles Isbell and Michael Littman on Udacity and is a full course on RL.
• A Short Course on Reinforcement Learning by Satinder Singh at MLSS'11 introduces RL and discusses some important shortcomings and proposed first steps to solving them.
• Advanced Topics: RL by David Silver is a more in-depth, modern RL course from one of the people who worked on Google DeepMind's Atari playing system that received a lot of (media) attention.
• Model-Based Reinforcement Learning is a tutorial given by Michael Littman at NIPS'09 about model-based RL, which is a lot less common than model-free RL, but not less interesting.

[ 2,3 ]

• Architectural Mismatch or Why it’s hard to build systems out of existing parts by Garlan, D., R. Allen and J. Ockerbloom. Also available here.
• Reductio ad Absurdum: On Oversimplification in Computer Science & its Pernicious Effect on Artificial Intelligence Research by K. R. Thórisson.
• ROBERT ROSEN’S ANTICIPATORY SYSTEMS THEORY: THE ART AND SCIENCE OF THINKING AHEAD by J. Rosen.
• The very laws of physics imply that artificial intelligence must be possible. What's holding us up? by D. Deutch.

[ 1,3 ]

• Essentials of General Intelligence by P. Voss
• What is AGI? by K. R. Thórisson.
• Introduction: Aspects of Artificial General Intelligence by P. Wang & B. Goerzel.
• Architectural Requirements for Human-like Agents Both Natural and Artificial by Sloman, A.
• Cognitive architectures: Research issues and challenges by Langley, P., Laird, J.E., Rogers, S.
• Mapping the Landscape of Human-Level Artificial General Intelligence by Adams et al.
• What Must a World Be Like That a Human-Like Intelligence May Develop In It by B. Goertzel.
• (ACT-R) An Integrated Theory of the Mind by Anderson, J. R.; Bothell, D.; Byrne, M.D.; Douglass, S.; Lebiere, C. & Qin, Y.

[ 3,4 ]

• Fridges, Elephants, and the Meaning of Autonomy and Intelligence by R. Sanz et al.
• Cognitive Architectures & Autonomy: A Comparative Review by K.R. Thórisson & H.P. Helgason
• Towards a Programming Paradigm for Control Systems With High Levels of Existential Autonomy by E. Nivel & K. R. Thórisson.
• A Framework for Autonomy Levels for Unmanned Systems (ALFUS) by Huang et al.
• The Emergence of Artificial Intelligence: Learning to Learn by P. Bock.

[ 2,2 ]

• Principles of Integrated Cognitive Control by R. Sanz et al.
• Self-awareness in Real-time Cognitive Control Architectures by Sanz, R., López, I. & Hernández, C.

[ 2,3 ]

• On Attention Mechanisms for AGI Architectures: A Design Proposal by Helgason et al.; accompanying video can be found here.
• A model of attention that takes global scene factors into account by Torralba.
• A three-layer model of selective attention by Mancas et al.
• Attention Capabilities for AI Systems by H. P. Helgason & K. R. Thórisson.

[ 1,3 ]

• Self-Programming: Operationalizing Autonomy by Nivel, E. & K. R. Thórisson.
• Raising AI: Tutoring Matters by Bieger et al.
• Approaches & Assumptions of Self-Programming in Achieving Artificial General Intelligence by Thórisson et al.
• Towards a Programming Paradigm for Control Systems With High Levels of Existential Autonomy by E. Nivel & K. R. Thórisson.
• Behavioral Self-Programming by Reasoning by Wang, P.
• Von Neumann Universal Constructor on Wikipedia.

[ 2,3 ]

• Raising AI: Tutoring Matters by Jordi Bieger, Kristinn R. Thórisson and Deon Garrett
• Machine teaching: An inverse problem to machine learning and an approach toward optimal education by Xiaojin Zhu
• Models of cooperative teaching and learning by Sarah Zilles, Steffen Lange, Robert Holte and Martin Zinkevich
• Teaching on a Budget: Agents Advising Agents in Reinforcement Learning by Lisa Torrey and Matthew E. Taylor
• Curriculum learning by Yoshua Bengio, Jérôme Louradour, Ronan Collobert and Jason Weston

[ 1,2 ]

• Critical Reasoning by Marianne Talbot. Also available here
• The Logic of Learning by P. Wang.
• Wason's Cards: What is Wrong? by P. Wang.

[ 1,1 ]

• Bounded Seed-AGI by E. Nivel et al.
• From Seed AI to Technological Singularity via Recursively Self-Improving Software by R. V. Yampolskiy.

[ 4,6 ]

• A New Constructivist AI: From Manual Construction to Self-Constructive Systems by K.R. Thórisson
• Can there be a science of complex systems? by H. A. Simon
• Achieving Artificial General Intelligence Through Peewee Granularity by Thórisson, K. R. & Nivel, E.
• Cybernetics and Second-Order Cybernetics by Heylighen, F. & C. Joslyn
• Self-Programming: Operationalizing Autonomy by Nivel, E. & K. R. Thórisson.
• Does the Future of AGI Lie in Cognitive Synergy? by B. Goertzel

[ 1,2 ]

• From NARS to a thinking machine by P. Wang
• What is NARS by K. R. Thórisson
• Introduction to NARS by P. Wang
• NARS intro paper by P. Wang
• NARS demos by P. Wang

[ 1,2 ]

• Bounded Seed-AGI by E. Nivel et al.
• Autonomous Acquisition of Natural Communication by K. R. Thórisson et al.
• Anytime Bounded Rationality by E. Nivel et al.
• Bounded Recursive Self-Improvement by E. Nivel et al.

[ 1,1 ]

• The Sigma Cognitive Architecture and System by P. S. Rosenbloom.

[ 1,1 ]

• OPENCOG PRIME: A COGNITIVE SYNERGY BASED ARCHITECTURE FOR ARTIFICIAL GENERAL INTELLIGENCE by Ben Goerzel.
• Getting Started with Open Cog by Ben Goerzel.

[0,0]

• Franklin, S. (2007). (LIDA) A Foundational Architecture for Artificial General Intelligence. Advances in Artificial General Intelligence: Concepts, Architectures and Algorithms. IOS Press, Amsterdam, The Netherlands, The Netherlands, pp. 36-54. PDF
• Anderson, J.R. & Schunn, C.D. (2000). Implications of the ACT-R learning theory: No magic bullets. Advances in instructional psychology. 5:1-34. Lawrence Erlbaum | PDF
• Laird, J.E.; Newell, A. & Rosenbloom, P.S. (1987). SOAR: An architecture for general intelligence. Artificial Intelligence, Volume 33, Issue 1, Pages 1-64 PDF
• Snaider, J; McCall, R. & Franklin, S. (2011). The LIDA framework as a general tool for AGI. Artificial General Intelligence, Lecture Notes in Computer Science. 2011. Volume 6830/2011. pp. 133-142 PDF

[ 6,8 ]

• Hybrid systems on Wikipedia.
• Towards Flexible Task-Environments For Comprehensive Evaluation of Artificial Intelligent Systems & Automatic Leaners by K. R. Thórisson et al.
• The Lovelace Test by M. Reidl.
• The Toy Box Problem by Johnston
• Psychometric Artificial General Intelligence: The Piaget-MacGuyver Room by Bringsjord, S. & Licato, J. (forthcoming). In Theoretical Foundations of Artificial General Intelligence, edited by P. Wang and B. Goertzel (Atlantis Press).
• Time, Clocks, and the Ordering of Events in a Distributed System by L. Lamport.
• Hybrid Dynamical Systems by R. Goebel et al.
• AGI Preschool: A Framework for Evaluating Early-Stage Human-like AGIs by Goertzel, B. & Bugaj, S. V. Proceedings of the Second Conference on Artificial General Intelligence, Atlantis Press.
• Theory of Hybrid Automata by T. A. Henzinger.
• HYBRID SYSTEMS: GENERALIZED SOLUTIONS AND ROBUST STABILITY by R. Goebel et al.

[ 2,3 ]

• Cognitive Architecture Requirements for Achieving AGI by J.E. Laird et al.
• Architectural Requirements for Human-like Agents Both Natural and Artificial by A. Sloman
• Cognitive architectures: Research issues and challenges. by Langley, P., Laird, J.E., Rogers, S. (2009). Cognitive Systems Research Vol 10(2), pp. 141-160.
• Towards a Complete, Multi-level Cognitive Architecture by R. Wray et al.

[ 0,1 ]

• When is a cognitive system embodied? by Riegler
• Does a Laptop Have a Body? by P. Wang.
• Social situatedness by Lindblom & Ziemke

[3,5]

• The Physical Symbol System Hypothesis: Status & Prospects by N. J. Nilsson.
• Minds, Brains & Programs by John Searle
• Subsymbolic Computation and the Chinese Room by D. Chalmers
• Syntactic Autonomy - Or Why There is no Autonomy Without Symbols and how Self-Organizing Systems Might Evolve Them by L. M. Rocha
• The Physics of Symbols: Bridging the Epistemic Cut by H. H. Pattee
• The 'Cybernetic Cut': Progressing from Description to Prescription in Systems Theory by D. L. Abel

Supporting material:

• Searle's Chinese Room Argument on the Internet Encyclopedia of Philosophy
• The Chinese Room on Wikipedia

[1,2]

• Strong and Weak Emergence by D. Chalmers
• Selected Self-Organization and the Semiotics of Evolutionary Systems by L. M. Rocha
• Weak Emergence by M. A. Bedau

[1,2]

• What's it Like to be a Bat? by T. Nagel
• Consciousness and its Place in Nature by D. J. Chalmers
• The Future of Consciousness - TEDx lecture by R. Hameroff
• Consciousness is a Mathematical Pattern - TEDx lecture by M. Tegmark
• Consciousness and the Brain - TEDx lecture by J. Searle

[0,3]

• Why are so many smart people such idiots about philosophy? by O. Goldhill
• Comparison table of cognitive architectures, courtesy of BICA Society / Alexei Samsonovich
• Ng-Thow-Hing, V., K.R. Thórisson et al (2009). Cognitive Map Architecture: Facilitation of Human-Robot Interaction in Humanoid Robots. PDF
• Toward a unified artificial intelligence by Wang, P.
• Creativity in a Nutshell by M. Boden.
• Militello, L.G., Dominguez, C.O., Lintern, G. & Klein, G. (2010). The Role of Cognitive Systems Engineering in the Systems Engineering Design Process. In Systems Engineering, Vol 13(3), pp. 261-273. PDF
• Pan, S. J. & Yang, Q. (2011). A survey on transfer learning. IEEE Transactions on Knoweledge and Data Engineering, 22(10), pp. 1345–1359. PDF
• Sanz, R., Hernandez, C., Gomez, J., Bermejo-Alonso, J., Rodriguez, M., Hernando, A. & Sanchez, G. (2009). Systems, models and self-awareness: Towards architectural models of consciousness. International Journal Of Machine Consciousness, 1(2), pp.255–279. PDF
• Silver, D.L. & Poirier, R. (2007). Requirements for Machine Lifelong Learning. IWINAC, LNCS (4527), pp.313-319. PDF
• PHYSICALISM, EMERGENCE AND DOWNWARD CAUSATION by Campbell and Bickhard
• Man as Machine - Joscha Bach's AGI intro lecture at AGI Summer School 2009
• Mastering the game of Go with deep neural networks and tree search by Silver, Huang et al. (DeepMind)
• Why Philosophers Should Care About Computational Complexity by S. Aaronsson
• A Vision for Computer Science - the System Perspective by J. Sifakis

• Journal of Artificial General Intelligence
• Introduction to Artificial Intelligence - A Modern Approach by S. Russell & P. Norvig

EOF