Center for Analysis and Design of Intelligent Agents

This page is read only. You can view the source, but not change it. Ask your administrator if you think this is wrong.
====== Course Overview / Lecture Notes ======

\\
\\
[[public:rem4:rem4-18:Final Exam|Final Exam]]
\\
\\


  * [[#Key_Concepts|Key Concepts]] (lecture notes below, this page) 
  * [[public:rem4:rem4-18:Scientific Publications|Scientific Publications]]
    - [[public:rem4:rem4-18:Scientific Environment]]
    - [[public:rem4:rem4-18:Research Grants]]
    - [[public:rem4:rem4-18:Being a Peer Reviewer]]
    - [[public:rem4:rem4-18:Ethics]]
  * [[public:rem4:rem4-18:Writing papers]] 
    - [[public:rem4:rem4-18:Abstract|Abstracts]]
    - [[public:rem4:rem4-18:Introduction|Introductions]] 
    - [[public:rem4:rem4-18:Related Work, References]]
    - [[public:rem4:rem4-18:Hypotheses, Method, Execution]]
    - [[public:rem4:rem4-18:Results, Conclusions]]
    - Supplementary High-Level Guidelines (Read the first two of these and at least one other; skim the rest)
      - [[https://www.cs.cmu.edu/~Compose/shaw-icse03.pdf|]]
      - [[http://dbis.rwth-aachen.de/~derntl/papers/misc/paperwriting.pdf|CS & informatics: Basics of research paper writing and publishing]] by Michael Derntl (first 4 sections; rest is optional).
      - [[http://web.nchu.edu.tw/~jlwu/articles/AbstractReject.pdf|How to have your abstract rejected]]
      - [[http://www.doiserbia.nb.rs/img/doi/0354-7310/2003/0354-73100303207B.pdf|Guidelines for scientific papers in biology]] by Silvija BRKI et al.
      - [[https://writingproject.fas.harvard.edu/files/hwp/files/bg_psychology.pdf|Guidelines for scientific papers in psychology]] by Harvard College.
      - [[https://ceprofs.civil.tamu.edu/ssocolofsky/downloads/paper_how-to.pdf|Guidelines for scientific papers in engineering]] by Scott A. Socolofsky.
      - [[http://www.froihofer.net/en/students/how-to-write-a-computer-science-paper.html|How to write a computer science paper]] by Lorenz Froihofer.
    - Supplementary Section-Related Tips & Tricks (recommended to read all)
      - [[http://www.cs.cmu.edu/~jrs/sins.html|Three Sins of Authors in Computer Science and Math]] by Jonathan Shewchuk.
      - [[https://cr.yp.to/writing/devil-conclusions.html|The Devil's Guide to Conclusions]] by <del>the Devil</del> D. J. Bernstein.
      - [[http://advice.writing.utoronto.ca/planning/intros-and-conclusions/|Introductions and Conclusions]] by L. Freedman et al.
    - Even More Readings (optional)
      - [[http://www.sportsci.org/jour/9901/wghstyle.html|GUIDELINES ON STYLE FOR SCIENTIFIC WRITING]] by Will G Hopkins.
      - [[http://abacus.bates.edu/~ganderso/biology/resources/writing/HTWtoc.html|Writing for journals]] - Department of Biology, Bates College. 
  * **Philosophy of Science**
    - [[public:rem4:rem4-18:philosophy of science I]]
      - [[https://en.wikipedia.org/wiki/Technology|What is technology?]]
      - [[https://en.wikipedia.org/wiki/Science|What is science?]]
      - [[https://en.wikipedia.org/wiki/Philosophy_of_science|What is philosophy of science?]]
      - [[http://science.howstuffworks.com/innovation/scientific-experiments/occams-razor2.htm|What is Occam's Razor?]]
      - [[https://en.wikipedia.org/wiki/Philosophy|What is philosophy?]]
      - [[https://en.wikipedia.org/wiki/Causality|What is causation?]]
      - [[http://www.informationphilosopher.com/freedom/causality.html|Causality]] on Information Philosopher
      - [[http://nostalgia.wikipedia.org/wiki/Logical_positivism|Logical positivism.]]
      - IRPS: //What is Science?// by Ziman
      - IPRS - {{http://cadia.ru.is/wiki/_media/rem4:iprs-selectedchpts2015copy.pdf|Introductory Readings in the Philosophy of Science}} [[public:rem-4:rem-4-18:missing lines in IRPSS|Missing lines in scan]]
    - [[public:rem4:rem4-18:philosophy of science II]]
      - IPRS: Science: //Conjectures & Refutations// by Karl Popper
      - IRPS: //Why Astrology is a Pseudoscience// by Paul R. Thagard
      - IPRS - {{http://cadia.ru.is/wiki/_media/rem4:iprs-selectedchpts2015copy.pdf|Introductory Readings in the Philosophy of Science}} [[public:rem-4:rem-4-18:missing lines in IRPSS|Missing lines in scan]] 
    - [[public:rem4:rem4-18:philosophy of science III]]
      - IRPS: Chapters 17,18,19 and 20
      - IPRS - {{http://cadia.ru.is/wiki/_media/rem4:iprs-selectedchpts2015copy.pdf|Introductory Readings in the Philosophy of Science}} [[public:rem-4:rem-4-18:missing lines in IRPSS|Missing lines in scan]] 
  * **Empiricism, Experiments & Information**  \\ // Research Methodology - a step-by-step guide for beginners// **(RM)** by Ranjit Kumar \\ All chapters except Ch10 (and Ch18 if you have the 3rd edition). Emphasis on those covered in class.
    - [[http://arachnoid.com/scientific_paradigm/index.html|The scientific paradigm]] by Paul Lutus
    - [[https://en.wikipedia.org/wiki/Empirical_evidence|What is empirical evidence?]] on Wikipedia
    - [[https://en.wikipedia.org/wiki/Experiment|What is a scientific experiment?]] on Wikipedia
    - [[public:rem4:rem4-18:design_of_comparative_experiments_i|Design of Comparative Experiments I]]
      - RM: Chs.7 (Rsch Des), 8 (Sel Study Des)
    - [[/public:rem4:rem4-18:design_of_comparative_experiments_ii|Design of Comparative Experiments II]]
    - [[http://www.mrtc.mdh.se/publications/0446.pdf|Scientific Methods in Computer Science]] by Dodig-Crnkovic.

\\
\\
\\
\\
==== Assignments ====
  - [[public:rem4:rem4-18:p1._pick_topic_for_your_paper|P1:Pick a Topic For Your Paper]] (compulsory pass/fail*) **Assigned:** 12 Jan  **DUE:** JAN @ 23:59 
    * [[public:sc-t-701-rem4-18-1:rem4-18-approvedTitles|Approved Tentative Titles 2018]]
  - [[public:rem4:rem4-18:P2. Good/Bad Abstract]] (compulsory pass/fail)  **Assigned:** 15 Jan 18 **DUE:** 22 Jan @ 23:59 am 
    * [[public:sc-t-701-rem4-18-1:rem4-18-students who finished P2|List of students done with P2]]
  - [[public:rem4:rem4-18:P3. Write an Abstract I|P3. Write a short Abstract]] for this paper (compulsory pass/fail) **Assigned:** 19 Jan 18 **DUE:** 25 Jan 18 @ 23:59
    * [[public:sc-t-701-rem4-18-1:rem4-18-Students who finished P3|List of students who finished P3]]
  - [[public:rem4:rem4-18:P4. Write an Abstract for your topic]] (5%) **Assigned:** 26 Jan **DUE:** 2 FEB @ 23:59
  - [[public:rem4:rem4-18:P5. Find paper to use as a template for your own]] (compulsory pass/fail)  **Assigned:** 26 Jan **DUE:** Feb 8
  - [[public:rem4:rem4-18:P6. Write an Introduction for Your Paper]] (5%) **Assigned:** Feb 9 **DUE:** Feb 16
  - [[public:rem4:rem4-18:P7. Related Work & References]] (5%) **Assigned:** Feb 16 **DUE:** Feb 23
  - [[public:rem4:rem4-18:P8. Review a fellow student s abstract|P8. Review a Peer´s Abstract]] **Assigned:** Mon 26 Feb **DUE:** Fri 2 Mar
  - [[public:rem4:rem4-18:P9. Hypotheses, Method, Execution]] (5%) **Assigned:** Mar 2 **DUE:** Mar 9
  - [[public:rem4:rem4-18:P10. Results & Conclusion]] (5%) **Assigned:** Mar 9 **DUE:** Mar 16
  - [[public:rem4:rem4-18:P11. Full Paper v.1.0]] (2%) **Assigned:** Mar16 **DUE:** Mar 26
  - [[public:rem4:rem4-18:P12. Review a Fellow Student's Paper]] (3%) **Assigned:** Mar 26 **DUE:** Apr 4
  - [[public:rem4:rem4-18:P13. Full Paper v.2.0]] (15%) **Assigned:** Mar 26 **DUE:** Apr 6

* //"Compulsory pass/fail" means that you **must** do this to continue on to the next assigned //Pn//, and your instructor will continue to provide feedback until you have satisfied its requirements. //
\\
\\
\\
\\
===== Key Concepts =====

==== Science, Technology, Philosophy, Mathematics ====

|  Philosophy  | A systematic investigation into any phenomenon. \\ Fundamental motivation: Deepened understanding of our place in the universe. \\ Fundamental driving principle: Human reasoning and creativity. \\ Fundamental organizing principle: Schools of thought; methods of reasoning. \\ //When you hardly know anything about a phenomenon, yet insist on getting to the bottom of it, philosophizing gets you started.// |
|  Induction  | The cognitive act of generalizing from experience. //Example: Socrates is a man. Socrates died. Hence, all men will die.//  |
|  Science  | A systematic investigation into phenomena in the natural world susceptible to physical experimentation. \\ Fundamental motivation: Reliable knowledge of the world. \\ Fundamental driving principle: Induction. \\ Fundamental organizing principle: Controlled comparative experiment. \\ //When you embark on improving your understanding of a phenomenon with measurable/quantifiable variables, through comparative experiments, you are applying the **scientific method** ("doing science").//  |
|  Engineering  | Effort to construct things using relevant knowledge (often state-of-the-art scientific models/theories - see below), systematic methods, and relevant technology. \\ Fundamental motivation: Control of human environment. \\ Fundamental principle: Design. \\ Fundamental organizing principle: Methodical application of known procedures and methods. \\ //When you embark on changing or improving any aspect of your environment, working towards the implementation of a well-defined end product, through an application of best known practices, you are doing engineering.//  |
|  Technology  | Tools and techniques for getting things done. Fundamental principle: Composition, design, engineering.  |
|  Deduction  | The cognitive act of following preconceived rules to their inevitable implication. //Example: All men are mortal. Socrates is a man. Hence, Socrates is mortal.//  |
|  Mathematics  | A systematic study of quantity, numbers, patterns, and their relationships. Fundamental principle: Deduction. \\ //When you embark on clarifying the behavior and nature of quantifiable domains, using axiomatic rules and proofs, you are doing mathematics.//  |

\\
\\
\\
\\
====Scientific Research Concepts / Definitions====

|  Theory (isl. kenning)  | "A set of statements or principles devised to explain a group of facts or phenomena, especially one that has been repeatedly tested or is widely accepted and can be used to make predictions about natural phenomena." [[http://dictionary.reference.com/search?q=theory|REF]] \\ A theory is a relatively big explanation, covering several phenomena, often through a single principle, or a set of simple principles.  |
|  Hypothesis (isl. tilgáta)  | Is a prediction about the relationship between a limited set of phenomena, typically formulated as measurable variables, as explained by a particular theory.  |
|  Data  | Typically "raw numbers" -- only contain low-level semantics.  |
|  Information  | Processed and prepared data. \\ Data organized at more than one level of detail. \\  "Data with a purpose."   |

\\
\\
\\
\\

==== The Scientific Method: The Comparative Experiment (ísl. samanburðartilraun) ====	 
|  Identification, description and formalization of phenomenon  | Observation and description of a phenomenon or group of phenomena. |
|  **Hypothesis**, null-hypothesis  | Formulation of an hypothesis to explain the phenomena. In physics, the hypothesis often takes the form of a causal mechanism or a mathematical relation. Null-hypothesis of a hypothesis is the claim that it is false - i.e. that some relationship that it proposes does **not** hold. |
|  Creation of **experimental setup** to test hypothesis  | Use of the hypothesis to predict the existence of other phenomena, or to predict quantitatively the results of new observations. |
|  Performance of experiment, collection and analysis of results  | Performance of experimental tests of the predictions by several independent experimenters and properly performed experiments. Basic assumption: Repeatability	Can be repeated by anyone anywhere  |
|  **Repeatability** requires formal framework  | Detailed description, clear goals, clear (limited) scope, hence the formalities in their execution  |
|  Key idea: **Comparsion**  | Baseline collected in same experimental setup without any other intervention by experimenter  |

\\
\\

|  {{public:t-701-rem4:scientific-method-1-gordana-dodig-crnkovic.png?700}}  |
|  Processes underlying hypothetico-deductive scientific work. REF: //Scientific Methods in Computer Science// by Gordana Dodig-Crnkovic  |

\\
\\
\\
\\

====Theories of the Scientific Method (Philosophy of Science) ====	 
|  A scientific theory predicts  | A good scientific theory can be used to predict (known and unknown) results.   |
|  A scientific theory is a spotlight  | A good scientific theory tells us where to look for interesting things; the more detailed the theory the more detailed should be its predictions and the more narrow its spotlight (specific suggestions for new investigations).   |
|  A scientific theory can produce new hypotheses  | A good scientific theory helps us do more experiments by being a source of hypothesis creation.   |
|  A scientific theory provides control  | A good scientific theory gives us control over the phenomenon it addresses that we would otherwise not have.  |
|  A scientific theory **explains** ("tells a story")  | A good scientific theory explains how data is related. The more **completely** and the more **simply** it explains things, the better the theory.  |
|  A scientific theory gives us the big picture  | A good scientific theory relates together, in a coherent way, some part of the world -- in general the bigger the part, the better the theory.   |
|  Occam's Razor  | A good scientific theory cannot be simplified; it is the shortest and most accurate explanation of a phenomenon. Einstein is quoted as saying: "A theory should be as simple as possible, but not simpler".   |
|  A scientific theory can be **disproven**.  | To count as "scientific" a theory must be disprovable. There must be some measures that are //possible// to do whose results could possibly - should the measurements come out a particular way - disprove the theory. \\ Applying this criterion strictly means that //all scientific theories to date have been disproven - i.e. proven incorrect.// \\ This is a //feature// of science (not a bug): Exposing the limits of our theories by demonstrating in which contexts they are incorrect allows us to come up with better theories.   |


\\
\\
\\
\\
====Scientific Method: Independent of Topic====
|  **Phenomenon**  | The world is filled with "stuff". Anything is a "thing" - even "nothing" is a thing (a concept in our minds, which is represented as neural patterns and potential for behavior). We can group any arbitrary collection of things and call it a **phenomenon**. //Example: A rock. A mountain. A planet.// (If I say that I want to study //"thingamajigs"// - something you've never heard of - I will first have to list some of the major ways in which thingamajigs can be identified. In fact, this is a good idea anyway, so as to be clear and consistent about what it is that one is studying.)   | 
|  The scientific method is independent of topic...  | One can study **any phenomenon** with the scientific method, including claims of telepathy; selection of topic is independent of method -- there is nothing inherently "unscientific" about studying any subject. (Close-mindedness //is//, however, very unscientific.) \\ In other words, given that science gets us the most reliable ("best") knowledge to build on at any time, we should take it seriously. But not so seriously as to exclude the possibility that it's wrong. (Because in fact we already know that **all** scientific knowledge is wrong -- i.e. every scientific theory to date has limits to its scope that we know of.) |
|  ... yet methodology varies significantly by field  |For example: \\ - Illegal to make experiments on living human brains \\ - Difficult to make comparative studies in sociology or space science.  |
|  Computer Science  | Direct testing of applications and programs.  \\ User-driven studies. \\ Models and simulations. \\ Logical and mathematical proofs.   |

\\
\\
\\
\\
====Models====
|  **Model**  | A model is a "cartoon" of a phenomenon -- an information structure that captures the most important (preferably all the important) aspects of a phenomenon in question.  | 
|  All scientific theories present a model  | No matter how explicit or implicit, all scientific theories are models of the world. //Best known example: E=mc^2//   | 
|  Science vs. Mathematics  | Mathematics is **axiomatic**: Some a-priori premises are (and must be) assumed. |
|  Science vs. Engineering  | In science we look for the model; in engineering we mold the world to behave like our model.  |
|  Science + Math  | We strive to make scientific theories (models of the world) mathematical because of the //compactness, precision,// and //specificity// this can give us. However, it is not guaranteed solely through the use of math because //a model must detail how it maps to the thing it is a model of//. If this is not done properly the math provides //no benefits//. \\ Mapping a model to its reference: A good scientist does it properly; a bad scientist does it sloppily; the wannabe ignores it happily. \\ Bottom line: Being mathematical is //no guarantee// for good science - it is neither necessary nor sufficient.   |
|  Science - Engineering - Math: The Holy Trinity  | The three fields so defined support each other: Building better scientific models helps us engineer better; engineering better helps us build new tools for doing science better. Both are bootstrapped by philosophy and clarified through math. |
|  The universe: Nothing is given  | How do we know that the sun will come up tomorrow? What evidence do we have? Can we prove it mathematically that the sun will come up tomorrow? \\ The only thing we know for sure is that we can perceive things in the world and that "I am here now". (This principle is most famously captured by Rene Descartes who wrote "I think, therefore I am".) \\ But since that perception is provided/generated by the same universe that we want to claim "exists" through those senses, using those grey cells, we cannot possibly know **for sure** what that really is, and hence whether it can be trusted. \\ Therefore, the universe is (and cannot be anything but) **non-axiomatic**.   |
|  Computer Science  | A creative mix of science, engineering and mathematics. \\ Direct testing of applications and programs; user studies  \\ Models and simulations. \\ Logical and mathematical proofs.   |


\\
\\
\\
\\
\\
\\
\\
\\
//EOF//