[[http://cadia.ru.is/wiki/public:t-701-rem4-16-3:rem4-16-main|REM4 2016 course notes]] ==This is the main page for REM4-16-3== **//2016//** ======T-701-REM4-16-3 Research Methodology / Aðferðafræði Rannsókna====== **Classrooms**: Mondays: //M108// -- Fridays: //M105// \\ **Instructors:** [[http://www.ru.is/faculty/thorisson|Kristinn R. Þórisson]] (KRÞ), Jacky Mallett (JM), Jordi Bieger (JB) \\ \\ \\ ==== Final Exam ==== **Date: //16 Nov.// Time: //9-12// Place: //M201//** \\ The topics the final 3-hour exam will cover are: Experimental design, statistics and philosophy of science, roughly in the proportions that these have been emphasized in the lectures and lecture notes. The emphasis will be on understanding of the concepts, topics and issues, rather than rote memorization, but of course students should know all the key important issues by heart. [[public:t-701-rem4-15-3:Example-Final-Exam-Questions | Final example example questions from 2015.]] **Note that this is a //closed-book no support-material// exam.** The final exam counts 55% of your final grade. === Course Aims & Goals === The course has two main aims. First, to provide the student with a compact foundation for the principles of scientific knowledge discovery, its foundational principles and concepts, the use of statistics for scientific investigation, and philosophical context out of which science came. Second, to provide the student experience in writing scientific text, focusing on scientific papers with results and data. After taking the course the student should be able to: - Explain research, research methodologies, research in computer science; - Choose a research subject and conduct a research project; - Write technical reports, papers, thesis, proposals effectively; - Extract key points of a body of scientific research and present in a concise manner; - Read and review technical papers; - Explain professional ethics in science: author credit, conflict of interest, misconduct. \\ **NB: For all homework and correspondence sent via email: PLEASE PUT "REM4" SOMEWHERE IN THE TITLE OF YOUR EMAIL, SO IT GETS CLASSIFIED CORRECTLY IN THE INSTRUCTOR'S INBOX. Thanks. ** \\ \\ =====Readings===== By the end of the course you are expected to have read, learned, and //thoroughly understood// the following texts and topics: ===Research methodology=== * Book: //Research Methodology - a step-by-step guide for beginners // ("RM"), Ranjit Kumar - All chapters except Ch10 (and Ch18 if you have the 3rd edition). Emphasis on those covered in class. * http://www.music-ir.org/mirex/wiki/2016:Main_Page * {{rem4:martal-rem4-autumn2016.pptx}} * {{http://cadia.ru.is/wiki/_media/rem4:halmos-excerpts.pdf|Paul Halmos: In His Own Words}} ===Scientific Concepts & Philosophy=== * Introductory Material * [[https://en.wikipedia.org/wiki/Philosophy | What is philosophy?]] * [[https://en.wikipedia.org/wiki/Science | What is science?]] * [[https://en.wikipedia.org/wiki/Technology | What is technology?]] * [[https://en.wikipedia.org/wiki/Philosophy_of_science | What is philosophy of science?]] * [[http://science.howstuffworks.com/innovation/scientific-experiments/occams-razor2.htm | What is Occam's razor?]] * [[https://en.wikipedia.org/wiki/Causality | What is causation?]] * [[https://en.wikipedia.org/wiki/Empirical_evidence | What is empirical evidence?]] * [[https://en.wikipedia.org/wiki/Experiment | What is a scientific experiment?]] * [[http://arachnoid.com/scientific_paradigm/index.html | The scientific paradigm]] * In-Depth * //Introductory Readings in the Philosophy of Science// ("IRPS"). E.D.Klemke, R. Hollinger, D. W. Rudge and A. D. Kline (Eds.). - Selected chapters (see below). [[public:rem4:rem4-15:IPRSreadings|IRPS - selected chapters]] * Thomas Kuhn * Short overview: http://www.britannica.com/eb/article-9002756/Thomas-S-Kuhn * Longer overview: http://plato.stanford.edu/entries/thomas-kuhn/ * Example of a paradigm shift a la Kuhn: http://www.britannica.com/eb/article-261582/plate-tectonics#936104.hook * Karl Popper * Short overivew: http://nostalgia.wikipedia.org/wiki/Karl_Popper * Imre Lakatos * Short overview: http://en.wikipedia.org/wiki/Imre_Lakatos * Short summary of his attempt to reconcile Kuhn & Popper: http://coraifeartaigh.wordpress.com/2011/02/11/kuhn-vs-popper-the-philosophy-of-lakatos/ ===Nature & Evolution of Science=== * [[http://plato.stanford.edu/entries/scientific-progress/ | Scientific progress]] ===Information=== * [[http://www.informationphilosopher.com/ | Introduction to information / information philosophy]] * [[http://plato.stanford.edu/entries/information/ | What is information?]] ===Logical Positivism=== * Short definition: http://nostalgia.wikipedia.org/wiki/Logical_positivism ===Additional Material=== Use the [[http://plato.stanford.edu/|Stanford Encylopedia of Philosophy]] and Google to further explore concepts and ideas that we encounter. Wikipedia is an excellent source of relatively high-quality texts on numerous scientific, philosophical and mathematical topics. Useful hub on science: http://undsci.berkeley.edu/resourcelibrary.php Philosophy of Science with humor: http://consc.net/phil-humor.html Using [[public:rem4:rem4-15:LateX]] for writing scientific papers. [[public:rem4:rem4-15:LaTeX Reverse Engineering|LaTeX Reverse Engineering exercise]] [[https://www.youtube.com/watch?v=zxn6yFcrPDM|Excellent talk on Leslie Lamport, Turing Award Winner, by Magnús Már Halldórsson (RU) -- highly recommended for all CS majors]] \\ \\ \\ ===== Class Schedule ===== ====AUGUST==== ^Date^Time^Who^Topic^Reading Material^Assignment^Due^ | Fri 19.08.2016 | 10:20 - 11:55 | KRTh | Introduction | All the "What is ...?" readings listed above | | | ^W2 AUG^^^^^^^ | Mon 22.08.2016 | 14:00 - 15:40 | KRTh | Key concepts \\ First Homework Assignment: Writing Scientific Papers - Pick a topic | [[public:rem4:rem4-16:Course Overview|Course overview / key concepts]] \\ The "What is ...?" readings listed above that you still haven't read (or, ok, maybe you read them all before last class :-)) | [[public:rem4:rem4-16:P1. Pick topic for your paper]] | Mon 29/08@noon | | Fri 26.08.2016 | 10:20 - 11:55 | KRTh | Writing papers \\ Papers: Abstracts, Introductions, Related Work | [[public:rem4:rem4-16:Writing papers]] \\ [[public:rem4:rem4-16:Abstract|Abstracts]] \\ [[public:rem4:rem4-16:Introduction|Introductions]] \\ [[public:rem4:rem4-16:Related Work, References]] \\ RM:Ch17 - Writing Research Reports | [[public:rem4:rem4-16:P2. Good/Bad Abstract]] (pass/fail) \\ \\ [[public:rem4:rem4-16:P3. Write an Abstract I|P3. Write a short Abstract]] (pass/fail) | 01.09@noon \\ \\ \\ 05.09@noon | ^W3 AUG/SEP^^^^^^^ | Mon 29.08.2016 | 14:00 - 15:40 | KRTh | Papers: Original contributions, Conclusions, References | [[public:rem4:rem4-16:Related Work, References]] \\ [[http://web.nchu.edu.tw/~jlwu/articles/AbstractReject.pdf|How to have your abstract rejected]] \\ | [[public:rem4:rem4-16:P4. Write an Abstract for your topic]] (5%) \\ \\ [[public:rem4:rem4-16:P5. Find paper to use as a template for your own]] (pass/fail) | 19.09@noon \\ \\ \\ 08.09@noon | ==== SEPTEMBER ==== ^Date^Time^Who^Topic^Reading Material^Assignment^Due^ | Fri 02.09.2016 | 10:20 - 11:55 | Markus Schedl | **Visiting researcher:** Research methods for developing music indexes | http://www.music-ir.org/mirex/wiki/2016:Main_Page \\ {{public:t-701-rem4:markusschedl-methodology-slides.pdf|Markus Schedl slides}} | | | ^W4 SEP^^^^^^^ | Mon 05.09.2016 | 14:00 - 15:40 | KRTh | Philosophy of Science \\ Review:P1 | [[public:rem4:rem4-16:Philosophy of Science I]] \\ [[http://www.informationphilosopher.com/freedom/causality.html | Causality]] \\ IRPS: Introduction, Science & Pseudoscience [[public:rem4:rem4-15:IPRSreadings|IRPS scan]] | | | | Fri 09.09.2016 | 10:20 - 11:55 | Marta Lárusdóttir | **Visiting Researcher:** Research methods for user interface design and evaluation | {{rem4:paperi-marta-predictionusability-comparingmethodsmartal.pdf|Prediction of Usability: Comparing Method Combinations}} by Frökjær & Lárusdóttir \\ {{rem4:martal-rem4-autumn2016.pptx}} \\ [[public:rem4:rem4-16:UI Methodology - emphasis points|UI Methodology - emphasis points]] | | | ^W5 SEP ^^^^^^^ | Mon 12.09.2016 | 14:00 - 15:40 | Magnús Már Halldórsson | **Visiting Researcher:** Mathematical & CS research methods | {{http://cadia.ru.is/wiki/_media/rem4:halmos-excerpts.pdf|Paul Halmos: In His Own Words}} by John Ewing \\ [[public:rem4:rem4-16:MMH empahsis points| MMH Emphasis Points]] | | | | Fri 16.09.2016 | 10:20 - 11:55 | Joanna Bryson | **Visiting researcher:** Simulation & social science | | | | ^W6 SEP ^^^^^^^ | Mon 19.09.2016 | 14:00 - 15:40 | KRTh | Philosophy of Science \\ Review:P5 | [[public:rem4:rem4-16:Philosophy of Science I]] \\ [[public:rem4:rem4-16:Philosophy of Science II]] \\ IRPS:pp.38-47 [[public:rem4:rem4-15:IPRSreadings|IRPS scan]] \\ | [[public:rem4:rem4-16:P6. Introduction]] (5%) | Sep22@noon | | Fri 23.09.2016 | 10:20 - 11:55 | KRTh | Experimental Design \\ Review:P3 | [[public:rem4:rem4-16:Experimental Designs I]] \\ RM:Chs.7 (RschDes), 8 (Sel Study Des) | [[public:rem4:rem4-16:P7. Related Work and References]] (5%) | Oct3@noon | ^W7 SEP ^^^^^^^ | Mon 26.09.2016 | 14:00 - 15:40 | KRTh | Philosophy of Science | [[public:rem4:rem4-16:Philosophy of Science II]] \\ [[public:rem4:rem4-16:Philosophy of Science III]] \\ IRPS:Chs.2,17,18,19,20 [[public:rem4:rem4-15:IPRSreadings|IRPS - selected chapters]] | | | | Fri 30.09.2016 | 10:20 - 11:55 | KRTh | Writing Papers: Contributions & Results |[[public:rem4:rem4-16:Contribution & Results]] \\ [[public:rem4:rem4-16:Submitting to conferences and journals]] | [[public:rem4:rem4-16:P8|P8. Review a peer's Abstract]] | IN-CLASS \\ | ====OCTOBER==== ^Date^Time^Who^Topic^Reading Material^Assignment^Due^ | Mon 03.10.2016 | 14:00 - 15:40 | KRTh | Experimental Design | [[public:rem4:rem4-15:Experimental Designs II]] | [[public:rem4:rem4-16:P9. Contribution, Results|P9. Contribution & Results]] (5%) | Oct13@noon | | Fri 07.10.2016 | 10:20 - 11:55 | JB | Graphing and data presentation | [[public:rem4:rem4-16:Visualization]] \\ RM:Chs.15 (ProcData), 16 (DsplData) \\ VDQI | | | ^W9 OCT^^^^^^^ | Mon 10.10.2016 | 14:00 - 15:40 | JM | Stats: T-test, linear models & beyond | [[public:rem4:rem4-15:T-Tests and Linear Models]] | | | | Fri 14.10.2016 | 10:20 - 11:55 | KRTh | Writing Papers: Conclusions & Future Work | [[public:rem4:rem4-15:Conclusions & Future Work]] \\ Review:P9 | [[public:rem4:rem4-16:P10. Conclusions]] (5%) \\ [[public:rem4:rem4-16:P11. Full Paper v. 1.0]] (5%) | 20oct@23:59 \\ \\ 26oct@23:59 | ^W10 OCT^^^^^^^ | Mon 17.10.2016 | 14:00 - 15:40 | JM | Simulation | TBD | | | | Fri 21.10.2016 | 10:20 - 11:55 | KRTh | Science Ethics | [[public:rem4:rem4-16:Science Ethics]] \\ {{rem4:20160919-summary-eng-advisory-ethische-en-juridische-aspecten-van-informaticaonderzoek-web.pdf|Ethical & Legal Aspects of Informatics Research - Dutch Royal Society}} ([[https://www.knaw.nl/en/news/publications/ethical-and-legal-aspects-of-informatics-research|Website]]) \\ [[http://www.iiim.is/2015/08/ethics-policy/|IIIM Ethics Policy]] \\ [[http://www.cs.rice.edu/~vardi/comp601/case1.html|Authors of scientific papers]] - Rice U. \\ RM:Ch13 (EthicsDataColl) | | | ^W11 OCT^^^^^^^ | Mon 24.10.2016 | 14:00 - 15:40 | KRTh | Research Environment: Grants & Authorship \\ Reviewing scientific papers | [[public:rem4:rem4-16:research_grants|Research Grants]] \\ [[public:rem4:rem4-16:Authorship|Paper Author List]] \\ [[public:rem4:rem4-16:Reviewing Scientific Papers]] | [[public:rem4:rem4-16:P12. Full Paper Review]] | in-class oct28@noon | | Fri 28.10.2016 | 10:20 - 11:55 | KRTh | Reviewing your fellow student's full paper | In-class review of a fellow student's paper. | [[public:rem4:rem4-16:P13. Final full paper | P13. Final full paper v. 2.0]] (15%) | 7Nov@noon | ^W12 OCT/NOV^^^^^^^ | Mon 31.10.2016 | 14:00 - 15:40 | KRTh | Presenting Your Work | [[public:rem4:rem4-16:Doing Presentations]] | [[public:rem4:rem4-16:P14. Presenting Your Work]] | Nov 2, IN-CLASS | ====NOVEMBER==== ^Date^Time^Who^Topic^Reading Material^Assignment^Due^ | Fri 04.11.2015 | 10:20 - 11:55 | KRTh | Student Presentations | | | | ^W13 NOV^^^^^^^ | Mon 07.11.2015 | 14:00 - 15:40 | KRTh | Student Presentations | | | | ^^^^^^^^ | | | | | | | |