| Next revision | Previous revision |
| public:notes_on_research_methodology_spring_2009 [2009/02/23 11:09] – created thorisson | public:notes_on_research_methodology_spring_2009 [2024/04/29 13:33] (current) – external edit 127.0.0.1 |
|---|
| ====== Notes On Research Methodology, spring 2009 ====== | ====== Notes On Research Methodology, spring 2009 ====== |
| |
| ===Concepts=== | ====Concepts==== |
| | Theory (isl. kenning) | "A set of statements or principles devised to explain a group of facts or phenomena, especially one that has been repeatedly tested or is widely accepted and can be used to make predictions about natural phenomena." [[http://dictionary.reference.com/search?q=theory|REF]] \\ A theory is a relatively big explanation, covering several phenomena, often through a single principle, or a set of simple principles. | | | Theory (isl. kenning) | "A set of statements or principles devised to explain a group of facts or phenomena, especially one that has been repeatedly tested or is widely accepted and can be used to make predictions about natural phenomena." [[http://dictionary.reference.com/search?q=theory|REF]] \\ A theory is a relatively big explanation, covering several phenomena, often through a single principle, or a set of simple principles. | |
| | Hypothesis (isl. tilgáta) | Is a prediction about the relationship between a limited set of phenomena, as explained by a particular theory | | | Hypothesis (isl. tilgáta) | Is a prediction about the relationship between a limited set of phenomena, as explained by a particular theory | |
| | Data | Typically "raw numbers" -- only contain low-level semantics | | |
| | Information | Processed and prepared data | | |
| | Experimental design | "A planned interference in the natural order of events." | | | Experimental design | "A planned interference in the natural order of events." | |
| | Subject(s) | Means the subject under study, which can be people, technology and natural phenomena | | |
| | Sample: Subject selection from a "population" A representative subset, drawn from a population, of the phenomenon we are studying. | Typically you can't study all the individuals of a particular subject pool, so in your experiment you use a sample and hope that the results generalize to the rest of the subjects. \\ Examples: \\ a. Siggi, Maggi and Biggi representing human males. \\ b. 10 lakes representing all freshwater on the Earth's surface. \\ c. rust on bottom of doors representing the overall state of an automobile. \\ A sample should be randomly chosen to (1) minimize spurious correlations and thus (2) maximize the generalizability of the results of measuring only a small subset of the phenomenon. | | |
| | Quasi-Experimental | When conditions do not permit an ideal design to be used and a controlled experiement is impossible, there are other techniques that can be used. These are called quasi-experimental designs. | | | Quasi-Experimental | When conditions do not permit an ideal design to be used and a controlled experiement is impossible, there are other techniques that can be used. These are called quasi-experimental designs. | |
| | Statistics | Mathematical methods for dealing with uncertainty. | | |
| | Dependent variable(s) | These are "the things we want to measure", e.g. the speedup seen with the new word processor. \\ Values are measured during and/or after the experiment. | | | Dependent variable(s) | These are "the things we want to measure", e.g. the speedup seen with the new word processor. \\ Values are measured during and/or after the experiment. | |
| | Independent variables | These are factors that need to be controlled for the results to be more intelligible. Example: If we want to study the efficiency speedup seen by a new multi-cultural word processor we would want to have all or some of the cultures represented when we do the study. \\ We select their **values** - the values are known when we start an experiment. \\ Any independent variable must have at least 2 levels (values), so its effect can be evaluated.| | | Independent variables | These are factors that need to be controlled for the results to be more intelligible. Example: If we want to study the efficiency speedup seen by a new multi-cultural word processor we would want to have all or some of the cultures represented when we do the study. \\ We select their **values** - the values are known when we start an experiment. \\ Any independent variable must have at least 2 levels (values), so its effect can be evaluated.| |
| | | Subject(s) | Means the subject under study, which can be people, technology and natural phenomena | |
| | | Sample: Subject selection from a "population" A representative subset, drawn from a population, of the phenomenon we are studying. | Typically you can't study all the individuals of a particular subject pool, so in your experiment you use a sample and hope that the results generalize to the rest of the subjects. \\ Examples: \\ a. Siggi, Maggi and Biggi representing human males. \\ b. 10 lakes representing all freshwater on the Earth's surface. \\ c. rust on bottom of doors representing the overall state of an automobile. \\ A sample should be randomly chosen to (1) minimize spurious correlations and thus (2) maximize the generalizability of the results of measuring only a small subset of the phenomenon. | |
| | | Data | Typically "raw numbers" -- only contain low-level semantics | |
| | | Information | Processed and prepared data | |
| | | Statistics | Mathematical methods for dealing with uncertainty. | |
| |
| \\ | \\ |
| \\ | \\ |
| |
| ===Controled Experiment=== | ====Controled Experiment==== |
| | What it is | A fairly recent research method, historically speaking, for testing hypotheses / theories | | | What it is | A fairly recent research method, historically speaking, for testing hypotheses / theories | |
| | When to use | When it is possible to control and select everything of importance to the subject of study | | | When to use | When it is possible to control and select everything of importance to the subject of study | |
| |
| |
| ===Correlational Studies & Quasi-Experimental Design=== | ====Correlational Studies & Quasi-Experimental Design==== |
| | Correlation | Some factors/variables co-vary when changes in one variable are related with changes in the other, negative or positive | | | Correlation | Some factors/variables co-vary when changes in one variable are related with changes in the other, negative or positive | |
| | Correlation: Powerful tool | Any variables in the world can be measured for correlation. Only two variables are needed (independent and dependent) for doing correlation studies | | | Correlation: Powerful tool | Any variables in the world can be measured for correlation. Only two variables are needed (independent and dependent) for doing correlation studies | |
| \\ | \\ |
| \\ | \\ |
| | ====Field Studies==== |
| ===Field Studies=== | |
| | What is it? | Quasi-experimental design. To study a phenomeon "in the wild". | | | What is it? | Quasi-experimental design. To study a phenomeon "in the wild". | |
| | When | When a controlled experimental setup is out of the question. | | | When | When a controlled experimental setup is not possible. | |
| | Examples | Example hypothesis: "The popularity of Nokia phones has to do with the quality of their user interface." | | | Examples | Example hypothesis: "The popularity of Nokia phones has to do with the quality of their user interface." | |
| | How | Try to approximate a true experimental design as possible, by randomizing where possible, and by controlling the independent variables, if possible. Make the best attempt possible at analyzing potential alternative variables related to the dependent variable to be measured. | | | How | Try to approximate a true experimental design as possible, by randomizing where possible, and by controlling the independent variables, if possible. Make the best attempt possible at analyzing potential alternative variables related to the dependent variable to be measured. | |
| \\ | \\ |
| |
| ===Pilots=== | ====Pilots==== |
| | What is it? | A more loose, pre-study using the intended experimental design to tune it \\ A pre-study intended to gauge the nature, scales or other factors of the variables to be measured, or the subject to be measured | | | What is it? | A more loose, pre-study using the intended experimental design to tune it \\ A pre-study intended to gauge the nature, scales or other factors of the variables to be measured, or the subject to be measured | |
| | Why and when | Pilots are much more useful than you might think. Yes, it will increase the duration and effort of your experiment BUT: It can significantly improve the quality of the subsequent experiment in many cases. It will certainly clarify and sharpen the experimenter's understanding of one or more of: the experiment, experimental procedure, variables and subjects. | | | Why and when | Pilots are much more useful than you might think. Yes, it will increase the duration and effort of your experiment BUT: It can significantly improve the quality of the subsequent experiment in many cases. It will certainly clarify and sharpen the experimenter's understanding of one or more of: the experiment, experimental procedure, variables and subjects. | |
| \\ | \\ |
| EOF | EOF |
| |
| |
| |
