Effect of recall interval on decay in working memory

Experimental Design

Tutorial Navigation

Getting StartedGeneral Instructions | Introduction to Your Study | Experimental Design | Stating a Hypothesis
Descriptive StatisticsHistograms | Central Tendency | Standard Deviation | Confidence Intervals
Comparing Two SamplesSamples and Populations | Choosing a T-Test | Paired T-Test | P-Values and T-Tables
Important ConceptsThe Normal Distribution | Z Scores | Probability Distributions
LevelsYou are currently on Experimental Design at level 2. Level 1 | Level 2 | Level 3
Next Topic Introduction to Your Study | Stating a Hypothesis

Explanation

Choosing Your Experimental Design
Before you start an experiment, it is a good idea to put some thought into which type of experimental design you will use. Both have advantages and disadvantages and sometimes you are forced to choose one over the other. Here are the usual scenarios in which the choice of experimental design is easy:
  • When the dependent variable cannot be manipulated, you probably need an independent design
    A good example of this point would be an experiment that compares males with females. You cannot test the same people under each condition (male and female) as you cannot change their gender, so unless you are pairing them in some other way (twins, for example) you must compare one group of males with a group of different females.
  • When you cannot repeat a measurement on the same experimental unit, you probably need an independent design
    When using a paired design, you often test (or measure) the same experimental units twice. If the first test is likely to have an effect on the second test or if the unit can be tested only once, then the second, repeated test is not possible. Crash testing cars would fall into this category as you cannot crash test the very same car under two different conditions - the first crash rules out the second test!
  • If you need to test the same experimental unit under different conditions, you need a paired design
There are some other considerations when choosing an experimental design. The main ones are:
  • It is easier to control for confounding variables with a paired design. Anything other than the independent variable that might affect your measurements is referred to as a confounding variable. There is always a risk that an experiment might produce a difference that is due to something other than the independent variable. For example, if you wanted to compare the heights of males and females but you chose one group from a basketball team and the other from a group of jockeys, you might find a difference, but would it be due to gender? By measuring the same subjects twice, you reduce the risk of introducing confounding variables.
  • If subjects are hard to find, then testing the same ones twice obviously doubles the quantity of data you can collect. It has the disadvantage of requiring each subject to return to produce the second sample, which can increase the risk of you having to throw away any data from the first sample that does not have a paired value in the second.
  • There may be ethical issues which either prevent you from manipulating the independent variable or dictate that subjects must be tested under both conditions.
  • If you are testing people, you may find that giving them the same test twice under different conditions allows them to practice the task in the first condition, which naturally produces an improvement in the second condition. Similarly, subjects might grow bored of the task and show fatigue effects when asked to perform it under the second condition.

Here are the advantages and disadvantages of each type of experimental design:
Within SubjectsBetween Subjects
Advantages
  • Fewer subjects are needed as each subject is tested twice;
  • You have more control over confounding variables.
  • There is less risk of practice or fatigue effects;
  • There is less risk of data loss due to drop-out as subjects are only measured once.
Disdvantages
  • Subjects may drop out, not completing the second condition and so rendering the data from their first condition unusable;
  • Subjects can suffer from practice or fatigue effects when tested twice.
  • Twice as many subjects are required;
  • You have less control over confounding variables.

Exploration

Here are some scenarios for you to make a decision on. Which experimental design would you choose?
You give a memory test to a group of people, then give them coffee and test them again.
What type of design do you have?
  Help
Which of these is a disadvantage of the design for the experiment above?   Help
If you wanted to test for differences between males and females, which design would you use?   Help
You sow one set of seeds in clay soil and another set of seeds in sandy soil to compare their growth rates. What type of design do you have?   Help

Application

You have a paired experimental design.
Are these data from the same subjects measured twice or from two sets of different subjects?   Help
Is the risk of confounding variables affecting the results greater or less for your experimental design?   Help
You have 20 measurements for each condition. How many different subjects were measured?   Help
How many times was each subject measured?   Help
Introduction to Your Study | Stating a Hypothesis