2012 Assurance of Learning Report - Kennesaw State University

F11 RESEARCH METHODS POSTTEST QUESTION BY QUESTION RESULTS
Correct answers highlighted
Percentages for methods sections first, Ns for questions ranged from 161 to 168
Percentages for experimental section next, in parentheses, Ns for all individual questions = 24
Percentages rounded to total 100%
Note: Results start with Q5 because preliminary questions included identifying information (e.g., name, section).
F11 Research methods posttest: Scientific method questions
5. Stanley has been chased by a dog twice in his life. Based on these two episodes, Stanley has concluded that, in general,
dogs are aggressive towards people. Stanley’s conclusion is not a scientific one because _____.
0% ( 0%) a. it is common knowledge that dogs are aggressive
4% ( 4%) b. Stanley has not compared the number of dogs that have chased him versus the number
of dogs that have not chased him
10% ( 4%) c. Stanley’s experiences with dogs may not be representative of other people’s experiences
with dogs
86% ( 92%) d. His conclusion is not scientific because of both (b) and (c)
6. To determine if people arriving at the library alone would be more likely o hold the door open for a person coming in
immediately after them than would people who arrived in pairs, researchers watched people entering the library from a
window of a nearby building. This investigation best
illustrates _____.
0% ( 0%) a. a case study
99% (100%) b. naturalistic observation
1% ( 0%) c. archival research
0% ( 0%) d. a longitudinal design
7. A research study indicated that men who were married for a longer period of time were more likely to be bald than men who
were married for a shorter period of time. This type of result best illustrates that _____.
3% ( 0%) a. people responding to surveys might not always provide accurate answers
1% ( 0%) b. experimental research is more practical than correlational research
10% ( 8%) c. random sampling is necessary to equalize differences between groups
86% (92%) d. correlational research enables prediction but does not indicate causation
8. Suppose Nathan wanted to study the effect of stress on performance during public speaking. He designed an experiment in
which all speeches would be made on a similar topic, in the same room, at a similar time of day, and to a similar
audience. Which of the following best illustrates a possible operational definition for his independent variable?
36% (21%) a. whether or not the speech was "just for practice" or for 20% of a course grade
42% (71%) b. the number of three-second pauses and "uuhhs" that participants made during a speech
12% ( 0%) c. a small auditorium with comfortable seats and good lighting
10% ( 8%) d. how the audience ranked the clarity of speeches
9. A researcher studying sensory processes asks participants to press the space bar as quickly as possible after a dot is
flashed on the computer screen. The dot flashed is either green, blue, or yellow. Each participant completes 60 trials in a
15 minute time period, with a 2-minute rest period after 30 trials. The computer records how quickly the participants press
the space bar. What is the dependent variable in this experiment?
5% ( 0%) a. the number of trials
4% ( 4%) b. the length of the rest period
79% (88%) c. the time it takes to press the space bar
12% ( 8%) d. the color of the dot
10. To evaluate the influence of caffeine on memory, Dr. Christopher recruited 100 participants and scheduled an experiment
at 6:00 p.m. The first 50 students who showed up drank a non-caffeinated (placebo) drink ("No Caffeine" group) and then
completed a memory task. The next 50 students who showed up drank a highly-caffeinated drink (“Caffeine” group) and
completed the same memory task. An appropriate statistical analysis revealed that memory was significantly poorer in
the Caffeine group. Can Dr. Christopher confidently conclude that caffeine impairs (hurts) memory?
30% (17%) a. Yes. There was a manipulated IV and a measurable DV, and the experiment was
conducted in a laboratory.
16% ( 0%) b. Yes. Statistical analysis indicated that memory was poorer in the Caffeine group.
52% (79%) c. No. Random assignment to groups was not used, so the groups may not have been
equivalent prior to the experiment.
2% ( 4%) d. No. Personal experience suggests that caffeine helps rather than hurts memory because
it makes people more alert.
22