12.01.2015 Views

RESEARCH METHOD COHEN ok

RESEARCH METHOD COHEN ok

RESEARCH METHOD COHEN ok

SHOW MORE
SHOW LESS

Create successful ePaper yourself

Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.

INTERNET-BASED INTERVIEWS 241<br />

‘neutral’, ‘do not want to respond’, ‘neither<br />

agree nor disagree’) could distort the results.<br />

Indeed, the points made in connection with<br />

Internet surveys and questionnaires apply equally<br />

to Internet experiments, and readers are advised<br />

to review these.<br />

Reips (2000b) points out that it is a<br />

misconception to regard an Internet-based<br />

experiment as the same as a laboratory<br />

experiment, as<br />

Internet participants could choose to leave the<br />

experiment at any time<br />

they can conduct the experiment at any time<br />

and in their own settings<br />

they are often conducted with larger samples<br />

than conventional experiments<br />

they rely on technical matters, network<br />

connections, and the computer competence<br />

of the participants<br />

they are more public than most conventional<br />

experiments.<br />

On the other hand, he also cautions against<br />

regarding the Internet-based experiment as completely<br />

different from the laboratory experiment,<br />

as<br />

<br />

<br />

<br />

many laboratory experiments also rely on<br />

computers<br />

fundamental ideas are the same for laboratory<br />

and Internet-based surveys<br />

similar results have been produced by both<br />

means.<br />

Reips (200b) suggests several issues in<br />

conducting Internet-based experiments:<br />

<br />

<br />

<br />

<br />

Consider a web-based software tool to develop<br />

the experimental materials.<br />

Pilot the experiment on different platforms<br />

for clarity of instructions and availability on<br />

different platforms.<br />

Decide the level of sophistication of HMTL<br />

scripting and whether to use HTML or non-<br />

HTML.<br />

Check the experiments for configuration errors<br />

and variance on different computers.<br />

Place the experiment on several web sites and<br />

services.<br />

Run the experiment online and offline to make<br />

comparisons.<br />

Use the ‘warm-up’ and ‘high hurdle’ techniques,<br />

asking filter questions (e.g. about the<br />

seriousness of the participant, their background<br />

and expertise, language skills).<br />

Use dropout to ascertain whether there is<br />

motivational confounding.<br />

Check for obvious naming of files and<br />

conditions (to reduce the possibility of<br />

unwanted access to files).<br />

Consider using passwords and procedures (e.g.<br />

consistency checks) to reduce the possibility of<br />

multiple submissions.<br />

Keep an experimental log of data for any<br />

subsequent analysis and verification of results.<br />

Analyse and report dropout.<br />

Keep the experimental details on the Internet,<br />

to give a positive impression of the experiment.<br />

At the time of writing, the Internet-based<br />

experiment is currently more a child of psychology<br />

than of education. However, given the rise<br />

of evidence-based practice in education, and<br />

the advocacy of randomized controlled trials in<br />

education, this form of experimentation is set to<br />

become more widely used in education.<br />

Details of the development of Internet-based<br />

experimental software can be found at:<br />

http://www.genpsylab.unizch/wextor/<br />

index.html<br />

http://psych.hanover.edu.APS/<br />

exponnet.html<br />

http://www.genpsy.unizch/Ulf.Lab/<br />

webexplist.html.<br />

Internet-based interviews<br />

The opportunity that Internet interviews present<br />

for interviewing respondents is immense. For<br />

example, online interviews which are entirely realtime<br />

and synchronous through chat rooms, can be<br />

anonymous for both parties if so desired, and the<br />

opportunity to contact respondents at mutually<br />

convenient times is enhanced. For example, at the<br />

Chapter 10

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!