Asking Questions - The Definitive Guide To Questionnaire Design ...

GLOSSARY 361
is most often used to mean any sort of nonprobability sample, such
as a quota sample, a convenience sample, or a haphazard sample.
randomized response A method that ensures respondent anonymity
on questions dealing with socially undesirable or illegal behavior.
The procedure involves asking two questions, one threatening
and the other completely innocuous, both of which have the same
possible answers (for example, “yes” or “no.”) The respondent decides
which question to answer on the basis of a probability mechanism
(such as a box of red and blue beads with a window in which
a single bead appears). Since the interviewer does not know what
question is being answered, the response is completely anonymous,
although some respondents may not believe this. By knowing the
distribution of responses to the innocuous question (such as “Were
you born in April?”) and the probability mechanism, the researcher
can estimate the response to the threatening question.
recall question A question asking about behavior that occurred in
the past. Recall questions are subject to memory error. (See also
memory error.)
records Documents used to reduce memory error on behavior questions.
Examples include bills, checkbook records, canceled checks,
titles and leases, and other financial records. (See also memory error.)
redundancy effect One type of order effect hypothesized to result
from asking related questions in such a way that respondents interpret
them as excluding reference to information given in previously
asked questions.
reliability, reliability checks In the technical sense, as used in psychology
and survey research, the degree to which multiple measures
of the same attitude or behavior agree. These multiple measures
may be used over time or at the same point in time. If repeated
in the same questionnaire, the same item should not be asked in
exactly, or nearly exactly, the same way, since this irritates the
respondent and distorts the estimate of reliability.