24.10.2014 Views

Asking Questions - The Definitive Guide To Questionnaire Design ...

Asking Questions - The Definitive Guide To Questionnaire Design ...

Asking Questions - The Definitive Guide To Questionnaire Design ...

SHOW MORE
SHOW LESS

You also want an ePaper? Increase the reach of your titles

YUMPU automatically turns print PDFs into web optimized ePapers that Google loves.

138 ASKING QUESTIONS<br />

Accounting for Multidimensional Attitudes<br />

Some attitudes are about objects that are multidimensional, and it<br />

is difficult to understand the attitude without taking other alternatives<br />

into consideration. Tax policy might be such a case. By focusing<br />

on a single aspect of tax policy, such as a flat rate, the question<br />

might in fact bias the measurement because opinions about the flat<br />

rate might depend on what it is compared to. Research indicates<br />

that you can get quite different readings on opinion about many<br />

subjects when the questions pose different comparisons. In such<br />

cases you need to ask the question in such a way that respondents<br />

must choose between two alternatives. A good example of this is in<br />

the bipolar example above in which respondents were asked<br />

whether they favor the graduated income tax or a flat tax.<br />

Given the extreme sensitivity of opinion questions to the formulation<br />

of alternatives, you must give careful consideration to the<br />

wording of the alternatives that are offered. Which alternatives are<br />

chosen, of course, depends entirely on the research question being<br />

investigated. Alternatives provide the frame of reference that the<br />

respondents use in expressing their opinions. You will want to be<br />

sure that respondents use the same frame of reference you are using.<br />

<strong>To</strong> ensure that the frame of reference is the same, you should do a<br />

considerable amount of pretesting and examine different ways to<br />

phrase alternatives. Pretest respondents should be asked to indicate<br />

what they understood the alternatives to mean in order to provide<br />

evidence that they are indeed interpreting the questions in the way<br />

you intended. If at all possible, a sufficiently large pretest should be<br />

done with split ballots, so that the effects of the stated alternatives<br />

can be empirically investigated. If large effects are found between<br />

different alternatives, you should continue investigations until you<br />

understand what is producing the effect.<br />

Sometimes what looks like a clear unidimensional concept<br />

turns out to be multidimensional. A dramatic effect of using unipolar<br />

items was found when developing a scale to measure psychological<br />

well-being (Bradburn, 1969). Instead of a series of bipolar

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!