21.09.2015 Views

Curbstoning and beyond Confronting data fabrication in survey research

sji-31-sji917

sji-31-sji917

SHOW MORE
SHOW LESS
  • No tags were found...

Create successful ePaper yourself

Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.

422 S. Koczela et al. / <strong>Curbston<strong>in</strong>g</strong> <strong>and</strong> <strong>beyond</strong>: <strong>Confront<strong>in</strong>g</strong> <strong>data</strong> <strong>fabrication</strong> <strong>in</strong> <strong>survey</strong> <strong>research</strong><br />

promise <strong>in</strong>terviewer morale [11], <strong>in</strong>creas<strong>in</strong>g the risk of<br />

<strong>fabrication</strong>. Each of these factors bears further exploration,<br />

as do methods to reduce or elim<strong>in</strong>ate the risks<br />

<strong>in</strong>troduced by each one.<br />

Apply<strong>in</strong>g a comb<strong>in</strong>ation of methods will help <strong>in</strong>crease<br />

the effectiveness of methods to counter <strong>fabrication</strong>.<br />

Nobody wants to focus on <strong>survey</strong> <strong>data</strong> <strong>fabrication</strong>.<br />

It is an expensive distraction from our ma<strong>in</strong> purpose of<br />

us<strong>in</strong>g <strong>survey</strong> <strong>research</strong> as a tool of <strong>in</strong>quiry. But as Crespi<br />

notes, to earn the perception (<strong>and</strong> reality) of reliability,<br />

<strong>survey</strong> <strong>research</strong>ers must work for it.<br />

References<br />

[1] AAPOR, 2003. Interviewer Falsification <strong>in</strong> Survey Research:<br />

Current Best Methods for Prevention, Detection <strong>and</strong> Repair of<br />

Its Effects. Accessed April 20, 2015 from https://www.aapor.<br />

org/AAPORKentico/AAPOR_Ma<strong>in</strong>/media/Ma<strong>in</strong>SiteFiles/<br />

falsification.pdf.<br />

[2] AAPOR, 2005. Summary of “Falsification Summit II”.<br />

Accessed April 21, 2015 from http://www.aapor.org/AAPOR<br />

Kentico/Education-Resources/Reports/Report-to-AAPOR-<br />

St<strong>and</strong>ards-Comm-on-Interviewer-Fals.aspx.<br />

[3] N. Bates, J. Dahlhamer, P. Phipps, A. Safir <strong>and</strong> L. Tan, Assess<strong>in</strong>g<br />

Contact History Para<strong>data</strong> Quality Across Several Federal<br />

Surveys. Proceed<strong>in</strong>gs of the Jo<strong>in</strong>t Statistical Meet<strong>in</strong>gs, 2010.<br />

[4] P.P. Biemer <strong>and</strong> L.E. Lyberg, Introduction to Survey Quality.<br />

Wiley <strong>and</strong> Sons, Hoboken NJ, 2003.<br />

[5] R.J. Bolton <strong>and</strong> D.J. H<strong>and</strong>, Statistical Fraud Detection: A Review,<br />

Statistical Science 17(3) (2002), 235–255.<br />

[6] S. Bredl, P. W<strong>in</strong>ker <strong>and</strong> K. Kotchau, A Statistical Approach<br />

to Detect Interviewer Falsification of Survey Data, Survey<br />

Methodology 38(1) (2012), 1–10.<br />

[7] L.P. Crespi, The cheater problem <strong>in</strong> poll<strong>in</strong>g, Public Op<strong>in</strong>ion<br />

Quarterly 9(4) (1945), 431–445.<br />

[8] A.N. Dajani <strong>and</strong> R.J. Marquette, Falsification Detection <strong>and</strong><br />

Prevention at Census: New Initiatives, Paper presented at<br />

“Curb-ston<strong>in</strong>g Part III” conference, Wash<strong>in</strong>gton Statistical<br />

Society, Wash<strong>in</strong>gton, DC, 2015.<br />

[9] S. De Haas <strong>and</strong> P. W<strong>in</strong>ker, Identification of partial falsifications<br />

<strong>in</strong> <strong>survey</strong> <strong>data</strong>, Statistical Journal of the IAOS 30(3)<br />

(2014), 271–281.<br />

[10] W.D. Dem<strong>in</strong>g, Out of the Crisis. MIT Press, 1982.<br />

[11] R. Far<strong>and</strong>a, The Cheater Problem Revisited: Lessons from<br />

Six Decades of State Department Poll<strong>in</strong>g. Paper presented<br />

at “New Frontiers <strong>in</strong> Prevent<strong>in</strong>g, Detect<strong>in</strong>g, <strong>and</strong> Remediat<strong>in</strong>g<br />

Fabrication <strong>in</strong> Survey Research” conference, NEAAPOR,<br />

Cambridge, MA, 2015.<br />

[12] A. Kennickel, <strong>Curbston<strong>in</strong>g</strong> <strong>and</strong> Culture, Statistical Journal of<br />

the IAOS 31(2) (2015).<br />

[13] S. Koczela, Discussion of identification of partial falsification<br />

<strong>in</strong> <strong>survey</strong> <strong>data</strong>, Statistical Journal of the IAOS 30(3) (2014).<br />

[14] P.J. Lavrakas, Encyclopedia of Survey Research Methods (2<br />

volumes). SAGE, 2008.<br />

[15] M. Robb<strong>in</strong>s, Prevent<strong>in</strong>g Data Falsification <strong>in</strong> Survey Research:<br />

Lessons from the Arab Barometer. Paper presented<br />

at “New Frontiers <strong>in</strong> Prevent<strong>in</strong>g, Detect<strong>in</strong>g, <strong>and</strong> Remediat<strong>in</strong>g<br />

Fabrication <strong>in</strong> Survey Research” conference. NEAAPOR,<br />

Cambridge, MA, 2015.<br />

[16] R. Ryan <strong>and</strong> E. Deci, Intr<strong>in</strong>sic <strong>and</strong> Extr<strong>in</strong>sic Motivations:<br />

Classic Def<strong>in</strong>itions <strong>and</strong> New Directions, Contemporary Educational<br />

Psychology 25(1) (2000).<br />

[17] S. Joerg-Peter <strong>and</strong> G. Wagner, Identification, Characteristics<br />

<strong>and</strong> Impact of Faked Interviews <strong>in</strong> Surveys, Forschungs<strong>in</strong>stitut<br />

zur Zukunft der Arb, IZA Discussion Paper No. 969, 2003.<br />

[18] S. Skwara, Statistical Sampl<strong>in</strong>g <strong>in</strong> Health Care Fraud Litigation,<br />

BCBSA National Internal Audit <strong>and</strong> Anti-Fraud Conference,<br />

Epste<strong>in</strong>, Becker, <strong>and</strong> Green, 2008.<br />

[19] R. Thissen, Systems <strong>and</strong> Processes for Assur<strong>in</strong>g Data Quality.<br />

Paper presented at “New Frontiers <strong>in</strong> Prevent<strong>in</strong>g, Detect<strong>in</strong>g,<br />

<strong>and</strong> Remediat<strong>in</strong>g Fabrication <strong>in</strong> Survey Research” conference,<br />

NEAAPOR, Boston MA, 2015.<br />

[20] R. Tourangeau, L.J. Rips <strong>and</strong> K. Ras<strong>in</strong>ski, The Psychology of<br />

Survey Response, Cambridge University Press, Cambridge,<br />

U.K., 2000.<br />

[21] P. W<strong>in</strong>ker, N. Menold <strong>and</strong> R. Porst, eds, Interviewers’ Deviations<br />

<strong>in</strong> Surveys: Impact, Reasons, Detection <strong>and</strong> Prevention,<br />

Peter Lang International Academic Publishers, Pieterlen,<br />

Switzerl<strong>and</strong>, 2013.

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!