Curbstoning and beyond Confronting data fabrication in survey research
sji-31-sji917
sji-31-sji917
- No tags were found...
Create successful ePaper yourself
Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.
422 S. Koczela et al. / <strong>Curbston<strong>in</strong>g</strong> <strong>and</strong> <strong>beyond</strong>: <strong>Confront<strong>in</strong>g</strong> <strong>data</strong> <strong>fabrication</strong> <strong>in</strong> <strong>survey</strong> <strong>research</strong><br />
promise <strong>in</strong>terviewer morale [11], <strong>in</strong>creas<strong>in</strong>g the risk of<br />
<strong>fabrication</strong>. Each of these factors bears further exploration,<br />
as do methods to reduce or elim<strong>in</strong>ate the risks<br />
<strong>in</strong>troduced by each one.<br />
Apply<strong>in</strong>g a comb<strong>in</strong>ation of methods will help <strong>in</strong>crease<br />
the effectiveness of methods to counter <strong>fabrication</strong>.<br />
Nobody wants to focus on <strong>survey</strong> <strong>data</strong> <strong>fabrication</strong>.<br />
It is an expensive distraction from our ma<strong>in</strong> purpose of<br />
us<strong>in</strong>g <strong>survey</strong> <strong>research</strong> as a tool of <strong>in</strong>quiry. But as Crespi<br />
notes, to earn the perception (<strong>and</strong> reality) of reliability,<br />
<strong>survey</strong> <strong>research</strong>ers must work for it.<br />
References<br />
[1] AAPOR, 2003. Interviewer Falsification <strong>in</strong> Survey Research:<br />
Current Best Methods for Prevention, Detection <strong>and</strong> Repair of<br />
Its Effects. Accessed April 20, 2015 from https://www.aapor.<br />
org/AAPORKentico/AAPOR_Ma<strong>in</strong>/media/Ma<strong>in</strong>SiteFiles/<br />
falsification.pdf.<br />
[2] AAPOR, 2005. Summary of “Falsification Summit II”.<br />
Accessed April 21, 2015 from http://www.aapor.org/AAPOR<br />
Kentico/Education-Resources/Reports/Report-to-AAPOR-<br />
St<strong>and</strong>ards-Comm-on-Interviewer-Fals.aspx.<br />
[3] N. Bates, J. Dahlhamer, P. Phipps, A. Safir <strong>and</strong> L. Tan, Assess<strong>in</strong>g<br />
Contact History Para<strong>data</strong> Quality Across Several Federal<br />
Surveys. Proceed<strong>in</strong>gs of the Jo<strong>in</strong>t Statistical Meet<strong>in</strong>gs, 2010.<br />
[4] P.P. Biemer <strong>and</strong> L.E. Lyberg, Introduction to Survey Quality.<br />
Wiley <strong>and</strong> Sons, Hoboken NJ, 2003.<br />
[5] R.J. Bolton <strong>and</strong> D.J. H<strong>and</strong>, Statistical Fraud Detection: A Review,<br />
Statistical Science 17(3) (2002), 235–255.<br />
[6] S. Bredl, P. W<strong>in</strong>ker <strong>and</strong> K. Kotchau, A Statistical Approach<br />
to Detect Interviewer Falsification of Survey Data, Survey<br />
Methodology 38(1) (2012), 1–10.<br />
[7] L.P. Crespi, The cheater problem <strong>in</strong> poll<strong>in</strong>g, Public Op<strong>in</strong>ion<br />
Quarterly 9(4) (1945), 431–445.<br />
[8] A.N. Dajani <strong>and</strong> R.J. Marquette, Falsification Detection <strong>and</strong><br />
Prevention at Census: New Initiatives, Paper presented at<br />
“Curb-ston<strong>in</strong>g Part III” conference, Wash<strong>in</strong>gton Statistical<br />
Society, Wash<strong>in</strong>gton, DC, 2015.<br />
[9] S. De Haas <strong>and</strong> P. W<strong>in</strong>ker, Identification of partial falsifications<br />
<strong>in</strong> <strong>survey</strong> <strong>data</strong>, Statistical Journal of the IAOS 30(3)<br />
(2014), 271–281.<br />
[10] W.D. Dem<strong>in</strong>g, Out of the Crisis. MIT Press, 1982.<br />
[11] R. Far<strong>and</strong>a, The Cheater Problem Revisited: Lessons from<br />
Six Decades of State Department Poll<strong>in</strong>g. Paper presented<br />
at “New Frontiers <strong>in</strong> Prevent<strong>in</strong>g, Detect<strong>in</strong>g, <strong>and</strong> Remediat<strong>in</strong>g<br />
Fabrication <strong>in</strong> Survey Research” conference, NEAAPOR,<br />
Cambridge, MA, 2015.<br />
[12] A. Kennickel, <strong>Curbston<strong>in</strong>g</strong> <strong>and</strong> Culture, Statistical Journal of<br />
the IAOS 31(2) (2015).<br />
[13] S. Koczela, Discussion of identification of partial falsification<br />
<strong>in</strong> <strong>survey</strong> <strong>data</strong>, Statistical Journal of the IAOS 30(3) (2014).<br />
[14] P.J. Lavrakas, Encyclopedia of Survey Research Methods (2<br />
volumes). SAGE, 2008.<br />
[15] M. Robb<strong>in</strong>s, Prevent<strong>in</strong>g Data Falsification <strong>in</strong> Survey Research:<br />
Lessons from the Arab Barometer. Paper presented<br />
at “New Frontiers <strong>in</strong> Prevent<strong>in</strong>g, Detect<strong>in</strong>g, <strong>and</strong> Remediat<strong>in</strong>g<br />
Fabrication <strong>in</strong> Survey Research” conference. NEAAPOR,<br />
Cambridge, MA, 2015.<br />
[16] R. Ryan <strong>and</strong> E. Deci, Intr<strong>in</strong>sic <strong>and</strong> Extr<strong>in</strong>sic Motivations:<br />
Classic Def<strong>in</strong>itions <strong>and</strong> New Directions, Contemporary Educational<br />
Psychology 25(1) (2000).<br />
[17] S. Joerg-Peter <strong>and</strong> G. Wagner, Identification, Characteristics<br />
<strong>and</strong> Impact of Faked Interviews <strong>in</strong> Surveys, Forschungs<strong>in</strong>stitut<br />
zur Zukunft der Arb, IZA Discussion Paper No. 969, 2003.<br />
[18] S. Skwara, Statistical Sampl<strong>in</strong>g <strong>in</strong> Health Care Fraud Litigation,<br />
BCBSA National Internal Audit <strong>and</strong> Anti-Fraud Conference,<br />
Epste<strong>in</strong>, Becker, <strong>and</strong> Green, 2008.<br />
[19] R. Thissen, Systems <strong>and</strong> Processes for Assur<strong>in</strong>g Data Quality.<br />
Paper presented at “New Frontiers <strong>in</strong> Prevent<strong>in</strong>g, Detect<strong>in</strong>g,<br />
<strong>and</strong> Remediat<strong>in</strong>g Fabrication <strong>in</strong> Survey Research” conference,<br />
NEAAPOR, Boston MA, 2015.<br />
[20] R. Tourangeau, L.J. Rips <strong>and</strong> K. Ras<strong>in</strong>ski, The Psychology of<br />
Survey Response, Cambridge University Press, Cambridge,<br />
U.K., 2000.<br />
[21] P. W<strong>in</strong>ker, N. Menold <strong>and</strong> R. Porst, eds, Interviewers’ Deviations<br />
<strong>in</strong> Surveys: Impact, Reasons, Detection <strong>and</strong> Prevention,<br />
Peter Lang International Academic Publishers, Pieterlen,<br />
Switzerl<strong>and</strong>, 2013.