Ten Most Wanted Cheaters Presentation PDF - Caveon Test Security

Cheating

Cheating is...Use of any unauthorized assistance in takingexaminations.Notes, Copying, TechnologyThe acquisition, without permission, of tests or otheracademic material belonging to a testing program ormember of school faculty.Piracy

Cheating Statistics10075502501961 1992 1999 2002College (n=4500)High School (n=12000)

ABC News Poll

caveon State Education Survey80% are spending more time on test security77% have formal policies in placebut only 5% of respondents have a separate security budget.50% conduct statistical analysis to detect cheating40% search the Internet for stolen test contentOver 80% have taken formal action against confirmed orsuspected cheating74% view outside, third-party review of their security proceduresas beneficial

Final word“…one conclusion from the trendstudies is clear: All agree that theproportion (of cheaters) is high andnot going down.”Greg Cizek (1999)

the hackerInfiltrates computerssystems to gain access totest questions andanswers and final testscores.

The Hacker“Harvard rejects 119 accused of hacking...”“Nearly half the students in the Indiana U. School ofDentistry’s second-year class... have been disciplined for theirroles in cheating... illegally obtained passwords...”“computer hackers in China forced the world’s leading testdeveloper, New Jersey-based Educational Testing Services(ETS), to scrap its computerized version of the GraduateRecord Examination (GRE) on both sides of the TaiwanStrait after they raided ETS’ database and poached sensitiveinformation”

The smugglerBrings unauthorizedmaterials into the settingwhich enables him tocheat.

NotesPalmForearmFingernailThighSkirtShirtHat BrimPant WaistbandPocketBand-AidPencil CaseCalculator CaseDeskChair

Notes are writtenon a stretchedrubber band. Unstretchednotesaren’t visible.Stretch to viewnotes. Flip toconceal.Rubber Band

Notes are attached tothe wrapper or thewrapper is scannedinto a computer.Ingredients list onwrapper is edited toinclude notes. Wrapperis printed on a colorprinter and re-attachedon food item.Food Wrapper

Notes on a smallpiece of paperinserted into thecasing of a clearpen.Pen

Notes are writtenon a stick of gum.After notes areused the evidencecan be eaten.Gum

The label on awater bottle ispeeled off andnotes are writtenon the inside faceof label. Label isre-applied and isvisible at theproper angle.Water Bottle

Notes are placedin pockets and arevisible duringtests.Pocket

the downloaderDownloads testquestions and answersfrom the Internet.

the downloader2006 ATP - IT Test Security SurveyNearly one-third reported that over 60% of theirexams have been stolenOver half reported that their exams were availablefor sale on the Internet within 3 months ofpublication50% found a 100% matche between the wordingof stolen exams and the actual exams

the time travelerShares test questionswith those taking the testat a later time.

college confidential forum72 Hours of Forum Traffic for Major TestNumber of Posts2001801601401201008060402006/4/05 0:006/4/05 3:006/4/05 6:006/4/05 9:006/4/05 12:006/4/05 15:006/4/05 18:006/4/05 21:006/5/05 0:006/5/05 3:006/5/05 6:006/5/05 9:006/5/05 12:006/5/05 15:006/5/05 18:006/5/05 21:006/6/05 0:006/6/05 3:006/6/05 6:006/6/05 9:006/6/05 12:006/6/05 15:006/6/05 18:006/6/05 21:006/7/05 0:00

illuminating traffic flowsMost forum participants log on right after examNearly 2000 posts regarding exam itemsAverage time spent in test “discussion” is 2 hoursPosts spread virally

the insiderWorks in thedevelopment of testsand shares testinformation to helpcheaters.

Philippines Criminal Authorities Raid Test PreparationCenter Accused of Using Recalled NPTE Test Items(Posted on 1/26/2007)Prior to the raids, agents of the NBI-IPRD conducted acriminal surveillance operation of the test centers, whichconfirmed the unlawful use of the test items. Specifically,SLRC was found to be providing its students withcopies of actual NPTE test items that candidateswho had previously taken the exam recalled bymemory. Armed with this information, the NBI-IPRDapplied for and obtained search warrants…

the coachAdministrator whooffers specific assistanceto students during a test.

the coach“...investigators found suspiciously high scores ineight schools... blaming ‘adult interference,’...”“Teachers... simply helped students answer thequestions.”“a teacher let his eighth-graders use calculators onthe 2006 math test.”“teachers let students consult world maps or helpfulreference sheets as they took their state exams.”

Robin hoodTeacher or otherreviewer that “fixes”responses to clarify whatthe student “really”intended.

forced to be robin hoodAdministrator asks “How is your daughter”Daughter has eating disordersFeeding tubeDoing better“Your benefits. You really need your benefits”“What happens if test scores go down?”“Who would they blame?“What..would happen? You’d lose your job”“Math scores can’t go down

forced to be robin hood“Take a razor, and open up the flap.”“Take the test yourself, develop an answer key”Develop three lists—1) Kids teachers think will pass, 2) Kidsteachers think may/may not pass, and 3) Kids who won’t passTake the Top 50 kids out of first two groupsLook at their answers and compare with your answer key“Most are probably going to pass, so you’re just making sure”

the collaboratorsA group thatcooperates during atest by variousmethods to cheat.

Copying

02021303110112021111150512021213120214040111130311121101110112021314151212020101120203031513Correct (Form 2)ResponseCorrect (Form 1)ResponseStudent 963Student 821the collaborators

extreme student irregularitiesLast NameFirst NameSchool DistrictSchool/Test CenterOverall IndexOverall FlagAberrance IndexAberrance FlagBimodal MixLow ThetaHigh ThetaCollusion IndexCollusion FlagCollusion ClusterErasure IndexErasure FlagWrong-to-RightAny-to-WrongErasuresSmith John 1 A 40.6 1 2.3 0 0.67 -5.7 0.6 41.1 1 372 0.3 0 0 0Johnson Joan 2 B 40.5 1 2.3 0 0.67 -5.7 0.6 41.1 1 372 0.3 0 0 0 1.3 0 320Last first 3 C 29.1 1 1.1 0 0.58 -2.4 0.3 29.6 1 1231 0.8 0 3 4Last first 4 D 28.9 1 1.8 0 0.59 -3.2 1.1 29.4 1 113 5.2 1 8 9Last first 19 B 12.2 1 0.7 0 0.31 1.9 3.9 4.0 0 373 0.8 0 2 0 12.8 1 255Retest IndexVolatile Retest FlagExpected ScoreIdentifies specific examinee “outliers”Example—Chance that “Joan” and “John” worked independently(i.e. did not collude) is1 in 1,000,000,000,000,000,000,000,000,000,000,000,000,000,000

the techieUses a cell phone, PDAor other wireless deviceto get answers during atest.

TechnologyHeadphonesCalculatorDatabank WatchCellphonePDAPDA WirelessiPod Song NamesiPod Audio FilesiPod Text FilesiPod Video FilesPagerBraindump WebsitesInternet ForumseBayTerm Paper WebsitesiPhone (ultimate)

Notes areentered intocalculators thathave memory forstoring notes.Calculator

Calculators

iPodSong names are renamedwith notes or test answersfor viewing on the screen.Text files can be stored.Audio notes can bestored.Video notes can be stored.

Examinee can askquestions and getanswers fromfriend during testvia textmessaging.Text Messaging

Cell Phones

Preventing Cell Phone CheatingHave a clear cell phone cheating policy.Except for the qualified list, no personal belongings are permittedwithin the testing area and all such belongings will be confiscated.Display signs at entrance to test center regarding use of cellphones.Ask candidates to keep hands in plain sight above the table top.Use a cell phone signal detector.

Cell Phone Signal Detectors

the chang gangA group ofindividuals thatmemorizes,collects and sellstest questions.

PiracyRazorDental FlossButtonCamPenCamDocuPenCamera Phone

Examinee takespictures of a testwith a cameraphone and sendspicture to anotherperson who cantext messagecorrect answersback.Camera Phone

Examinee uses asmall wireless“buttoncam”with a wirelessconnection to alaptop to stealtest items.ButtonCam

Small videocamera disguisedas a pen is placedis front pocket.Video signal ispicked up by aremote laptopand test imagesare captured.Pencam

Pen sized personalscanner used tocopy test questions.The DocuPen canstore hundreds ofpages of text intomemory. Data canbe transmitted viaBluetooth cellphone.DocuPen

Caveon ServicesSecurity AuditIn-depth audit of a testing program’s policies andprocedures related to test security.Caveon Web PatrolWeb crawling service focused on the detection of disclosedtest information.Caveon Data ForensicsPatent-pending statistical analysis of test data to identifypatterns indicative of test fraud.

Cheating Prevention1. Have a policy concerning cheating, and advertise it.2. If space permits, arrange students so that there are empty chairs inbetween each student. Assign students seating during the test.3. Instruct students to keep their test papers close to their body andon the surface of the table during the test.4. Walk around and monitor students frequently. Don’t sit still in thefront of the room.5. Do not allow more than one student to go to the bathroom at atime. When the student leaves for the bathroom, collect their test.

Cheating Prevention5. Be aware that students might hide cheat sheets in theirbackpack, in their jacket, on food or drink wrappers, or in apen cap.6. Ban the use of electronic devices during exams. (cell phones,iPods)7. Cheating is reduced when teachers remind students that suchbehavior is wrong and will result in disciplinary action.8. Discipline those who are caught cheating with significantpenalties.

thank youdon.sorensen@caveon.com