Effectiveness of Reading and Mathematics Software Products ...

More documents

Recommendations

Info

2 'HVSLWH WKH IDLUO\ VL]DEOH QXPEHU RI VWXGLHV DQG JHQHUDOO\ SRVLWLYH ILQGLQJV PHWD DQDO\VWVKDYHQRWHGWKDWPDQ\VWXGLHVFRQWDLQHGZHDNQHVVHVRUGHVLJQIODZV0XUSK\HWDO 3HDUVRQHWDO2IWKHWHFKQRORJ\VWXGLHVUHYLHZHGE\:D[PDQHWDOIRU H[DPSOH KDOI KDG VDPSOH VL]HV RI IHZHU WKDQ VWXGHQWV 0DQ\ VWXGLHV KDG QR FRQWURO JURXSV RU HTXLYDOHQW FRPSDULVRQ JURXSV OHDGLQJ WR TXHVWLRQDEOH YDOLGLW\ IRU FODLPV RI HIIHFWV6WXGLHVZLWKVWURQJHUUHVHDUFKGHVLJQVVKRZHGVPDOOHUHIIHFWV3HDUVRQHWDO 6HYHUDO UHFHQW H[SHULPHQWDO VWXGLHV H[DPLQHG SURGXFW HIIHFWLYHQHVV DQG UHDFKHG GLIIHUHQWFRQFOXVLRQV5RXVHDQGUXHJHUHYDOXDWHGWKHHIIHFWLYHQHVVRI)DVW)RU:RUG DVRIWZDUHDSSOLFDWLRQEDVHGRQDVHWRIH[HUFLVHVWKDWQHXURVFLHQWLVWVKDGIRXQGWRSURGXFH GUDPDWLFUHDGLQJJDLQVIRUVRPHFKLOGUHQ0HU]HQLFKHWDO7DOODOHWDO5RXVH DQGUXHJHUIRXQGDVPDOOSRVLWLYHHIIHFWIRU)DVW)RU:RUGRQDFRPSXWHUEDVHGPHDVXUHRI ODQJXDJHVNLOOVEXWQRHIIHFWRQUHDGLQJDFKLHYHPHQWPHDVXUHGXVLQJDVWDQGDUGL]HGWHVW,Q FRQWUDVWLQJ WKHLU ILQGLQJV ZLWK SUHYLRXVO\ UHSRUWHG ILQGLQJV 5RXVH DQG UXHJHU QRWHG SUREOHPVLQWKHGHVLJQRIDVWXG\E\UHVHDUFKHUVDIILOLDWHGZLWKWKHFRPSDQ\WKDWGLVWULEXWHV )DVW)RU:RUG,QWKDWVWXG\VWXGHQWVZHUHDVVLJQHGUDQGRPO\WRWKHWUHDWPHQWJURXSRUD FRQWUROJURXS0LOOHUHWDOEXWVWXGHQWVZKRGLGQRWFRPSOHWHWKHWUHDWPHQWEDVHG RQ D GHILQLWLRQ RI FRPSOHWLRQ SURYLGHG E\ WKH SURGXFW YHQGRU ZHUH GURSSHG IURP WKH VDPSOHWKHUHE\LQYDOLGDWLQJLWVH[SHULPHQWDOGHVLJQ ,QFRQWUDVWDUDQGRPL]HGILHOGWULDORI$OJHEUD&RJQLWLYH7XWRUUHSRUWHGSRVLWLYHUHVXOWV 0RUJDQ DQG 5LWWHU ,Q WKH VWXG\ HLJKW MXQLRU KLJK WHDFKHUV WDXJKW VRPH RI WKHLU FODVVHVXVLQJWKH&RJQLWLYH7XWRUDQGVRPHXVLQJWKHLUWUDGLWLRQDOWH[WERRN6WXGHQWVLQWKH &RJQLWLYH 7XWRU FODVVHV VFRUHG KLJKHU RQ DQ HQGRIFRXUVH DOJHEUD WHVW GHYHORSHG E\ (GXFDWLRQDO7HVWLQJ6HUYLFHDQGDOVRUHFHLYHGKLJKHUFRXUVHJUDGHV 6LPLODUO\1XQQHU\HWDOIRXQGSRVLWLYHHIIHFWVIRU$FFHOHUDWHG5HDGHUDVRIWZDUH SURGXFWWKDWUHFRPPHQGVUHDGLQJPDWHULDODWDOHYHODSSURSULDWHIRUWKHLQGLYLGXDOVWXGHQW DQGSURYLGHVFRPSXWHUEDVHGTXL]]HVWHVWLQJVWXGHQWFRPSUHKHQVLRQRIWKHUHFRPPHQGHG PDWHULDOV7KHVWXG\UDQGRPO\DVVLJQHGWHDFKHUVIURPQLQHHOHPHQWDU\VFKRROVLQDODUJH XUEDQGLVWULFWWRXVHWKHSURGXFWRUWRDFRQWUROFRQGLWLRQ 7KXV ZKLOH D SUHSRQGHUDQFH RI UHVHDUFK RQ WKH HIIHFWLYHQHVV RI UHDGLQJ DQG PDWK VRIWZDUHVXJJHVWVSRVLWLYHHIIHFWVPDQ\VWXGLHVKDYHEHHQVPDOOPHWKRGRORJLFDOO\IODZHGRU VSRQVRUHG E\ DQ RUJDQL]DWLRQ ZLWK DQ LQWHUHVW LQ WKH RXWFRPH 0RUH UHFHQW VWXGLHV XVLQJ ULJRURXVGHVLJQVKDYH\LHOGHGPL[HGILQGLQJV$JDLQVWWKLVEDFNGURSDODUJHVFDOHVWXG\RI HGXFDWLRQDOWHFKQRORJ\SURGXFWVFDQSURYLGHXVHIXOLQIRUPDWLRQDERXWWKHLUHIIHFWLYHQHVV % 'HVLJQRIWKH1DWLRQDO6WXG\ ,QIDOOWKH86'HSDUWPHQWRI(GXFDWLRQ('EHJDQZRUNLQJZLWK0DWKHPDWLFD 3ROLF\ 5HVHDUFK ,QF 035 DQG LWV SDUWQHUV WR GHVLJQ WKH QDWLRQDO VWXG\ FDOOHG IRU E\ &RQJUHVVH\UHFRPPHQGDWLRQVIURPWKHGHVLJQHIIRUWZHUHWRIRFXVWKHQDWLRQDOVWXG\RQ JUDGHVLQVFKRROVWKDWVHUYHGODUJHSHUFHQWDJHVRIVWXGHQWVLQSRYHUW\WRIRFXVRQWKH UHDGLQJDQGPDWKVXEMHFWDUHDVDQGWRXVHVWDQGDUGL]HGWHVWVFRUHVWRPHDVXUHHIIHFWLYHQHVV $JRGLQLHWDO7KHGHVLJQHIIRUWDOVRUHFRPPHQGHGWKDWDSXEOLFVXEPLVVLRQVSURFHVV ,,QWURGXFWLRQ
3 EH XVHG WR VHOHFW WKH WHFKQRORJ\ SURGXFWV LQFOXGHG LQ WKH HYDOXDWLRQ 7KH VWXG\·V PDLQ IHDWXUHVDUHVXPPDUL]HGLQWKHDFFRPSDQ\LQJER[ 7KH OHJLVODWLRQ FDOOHG IRU WKH VWXG\ WR KDYH ´FRQWURO JURXSV RU FRQWURO FRQGLWLRQVµ ZKLFKFRQVLVWHQWZLWKFXUUHQWSUDFWLFHZDVLQWHUSUHWHGWRPHDQWKDWWKHVWXG\VKRXOGXVHDQ H[SHULPHQWDOGHVLJQ7KHVWXG\XVHGDGHVLJQLQZKLFKWHDFKHUVZKRZHUHQRWXVLQJRQHRI WKHVWXG\·VWHFKQRORJ\SURGXFWVYROXQWHHUHGWRSDUWLFLSDWHLQWKHVWXG\:LWKLQHDFKVFKRRO WKHVHWHDFKHUVZHUHWKHQUDQGRPO\DVVLJQHGWRHLWKHUDWUHDWPHQWJURXSWKDWKDGDFFHVVWR WKHDVVLJQHGSURGXFWRUWRDFRQWUROJURXSWKDWXVHGWKHLUFRQYHQWLRQDOWHDFKLQJDSSURDFKHV 7KH H[SHULPHQWDO GHVLJQ ZDV WKH EDVLV IRU DQVZHULQJ WKH VWXG\·V PDLQ TXHVWLRQ ´'R VWXGHQWVDFKLHYHPRUHZKHQWHDFKHUVDUHDEOHWRXVHWKHVHOHFWHGWHFKQRORJ\SURGXFWVWKDQ ZKHQ WKH\ GR QRW"µ %HFDXVH WKH RQO\ GLIIHUHQFH RQ DYHUDJH EHWZHHQ JURXSV LV ZKHWKHU WHDFKHUV ZHUH DVVLJQHG WR XVH SURGXFWV VHOHFWHG IRU WKH VWXG\ VFRUH GLIIHUHQFHV FRXOG EH DWWULEXWHG DV HIIHFWV RI WKH SURGXFWV DIWHU DFFRXQWLQJ IRU VDPSOLQJ YDULDELOLW\ 6FRUH GLIIHUHQFHV FRXOG EH DIIHFWHG E\ ZKHWKHU FRQWURO JURXS WHDFKHUV XVHG RWKHU WHFKQRORJ\ SURGXFWVWKDWZHUHQRWDPRQJWKRVHVHOHFWHGIRUWKHVWXG\DQLVVXHWKDWZDVUHFRJQL]HGLQ WKHGHVLJQDQGZLOOEHDGGUHVVHGLQWKHDQDO\VLV 7KHVWXG\·VPDLQTXHVWLRQLVHTXLYDOHQWWRWKHTXHVWLRQIDFHGE\VFKRROGLVWULFWVZDQWLQJ WRUDLVHVWXGHQWWHVWVFRUHVDQGFRQVLGHULQJLQYHVWLQJLQDWHFKQRORJ\SURGXFWWRGRVR'RHV SXUFKDVLQJ WKH SURGXFW OHDG WR KLJKHU VFRUHV" 7KH VWXG\ WHVWHG ZKHWKHU VWXGHQWV LQ FODVVURRPVRIWUHDWPHQWJURXSWHDFKHUVZKRZHUHDEOHWRXVHSURGXFWVVHOHFWHGWREHLQWKH VWXG\SHUIRUPHGEHWWHURUZRUVHWKDQVWXGHQWVLQFODVVURRPVRIFRQWUROJURXSWHDFKHUVZKR ZHUH QRW DEOH WR XVH WKRVH SDUWLFXODU SURGXFWV EXW PD\ KDYH XVHG RWKHU SURGXFWV ,Q 6WXG\'HVLJQ ,QWHUYHQWLRQ6L[WHHQSURGXFWVZHUHVHOHFWHGE\('EDVHGRQSXEOLFVXEPLVVLRQVDQGUDWLQJVE\WKHVWXG\ WHDPDQGH[SHUWUHYLHZSDQHOV3URGXFWVZHUHJURXSHGLQWRIRXUDUHDVILUVWJUDGHUHDGLQJIRXUWKJUDGH UHDGLQJVL[WKJUDGHPDWKDQGDOJHEUD 3DUWLFLSDQWV7KLUW\WKUHHGLVWULFWVVFKRROVDQGWHDFKHUVSDUWLFLSDWHGLQWKHVWXG\,QILUVWJUDGH GLVWULFWV VFKRROV DQG WHDFKHUV SDUWLFLSDWHG ,Q IRXUWK JUDGH GLVWULFWV VFKRROV DQG WHDFKHUV SDUWLFLSDWHG ,Q VL[WK JUDGH GLVWULFWV VFKRROV DQG WHDFKHUV YROXQWHHUHG DQG IRU DOJHEUDGLVWULFWVVFKRROVDQGWHDFKHUVSDUWLFLSDWHG'LVWULFWVDQGVFKRROVFRXOGSDUWLFLSDWHLQWKH VWXG\DWPRUHWKDQRQHJUDGHOHYHODQGVRPHGLG'LVWULFWVZHUHUHFUXLWHGRQWKHEDVLVWKDWWKH\GLGQRW DOUHDG\XVHWHFKQRORJ\SURGXFWVWKDWZHUHVLPLODUWRVWXG\SURGXFWVLQSDUWLFLSDWLQJVFKRROV 5HVHDUFK 'HVLJQ :LWKLQ HDFK VFKRRO WHDFKHUV ZHUH UDQGRPO\ DVVLJQHG WR EH DEOH WR XVH WKH VWXG\ SURGXFWWKHWUHDWPHQWJURXSRUQRWWKHFRQWUROJURXS&RQWUROJURXSWHDFKHUVZHUHDEOHWRXVHRWKHU WHFKQRORJ\SURGXFWVWKDWPD\KDYHEHHQLQWKHLUFODVVURRPV7KHVWXG\DGPLQLVWHUHGWHVWVWRVWXGHQWVLQ ERWKW\SHVRIFODVVURRPVQHDUWKHEHJLQQLQJDQGHQGRIWKHVFKRRO\HDU7KHVWXG\DOVRREVHUYHGWUHDWPHQW DQGFRQWUROFODVVURRPVWKUHHWLPHVGXULQJWKHVFKRRO\HDUDQGFROOHFWHGGDWDIURPWHDFKHUTXHVWLRQQDLUHV DQGLQWHUYLHZVVWXGHQWUHFRUGVDQGSURGXFWUHFRUGV 2XWFRPHV$QDO\]HG6WXGHQWWHVWVFRUHVFODVVURRPDFWLYLWLHVDQGUROHVRIWHDFKHUVDQGVWXGHQWV ,,QWURGXFWLRQ
Page 1: (IIHFWLYHQHVVRI5HDGLQJDQG 0DWKHPDWL
Page 4 and 5: U. S. Department of Education 0DUJD
Page 7: &RQWHQWV &KDSWHU 3DJH ([HFXWLYH6
Page 10 and 11: viii ,,, ,,, ,,, ,,, ,9 ,9 ,9 ,9 ,9
Page 13: ([KLELWV ([KLELW ,, 3DJH +RZ3URGX
Page 16 and 17: xiv 6WXG\'HVLJQ ,QWHUYHQWLRQ6L[WHHQ
Page 18 and 19: xvi HIIHFWLYHQHVV RI JURXSV RI SURG
Page 20 and 21: xviii JUDGHUVDQGWKH6$7PDWKEDWWHU\IR
Page 22 and 23: xx YDULRXV VNLOOV 6RIWZDUHEDVHG UHF
Page 24 and 25: xxii Avtˆ…r" @ssrp‡†‚sA‚
Page 26 and 27: xxiv 6XPPDU\ &RQJUHVVSRVHGTXHVWLRQV
Page 30 and 31: 4 DGRSWLQJ WKLV DSSURDFK WKH QDWLRQ
Page 32 and 33: 6 WDUJHW 7KH WHDP HVWLPDWHG WKDW
Page 34 and 35: 8 7DEOH,1XPEHURI6WXG\'LVWULFWV6FKR
Page 36 and 37: 10 :KHWKHU H[FOXGHG WHDFKHUV ZHUH U
Page 38 and 39: 12 IRULQGLYLGXDOVWXGHQWVDQGPHUJHGGD
Page 40 and 41: 14 7DEOH,)HDWXUHVRI7HVWV8VHGLQWKH6W
Page 42 and 43: 16 WKHIXOOVHWRIHVWLPDWHVIURPWKHPDLQ
Page 44 and 45: 18 VXSSRUW RQ XVLQJ SURGXFWV WKH GX
Page 46 and 47: 20 7DEOH,,,QVWUXFWLRQDO)HDWXUHVRI)L
Page 48 and 49: 22 7DEOH,, 7HDFKHU5HSRUWHG8VHRI6WXG
Page 50 and 51: 24 XQGHUDVLQJOHORJLQ+RZHYHUFRUUHODW
Page 52 and 53: 26 3UHYLRXV VWXGLHV KDYH REVHUYHG W
Page 54 and 55: 28 7DEOH,,&KDUDFWHULVWLFVRI7HDFKHUV
Page 56 and 57: 30 VDPHVHWRIYDULDEOHVXVHGIRUWKHVFRU
Page 58 and 59: 32 WKDW VWXGHQWV KDG SUREOHPV DFFHV
Page 60 and 61: 34 ________________________________
Page 63 and 64: &KDSWHU,,, (IIHFWVRI)RXUWK*UDGH5HD
Page 65 and 66: 39 7DEOH,,,,QVWUXFWLRQDO)HDWXUHVRI)
Page 67 and 68: 41 )LJXUH,,, 'LIIHUHQFHLQ$QQXDO7HDF
Page 69 and 70: 43 7DEOH,,,$FWLYLWLHVLQ7UHDWPHQWDQG
Page 71 and 72: 45 ZKHWKHU D FODVVURRP ZDV DVVLJQHG
Page 73 and 74: 47 )LJXUH,,, 6FKRRO/HYHO(IIHFWVE\3U
Page 75: 7DEOH,,,,QWHUDFWLRQV%HWZHHQ0RGHUDWL
Page 78 and 79:
52 0DQ\ LQVWUXFWLRQDO IHDWXUHV RI W
Page 80 and 81:
54 7DEOH,97HDFKHU5HSRUWHG8VHRI6WXG\
Page 82 and 83:
56 0RVWWHDFKHUVSHUFHQWVFKHGXOHGWKHS
Page 84 and 85:
58 7DEOH,9&KDUDFWHULVWLFVRI7HDFKHU
Page 86 and 87:
60 ,9(IIHFWVRI6L[WK*UDGH0DWK6RIWZDU
Page 88 and 89:
& &RQFOXVLRQV 7KLV VWXG\ H[SHULPHQW
Page 90 and 91:
64 7KH SURGXFWV ZHUH UDWHG DV VLPLO
Page 92 and 93:
7DEOH97HDFKHU5HSRUWHG8VHRI6WXG\3URG
Page 94 and 95:
7HDFKHUV YDULHG LQ KRZ WKH\ VFKHGXO
Page 96 and 97:
(IIHFWV:HUH1RW6WDWLVWLFDOO\'LIIHUHQ
Page 98 and 99:
9(IIHFWVRI$OJHEUD6RIWZDUH3URGXFWV
Page 100 and 101:
7DEOH9,QWHUDFWLRQV%HWZHHQ0RGHUDWLQJ
Page 102 and 103:
76 %ODFN3DQG':LOLDP´$VVHVVPHQWDQG&
Page 104 and 105:
78 0H]HUQLFK 00 :0 -HQNLQV 3 -RKQVW
Page 107 and 108:
$SSHQGL[$ 'DWD&ROOHFWLRQ$SSURDFKDQG
Page 109 and 110:
83 % 7HDFKHU6XUYH\ ,Q1RYHPEHUWHDFKH
Page 111 and 112:
85 7DEOH$1XPEHUDQG3HUFHQWRI(OLJLEO
Page 113 and 114:
87 7DEOH$1XPEHURI6WXGHQWV7HVWHG,
Page 115 and 116:
89 IUDPHZRUNXVHGWKHPRGHORILQVWUXFWL
Page 117 and 118:
91 7$%/($D 'HVFULSWLYH6WDWLVWLFVRI
Page 119 and 120:
93 7DEOH$D 'HVFULSWLYH +LVSDQLFVW
Page 121 and 122:
95 7DEOH$E 'HVFULSWLYH 7UHDWPHQW*UR
Page 123 and 124:
97 $SSHQGL[$'DWD&ROOHFWLRQ$SSURD
Page 125:
99 $SSHQGL[$'DWD&ROOHFWLRQ$SSURD
Page 128 and 129:
ZKHUH
Page 130 and 131:
DIWHU DGMXVWLQJ IRU FRYDULDWHV RFFX
Page 132 and 133:
PRGHUDWLQJYDULDEOHVFRXOGEHLQFOXGHGI
Page 134 and 135:
7DEOH%FRQWLQXHG 9DULDEOH1DPH )LUVW
Page 136 and 137:
7KH VHFRQG HVWLPDWRU LV WKH GLIIHUH
Page 138:
7DEOH%&RPSDULVRQRI(IIHFW6L]HV%DVHGR
show all

Effectiveness of Reading and Mathematics Software Products ...

Create successful ePaper yourself

Delete template?

Save as template?