Effectiveness of Reading and Mathematics Software Products ...

More documents

Recommendations

Info

4 DGRSWLQJ WKLV DSSURDFK WKH QDWLRQDO VWXG\·V GHVLJQ HVVHQWLDOO\ LV VLPLODU WR WKH GHVLJQV RI PDQ\VWXGLHVRISURGXFWHIIHFWLYHQHVVFLWHGDERYH 7KHVWXG\WHVWVZKHWKHUVHOHFWHGUHDGLQJDQGPDWKHPDWLFVSURGXFWVDUHHIIHFWLYHZKHQ GLVWULFWVYROXQWHHUWRSDUWLFLSDWHDQGVFKRROVDQGWHDFKHUVYROXQWHHUWRLPSOHPHQWSURGXFWV 7KHYROXQWDU\DVSHFWRIWKHVWXG\DQGWKHIDFWWKDWGLVWULFWVDQGVFKRROVZHUHSDUWLFLSDWLQJLQ DVWXG\PD\LQWURGXFHDGLIIHUHQFHEHWZHHQPHDVXUHGHIIHFWLYHQHVVUHSRUWHGE\WKHVWXG\ HIIHFWLYHQHVV LQ DFWXDO XVH DQG HIIHFWLYHQHVV UHSRUWHG E\ RWKHU VWXGLHV )RU H[DPSOH HIIHFWLYHQHVV DV PHDVXUHG E\ WKLV VWXG\ PLJKW EH KLJKHU WKDQ HIIHFWLYHQHVV LQ DFWXDO XVH EHFDXVH VFKRROV DQG WHDFKHUV YROXQWHHUHG IRU WKH VWXG\ DQG WKH VWXG\ DOVR SXUFKDVHG VRIWZDUHDQGKDUGZDUHIRUFODVVURRPVDQGVFKRROVZKHQXSJUDGHVZHUHQHHGHGIRUSURGXFWV WRRSHUDWH,QDFWXDOXVHSURGXFWVPLJKWEHSODFHGLQFODVVURRPVRIWHDFKHUVZKRGRQRW ZDQWWRXVHWKHPDQGPD\QRWXVHWKHPHIIHFWLYHO\ZKLFKSUHVXPDEO\ZRXOGLPSO\ORZHU OHYHOVRIHIIHFWLYHQHVV (IIHFWLYHQHVVDVPHDVXUHGE\WKHVWXG\PLJKWEHORZHUWKDQHIIHFWLYHQHVVUHSRUWHGE\ RWKHU VWXGLHV EHFDXVH SURGXFWV ZHUH LPSOHPHQWHG E\ WHDFKHUV ZKR KDG QRW XVHG WKHVH SURGXFWVEHIRUH$VODWHUFKDSWHUVQRWHVRPHVFKRROVDQGFODVVURRPVHQFRXQWHUHGYDULRXV GLIILFXOWLHV LQ VWDUWLQJ WR XVH RU FRQWLQXLQJ WR XVH SURGXFWV 7HDFKHUV FRXOG VWRS XVLQJ SURGXFWVRUUHGXFHWKHLUXVHLIWHDFKHUVEHOLHYHGSURGXFWVZHUHLQHIIHFWLYHRUGLIILFXOWWRXVH RU WKH\ FRXOG XVH SURGXFWV LQ ZD\V WKDW YHQGRUV PD\ QRW KDYH LQWHQGHG RU SUHGLFWHG 7HDFKHUVLQFRQWUROFODVVURRPVGLGQRWKDYHDFFHVVWRSURGXFWVLQWKHVWXG\EXWFRXOGXVH FRPSXWHUV LQ RWKHU ZD\V VXFK DV IRU ZHE EURZVLQJ IRU RIILFHUHODWHG IXQFWLRQV DQG WR RSHUDWHRWKHUSURGXFWV/DWHUFKDSWHUVDQDO\]HWKHH[WHQWWRZKLFKWKH\GLGVR (IIHFWLYHQHVVDVPHDVXUHGE\WKHVWXG\PLJKWEHORZHUWKDQZKDWKDVEHHQUHSRUWHGE\ RWKHU VWXGLHV EHFDXVH WKLV VWXG\ XVHG DQ H[SHULPHQWDO GHVLJQ %HFDXVH WHDFKHUV ZHUH UDQGRPO\DVVLJQHGDVSDUWRIWKHH[SHULPHQWIDFWRUVWKDWPD\KDYHSUHGLVSRVHGWHDFKHUVWR XVH SURGXFWV PRUH HIIHFWLYHO\ DQG WKDW FRQIRXQG DFWXDO HIIHFWLYHQHVV ZLWK WHDFKHU FKDUDFWHULVWLFVDUHFRQWUROOHGE\WKHH[SHULPHQWDOGHVLJQ 6HOHFWLQJ3URGXFWVIRUWKH(YDOXDWLRQ ,QIDOOGHYHORSHUVDQGYHQGRUVRIHGXFDWLRQDOWHFKQRORJ\SURGXFWVUHVSRQGHGWRD SXEOLFLQYLWDWLRQDQGVXEPLWWHGSURGXFWVIRUSRVVLEOHLQFOXVLRQLQWKHQDWLRQDOVWXG\035 VWDIIVHOHFWHGRIWKHVXEPLVVLRQVIRUIXUWKHUUHYLHZE\WZRSDQHOVRIRXWVLGHH[SHUWV RQHIRUUHDGLQJSURGXFWVDQGRQHIRUPDWKSURGXFWV7KHWKUHHPDLQFULWHULDRIWKHUHYLHZV ZHUHZKHWKHUWKHSURGXFWKDGHYLGHQFHRIHIIHFWLYHQHVVDQGUHODWHGWRWKLVWKHYDOLGLW\RI WKH HYLGHQFH ZKHWKHU WKH SURGXFW ZDV DEOH WR RSHUDWH RQ D QDWLRQDO VFDOH DQG ZKHWKHU SURGXFW GHYHORSHUV FRXOG WUDLQ DQ DGHTXDWH QXPEHU RI WHDFKHUV IRU WKH QDWLRQDO VWXG\·V 1 $QRWKHUSRVVLEOHWHVWRIWHFKQRORJ\·VHIIHFWLYHQHVVZRXOGEHWRLQWURGXFHFRPSXWHUVWKHKDUGZDUHSDUW RIHGXFDWLRQDOWHFKQRORJ\LQFODVVURRPVDQGDVVHVVZKHWKHUWHVWVFRUHVRURWKHUPHDVXUHVRIVWXGHQWOHDUQLQJ LQFUHDVH$QVZHULQJWKLVTXHVWLRQZRXOGKDYHUHTXLUHGIRFXVLQJWKHVWXG\RQWKHVPDOOQXPEHURIVFKRROVDQG FODVVURRPV WKDW KDG QRW \HW LQWURGXFHG FRPSXWHUV ZKLFK ZRXOG UHGXFH WKH VWXG\·V UHOHYDQFH WR WKH PXFK ODUJHUQXPEHURIVFKRROVWKDWDOUHDG\XVHGFRPSXWHUV ,,QWURGXFWLRQ
5 VDPSOH VL]HV 7KH SDQHOV GLG QRW UHYLHZ DQG FRPSDUH WKH LQVWUXFWLRQDO IHDWXUHV RI WKH SURGXFWV 035 LQIRUPHG WKH SDQHO PHPEHUV WKDW WKH\ ZHUH QRW OLPLWHG WR 035·V OLVW RI SURGXFWVEXWFRXOGUHYLHZDQ\RIWKHVXEPLVVLRQV ,Q-DQXDU\('FRQVLGHUHGWKHSDQHO·VUHFRPPHQGDWLRQVDQGVHOHFWHGSURGXFWV IRUWKHVWXG\,QVHOHFWLQJSURGXFWV('JURXSHGWKHPLQWRIRXUDUHDVHDUO\UHDGLQJILUVW JUDGH UHDGLQJ FRPSUHKHQVLRQ IRXUWK JUDGH SUHDOJHEUD VL[WK JUDGH DQG DOJHEUDQLQWKJUDGH 7KHSURGXFWVUDQJHGZLGHO\LQWKHLULQVWUXFWLRQDODSSURDFKHVDQG KRZ ORQJ WKH\ KDG EHHQ LQ XVH ,Q JHQHUDO KRZHYHU WKH FULWHULD ZHLJKWHG WKH VHOHFWLRQ WRZDUG SURGXFWV WKDW KDG HYLGHQFH RI HIIHFWLYHQHVV IURP SUHYLRXV UHVHDUFK RU IRU QHZHU SURGXFWV HYLGHQFH WKDW WKHLU GHVLJQV ZHUH EDVHG RQ DSSURDFKHV IRXQG WR EH HIIHFWLYH E\UHVHDUFK7ZHOYHRIWKHSURGXFWVKDGUHFHLYHGDZDUGVRUEHHQQRPLQDWHGIRUDZDUGV VRPHDVUHFHQWO\DVE\WUDGHDVVRFLDWLRQVPHGLDWHDFKHUVRUSDUHQWV7KHVWXG\GLG QRW GHWHUPLQH WKH WRWDO QXPEHU RI VFKRROV WHDFKHUV DQG VWXGHQWV FXUUHQWO\ XVLQJ WKH SURGXFWV ,QWKHVXEPLVVLRQSURFHVV('LQIRUPHGGHYHORSHUVWKDWWKHVWXG\ZRXOGIRFXVRQWKH DYHUDJH HIIHFWLYHQHVV RI UHDGLQJ DQG PDWKHPDWLFV VRIWZDUH SURGXFWV UDWKHU WKDQ RQ WKH HIIHFWLYHQHVV RI LQGLYLGXDO SURGXFWV 7KH LQWHQW ZDV WR PHDVXUH ZKHWKHU WHFKQRORJ\ DV UHSUHVHQWHGE\WKHVHOHFWHGUHDGLQJDQGPDWKHPDWLFVVRIWZDUHSURGXFWVLPSURYHGDFDGHPLF DFKLHYHPHQWUDWKHUWKDQKRZLQGLYLGXDOSURGXFWVLQFUHDVHGDFKLHYHPHQW7KHPDLQILQGLQJV IURPWKHQDWLRQDOVWXG\ZHUHWREHEDVHGRQWKHFRPELQHGSURGXFWUHVXOWVDWHDFKRIWKH IRXUJUDGHOHYHOV 7KHYROXQWDU\DVSHFWRIFRPSDQ\SDUWLFLSDWLRQLQWKHVWXG\PHDQWWKDWSURGXFWVPD\ QRW EH D UHSUHVHQWDWLYH VDPSOLQJ RI UHDGLQJ DQG PDWK WHFKQRORJ\ SURGXFWV WKDW VFKRROV FRXOGSXUFKDVHRUXVH1RWDOOSURGXFWVZHUHVXEPLWWHGIRUSRWHQWLDOLQFOXVLRQLQWKHVWXG\ DQGPRVWSURGXFWVWKDWZHUHVXEPLWWHGZHUHQRWVHOHFWHG3URGXFWVWKDWZHUHVHOHFWHGPD\ KDYHEHHQPRUHHIIHFWLYHWKDQWKHDYHUDJHSURGXFWEHFDXVHVHOHFWHGSURGXFWVZHUHDEOHWR SURYLGH DW OHDVW VRPH HYLGHQFH RI HIIHFWLYHQHVV IURP SUHYLRXV UHVHDUFK RU D SURRI RI FRQFHSW('UHFRJQL]HGWKDWVHOHFWLQJRVWHQVLEO\PRUHHIIHFWLYHSURGXFWVSRVVLEO\WLOWHGWKH VWXG\WRZDUGILQGLQJKLJKHUOHYHOVRIHIIHFWLYHQHVVEXWWKHWLOWZDVYLHZHGDVDUHDVRQDEOH WUDGHRIIWRDYRLGLQYHVWLQJWKHVWXG\·VUHVRXUFHVLQSURGXFWVWKDWKDGOLWWOHRUQRHYLGHQFH RIHIIHFWLYHQHVV & 5HFUXLWLQJ'LVWULFWVDQG6FKRROVIRUWKH6WXG\ 6DPSOHVL]HWDUJHWVZHUHVHWVRWKDWWKHVWXG\FRXOGGHWHFWDQHIIHFWVL]HRQWHVWVFRUHV RIDWOHDVWDWHDFKRILWVIRXUJUDGHOHYHOV$JRGLQLHWDO7KLVWDUJHWHIIHFWVL]HZDV DEDODQFHEHWZHHQWKHGHVLUHIRULQWHUYHQWLRQVWRVXEVWDQWLDOO\FORVHDFKLHYHPHQWJDSVDQG WKH UHDOLW\ WKDW IHZ ODUJHVFDOH HGXFDWLRQ HYDOXDWLRQV KDYH IRXQG HIIHFWV ODUJHU WKDQ WKH $OWKRXJKPDQ\VWXGHQWVWDNHDOJHEUDLQWKHLUILUVW\HDURIKLJKVFKRROGLVWULFWVLQFUHDVLQJO\DUHPRYLQJWR KDYHVWXGHQWVWDNHDOJHEUDLQHLJKWKJUDGH6WXGHQWVLQXSSHU\HDUVRIKLJKVFKRRODOVRFDQWDNHDOJHEUD ,,QWURGXFWLRQ
Page 1: (IIHFWLYHQHVVRI5HDGLQJDQG 0DWKHPDWL
Page 4 and 5: U. S. Department of Education 0DUJD
Page 7: &RQWHQWV &KDSWHU 3DJH ([HFXWLYH6
Page 10 and 11: viii ,,, ,,, ,,, ,,, ,9 ,9 ,9 ,9 ,9
Page 13: ([KLELWV ([KLELW ,, 3DJH +RZ3URGX
Page 16 and 17: xiv 6WXG\'HVLJQ ,QWHUYHQWLRQ6L[WHHQ
Page 18 and 19: xvi HIIHFWLYHQHVV RI JURXSV RI SURG
Page 20 and 21: xviii JUDGHUVDQGWKH6$7PDWKEDWWHU\IR
Page 22 and 23: xx YDULRXV VNLOOV 6RIWZDUHEDVHG UHF
Page 24 and 25: xxii Avtˆ…r" @ssrp‡†‚sA‚
Page 26 and 27: xxiv 6XPPDU\ &RQJUHVVSRVHGTXHVWLRQV
Page 28 and 29: 2 'HVSLWH WKH IDLUO\ VL]DEOH QXPEHU
Page 32 and 33: 6 WDUJHW 7KH WHDP HVWLPDWHG WKDW
Page 34 and 35: 8 7DEOH,1XPEHURI6WXG\'LVWULFWV6FKR
Page 36 and 37: 10 :KHWKHU H[FOXGHG WHDFKHUV ZHUH U
Page 38 and 39: 12 IRULQGLYLGXDOVWXGHQWVDQGPHUJHGGD
Page 40 and 41: 14 7DEOH,)HDWXUHVRI7HVWV8VHGLQWKH6W
Page 42 and 43: 16 WKHIXOOVHWRIHVWLPDWHVIURPWKHPDLQ
Page 44 and 45: 18 VXSSRUW RQ XVLQJ SURGXFWV WKH GX
Page 46 and 47: 20 7DEOH,,,QVWUXFWLRQDO)HDWXUHVRI)L
Page 48 and 49: 22 7DEOH,, 7HDFKHU5HSRUWHG8VHRI6WXG
Page 50 and 51: 24 XQGHUDVLQJOHORJLQ+RZHYHUFRUUHODW
Page 52 and 53: 26 3UHYLRXV VWXGLHV KDYH REVHUYHG W
Page 54 and 55: 28 7DEOH,,&KDUDFWHULVWLFVRI7HDFKHUV
Page 56 and 57: 30 VDPHVHWRIYDULDEOHVXVHGIRUWKHVFRU
Page 58 and 59: 32 WKDW VWXGHQWV KDG SUREOHPV DFFHV
Page 60 and 61: 34 ________________________________
Page 63 and 64: &KDSWHU,,, (IIHFWVRI)RXUWK*UDGH5HD
Page 65 and 66: 39 7DEOH,,,,QVWUXFWLRQDO)HDWXUHVRI)
Page 67 and 68: 41 )LJXUH,,, 'LIIHUHQFHLQ$QQXDO7HDF
Page 69 and 70: 43 7DEOH,,,$FWLYLWLHVLQ7UHDWPHQWDQG
Page 71 and 72: 45 ZKHWKHU D FODVVURRP ZDV DVVLJQHG
Page 73 and 74: 47 )LJXUH,,, 6FKRRO/HYHO(IIHFWVE\3U
Page 75: 7DEOH,,,,QWHUDFWLRQV%HWZHHQ0RGHUDWL
Page 78 and 79: 52 0DQ\ LQVWUXFWLRQDO IHDWXUHV RI W
Page 80 and 81:
54 7DEOH,97HDFKHU5HSRUWHG8VHRI6WXG\
Page 82 and 83:
56 0RVWWHDFKHUVSHUFHQWVFKHGXOHGWKHS
Page 84 and 85:
58 7DEOH,9&KDUDFWHULVWLFVRI7HDFKHU
Page 86 and 87:
60 ,9(IIHFWVRI6L[WK*UDGH0DWK6RIWZDU
Page 88 and 89:
& &RQFOXVLRQV 7KLV VWXG\ H[SHULPHQW
Page 90 and 91:
64 7KH SURGXFWV ZHUH UDWHG DV VLPLO
Page 92 and 93:
7DEOH97HDFKHU5HSRUWHG8VHRI6WXG\3URG
Page 94 and 95:
7HDFKHUV YDULHG LQ KRZ WKH\ VFKHGXO
Page 96 and 97:
(IIHFWV:HUH1RW6WDWLVWLFDOO\'LIIHUHQ
Page 98 and 99:
9(IIHFWVRI$OJHEUD6RIWZDUH3URGXFWV
Page 100 and 101:
7DEOH9,QWHUDFWLRQV%HWZHHQ0RGHUDWLQJ
Page 102 and 103:
76 %ODFN3DQG':LOLDP´$VVHVVPHQWDQG&
Page 104 and 105:
78 0H]HUQLFK 00 :0 -HQNLQV 3 -RKQVW
Page 107 and 108:
$SSHQGL[$ 'DWD&ROOHFWLRQ$SSURDFKDQG
Page 109 and 110:
83 % 7HDFKHU6XUYH\ ,Q1RYHPEHUWHDFKH
Page 111 and 112:
85 7DEOH$1XPEHUDQG3HUFHQWRI(OLJLEO
Page 113 and 114:
87 7DEOH$1XPEHURI6WXGHQWV7HVWHG,
Page 115 and 116:
89 IUDPHZRUNXVHGWKHPRGHORILQVWUXFWL
Page 117 and 118:
91 7$%/($D 'HVFULSWLYH6WDWLVWLFVRI
Page 119 and 120:
93 7DEOH$D 'HVFULSWLYH +LVSDQLFVW
Page 121 and 122:
95 7DEOH$E 'HVFULSWLYH 7UHDWPHQW*UR
Page 123 and 124:
97 $SSHQGL[$'DWD&ROOHFWLRQ$SSURD
Page 125:
99 $SSHQGL[$'DWD&ROOHFWLRQ$SSURD
Page 128 and 129:
ZKHUH
Page 130 and 131:
DIWHU DGMXVWLQJ IRU FRYDULDWHV RFFX
Page 132 and 133:
PRGHUDWLQJYDULDEOHVFRXOGEHLQFOXGHGI
Page 134 and 135:
7DEOH%FRQWLQXHG 9DULDEOH1DPH )LUVW
Page 136 and 137:
7KH VHFRQG HVWLPDWRU LV WKH GLIIHUH
Page 138:
7DEOH%&RPSDULVRQRI(IIHFW6L]HV%DVHGR
show all

Effectiveness of Reading and Mathematics Software Products ...

You also want an ePaper? Increase the reach of your titles

Delete template?

Save as template?