Effectiveness of Reading and Mathematics Software Products ...

(IIHFWLYHQHVVRI5HDGLQJDQG 

0DWKHPDWLFV6RIWZDUH3URGXFWV 

)LQGLQJVIURPWKH)LUVW6WXGHQW 

&RKRUW 

 

5HSRUWWR&RQJUHVV



)LQGLQJVIURPWKH)LUVW6WXGHQW 

&RKRUW 

 

5HSRUWWR&RQJUHVV 

0DUFK 

 

 

 

 

0DUN'\QDUVNL 

5REHUWR$JRGLQL 

6KHLOD+HDYLVLGH 

7LPRWK\1RYDN 

1DQF\&DUH\ 

/DULVVD&DPSX]DQR 

0DWKHPDWLFD3ROLF\5HVHDUFK,QF 

 

%DUEDUD0HDQV 

5REHUW0XUSK\ 

:LOOLDP3HQXHO 

+DO-DYLW] 

'HERUDK(PHU\ 

:LOORZ6XVVH[ 

65,,QWHUQDWLRQDO 

 

 

 

1&(( 

86'HSDUWPHQWRI(GXFDWLRQ

U. S. Department of Education 

0DUJDUHW6SHOOLQJV 

6HFUHWDU\ 

 

,QVWLWXWHRI(GXFDWLRQ6FLHQFHV 

*URYHU-:KLWHKXUVW 

'LUHFWRU 

 

1DWLRQDO&HQWHUIRU(GXFDWLRQ(YDOXDWLRQDQG5HJLRQDO$VVLVWDQFH 

3KRHEH&RWWLQJKDP 

&RPPLVVLRQHU 

 

 

0DUFK 

 

7KLV UHSRUW LV LQ WKH SXEOLF GRPDLQ $XWKRUL]DWLRQ WR UHSURGXFH LW LQ ZKROH RU LQ SDUW LV 

JUDQWHG:KLOHSHUPLVVLRQWRUHSULQWWKLVSXEOLFDWLRQLVQRWQHFHVVDU\WKHFLWDWLRQVKRXOGEH 

'\QDUVNL 0DUN 5REHUWR $JRGLQL 6KHLOD +HDYLVLGH 7LPRWK\ 1RYDN 1DQF\ &DUH\ /DULVVD 

&DPSX]DQR%DUEDUD0HDQV5REHUW0XUSK\:LOOLDP3HQXHO+DO-DYLW]'HERUDK(PHU\DQG 

:LOORZ 6XVVH[ (IIHFWLYHQHVV RI 5HDGLQJ DQG 0DWKHPDWLFV 6RIWZDUH 3URGXFWV )LQGLQJV IURP WKH )LUVW 

6WXGHQW &RKRUW :DVKLQJWRQ '& 86 'HSDUWPHQW RI (GXFDWLRQ ,QVWLWXWH RI (GXFDWLRQ 

6FLHQFHV 

 

3UHSDUHGXQGHU&RQWUDFW1R('&2ZLWK0DWKHPDWLFD3ROLF\5HVHDUFK,QF 

 

7RRUGHUFRSLHVRIWKLVUHSRUW 

 

ƒ:ULWHWR('3XEV(GXFDWLRQ3XEOLFDWLRQV&HQWHU86'HSDUWPHQWRI(GXFDWLRQ32%R[ 

-HVVXS0' 

 

ƒ&DOOLQ\RXUUHTXHVWWROOIUHHWR('3XEV,IVHUYLFHLVQRW\HWDYDLODEOHLQ\RXU 

DUHD FDOO 86$/($51 7KRVH ZKR XVH D WHOHFRPPXQLFDWLRQV GHYLFH 

IRUWKHGHDI7''RUDWHOHW\SHZULWHU77

$FNQRZOHGJPHQWV 

 

 

 

7KLV VWXG\ UHSUHVHQWV D FROODERUDWLYH HIIRUW RI PDQ\ VFKRRO GLVWULFWV VFKRROV WHDFKHUV 

UHVHDUFKHUV GDWD FROOHFWLRQ H[SHUWV SXEOLVKHUV DQG GHYHORSHUV DQG VWDII RI WKH ,QVWLWXWH RI 

(GXFDWLRQ6FLHQFHV:HDSSUHFLDWHWKHZLOOLQJQHVVRIWKHVFKRROGLVWULFWVVFKRROVDQGWHDFKHUVWR 

YROXQWHHU IRU WKH VWXG\ XVH WKH SURGXFWV DQG UHVSRQG WR PDQ\ UHTXHVWV IRU GDWD SHUVSHFWLYHV 

LQVLJKWVDQGDFFHVVWRFODVVURRPV:HWKDQN$XGUH\3HQGOHWRQSURMHFWRIILFHU5LFN\7DNDLDQG 

3KRHEH &RWWLQJKDP DW WKH ,QVWLWXWH RI (GXFDWLRQ 6FLHQFHV IRU WKHLU VXSSRUW DQG JXLGDQFH 

WKURXJKRXWWKHVWXG\:HDOVRWKDQN-RKQ%DLOH\6XVDQ3DWULFNDQG7LPRWK\0DJQHURIWKH86 

'HSDUWPHQW RI (GXFDWLRQ·V 2IILFH RI (GXFDWLRQ 7HFKQRORJ\ IRU WKHLU VXSSRUW DQG VXJJHVWLRQV 

WKURXJKRXWWKHVWXG\:HEHQHILWHGIURPWKHLQVLJKWVDQGFRPPHQWVRIWKHHYDOXDWLRQ·VWHFKQLFDO 

ZRUNLQJJURXS&KULV/RQLJDQ6WHYHQ5RVV7RP&RRN-HUH%URSK\0LFKDHODPLO*DU\3KLOOLSV 

'RXJ&OHPHQWVDQG-RKQ&RRQH\ 

 

:H WKDQN &KULVWRSKHU 6DQIRUG DQG )UDQFHV %HUJODQG IRU FRRUGLQDWLQJ WKH FODVVURRP 

REVHUYDWLRQVDQGPRQLWRULQJWKHFROOHFWLRQDQGSURFHVVLQJRIWKHLQWHUYLHZDQGREVHUYDWLRQGDWD 

$P\ +DIWHU IRU WKH VXSSRUW WR WKH VWDII FRQGXFWLQJ REVHUYDWLRQV $P\ /HZLV IRU GHVLJQ DQG 

SURGXFWLRQRILQVWUXPHQWDWLRQIRUWKHREVHUYDWLRQVDQG3DXO+XIRUDQDO\]LQJDQGGRFXPHQWLQJWKH 

REVHUYDWLRQDO GDWD 0HOLVVD 7KRPDV ZDV D NH\ FRQWULEXWRU WR WKH GHYHORSPHQW RI WKH VXUYH\ 

LQVWUXPHQWVDQGKHOSHGGLUHFWWKHWHVWLQJDQGGDWDFROOHFWLRQHIIRUWULVWLQD4XDUWDQD7RP%DUWRQ 

9DOHULH:LOOLDPV0HOLVVD'XJJHU7LPRWK\%UXXUVHPDDQG/HRQDUG%URZQDVVLVWHGLQPDQDJLQJWKH 

GDWD FROOHFWLRQ DQG 0DULDQQH 6WHYHQVRQ )UDQFHQH %DUERXU 6XVDQ *ROGHQ 6HDVRQ %HGHOO%R\OH 

DQG6KHOE\3ROODFNDOVRKHOSHGFROOHFWDQGPDQDJHWKHGDWD:HWKDQN1DNLV(YJHQLRX6FRWW5HLG 

0DUN%HDUGVOH\5RQDOG3DODQFDDQG5RODQG6FXUDWRIRULQIRUPDWLRQV\VWHPVVXSSRUW'RQ-DQJ 

DQG$PDQJ6XNDVLKIRUVWDWLVWLFDOVXSSRUWDQG7LP1RYDN&DURO5D]DILQGUDNDWRDQG$OH[%RJLQ 

IRUSURJUDPPLQJWKHHVWLPDWLRQPRGHOV:HDSSUHFLDWHWKHH[SHUWVNLOOVRI-LOO0LOOHUDQG%LOO*DUUHWW 

WRIRUPDWDQGSURGXFHWKHUHSRUW 

 

7KH$XWKRUV

&RQWHQWV 

 

&KDSWHU 

3DJH 

([HFXWLYH6XPPDU\«««««««««««««««««««««««[LLL 

 

, ,QWURGXFWLRQ 

 

$ 5HVHDUFKRQWKH(IIHFWLYHQHVVRI5HDGLQJDQG0DWKHPDWLFV6RIWZDUH 

% 'HVLJQRIWKH1DWLRQDO6WXG\ 

& 5HFUXLWLQJ'LVWULFWVDQG6FKRROVIRUWKH6WXG\ 

' 5HFUXLWLQJDQG$VVLJQLQJ7HDFKHUV 

( &ROOHFWLQJ&ODVVURRPDQG6WXGHQW'DWD 

) /RRNLQJ$KHDG 

 

,, (IIHFWVRI)LUVW*UDGH5HDGLQJ6RIWZDUH3URGXFWV 

 

$ ,PSOHPHQWDWLRQ$QDO\VLV 

% (IIHFWVRQ5HDGLQJ7HVW6FRUHV 

& &RQFOXVLRQV 

 

,,, (IIHFWVRI)RXUWK*UDGH5HDGLQJ6RIWZDUH3URGXFWV 

 


% (IIHFWVRQ5HDGLQJ7HVW6FRUHV 


 

,9 (IIHFWVRI6L[WK*UDGH0DWK6RIWZDUH3URGXFWV 

 


% (IIHFWVRQ0DWK7HVW6FRUHV 


 

9 (IIHFWVRI$OJHEUD6RIWZDUH3URGXFWV 

 


% (IIHFWVRQ$OJHEUD7HVW6FRUHV 


 

 

5HIHUHQFHV 

 

$SSHQGL[$'DWD&ROOHFWLRQ$SSURDFKDQG5HVSRQVH5DWHV 

 

$SSHQGL[%(VWLPDWLQJ(IIHFWVDQG$VVHVVLQJ5REXVWQHVV

7DEOHV 

 

7DEOH 

, 

, 

, 

, 

,, 

,, 

,, 

,, 

,, 

3DJH 

1XPEHURI6WXG\'LVWULFWV6FKRROV7HDFKHUVDQG6WXGHQWVE\ 

*UDGH/HYHO6SULQJ 

&KDUDFWHULVWLFVRI'LVWULFWVLQWKH6WXG\ 

&KDUDFWHULVWLFVRI6FKRROVLQWKH6WXG\ 

)HDWXUHVRI7HVWV8VHGLQWKH6WXG\ 

,QVWUXFWLRQDO)HDWXUHVRI)LUVW*UDGH5HDGLQJ3URGXFWV 

7HDFKHU5HSRUWHG8VHRI6WXG\3URGXFWVDQG2WKHU5HDGLQJ 

6RIWZDUH3URGXFWV)LUVW*UDGH 

'DLO\DQG$QQXDO8VDJH)URP3URGXFW5HFRUGV 

$FWLYLWLHVLQ7UHDWPHQWDQG&RQWURO&ODVVURRPV)LUVW*UDGH 

&KDUDFWHULVWLFVRI7HDFKHUVDQG6WXGHQWVLQ7UHDWPHQWDQG 

&RQWURO&ODVVURRPV)LUVW*UDGH 

,, 6SULQJ5HDGLQJ7HVW6FRUH'LIIHUHQFHVLQ7UHDWPHQWDQG&RQWURO 

&ODVVURRPV)LUVW*UDGH 

,, 

(IIHFWRQ3HUFHQWRI6WXGHQWVLQ/RZHVW7KLUGRI5HDGLQJ7HVW6FRUH 

,, ,QWHUDFWLRQV%HWZHHQ0RGHUDWLQJ9DULDEOHVDQG(IIHFWV 

6$75HDGLQJ7HVW)LUVW*UDGH 

,, 

,,, 

,,, 

,,, 

,,, 

,QWHUDFWLRQV%HWZHHQ0RGHUDWLQJ9DULDEOHVDQG(IIHFWV 

7HVWRI:RUG5HDGLQJ(IILFLHQF\)LUVW*UDGH 

,QVWUXFWLRQDO)HDWXUHVRI)RXUWK*UDGH5HDGLQJ3URGXFWV 

7HDFKHU5HSRUWHG8VHRI6WXG\3URGXFWVDQG2WKHU5HDGLQJ 

6RIWZDUH3URGXFWV)RXUWK*UDGH 


$FWLYLWLHVLQ7UHDWPHQWDQG&RQWURO&ODVVURRPV)RXUWK*UDGH

viii 

,,, 

,,, 

,,, 

,,, 

,9 

,9 

,9 

,9 

,9 

,9 

 

,9 

,9 

9 

9 

9 

9 

9 


&RQWURO&ODVVURRPV)RXUWK*UDGH 

6SULQJ5HDGLQJ7HVW6FRUH'LIIHUHQFHVLQ7UHDWPHQWDQG&RQWURO 

&ODVVURRPV)RXUWK*UDGH 

(IIHFWRQ3HUFHQWRI6WXGHQWVLQ/RZHVW7KLUGRI5HDGLQJ7HVW6FRUHV 


6$75HDGLQJ7HVW)RXUWK*UDGH 

,QVWUXFWLRQDO)HDWXUHVRI6L[WK*UDGH0DWKHPDWLFV3URGXFWV 

7HDFKHU5HSRUWHG8VHRI6WXG\3URGXFWVDQG2WKHU0DWKHPDWLFV 

3URGXFWV6L[WK*UDGH 


$FWLYLWLHVLQ7UHDWPHQWDQG&RQWURO&ODVVURRPV6L[WK*UDGH 

&KDUDFWHULVWLFVRI7HDFKHUVDQG6WXGHQWVLQ7UHDWPHQWDQG&RQWURO 

&ODVVURRPV6L[WK*UDGH 

6SULQJ0DWK7HVW6FRUH'LIIHUHQFHVLQ7UHDWPHQWDQG&RQWURO 

&ODVVURRPV6L[WK*UDGH 

(IIHFWRQ3HUFHQWRI6WXGHQWVLQ/RZHVW7KLUGRI0DWK7HVW6FRUHV 


6$70DWK7HVW6L[WK*UDGH 

,QVWUXFWLRQDO)HDWXUHVRI$OJHEUD3URGXFWV 

7HDFKHU5HSRUWHG8VHRI6WXG\3URGXFWVDQG2WKHU0DWK6RIWZDUH 

'DLO\DQG$QQXDO8VDJH 

$FWLYLWLHVLQ7UHDWPHQWDQG&RQWURO&ODVVURRPV 


&RQWURO&ODVVURRPV 

9 (76$OJHEUD)LQDO([DP6FRUH'LIIHUHQFHVLQ7UHDWPHQWDQG 

&RQWURO&ODVVURRPV 

 

9 ,QWHUDFWLRQV%HWZHHQ0RGHUDWLQJ9DULDEOHVDQG(IIHFWV 

(76$OJHEUD7HVW 

7DEOHV Ã

)LJXUHV 

 

)LJXUH 

,, 

,, 

,, 

,,, 

3DJH 

'LIIHUHQFHLQ$QQXDO7HDFKHU5HSRUWHG+RXUVRI5HDGLQJ7HFKQRORJ\ 

3URGXFW8VH%HWZHHQ7UHDWPHQWDQG&RQWURO&ODVVURRPV)LUVW*UDGH 

6FKRRO/HYHO(IIHFW6L]HVE\'LVWULFW)LUVW*UDGH6$75HDGLQJ6FRUH 

6FKRRO/HYHO(IIHFW6L]HVE\3URGXFW)LUVW*UDGH6$75HDGLQJ6FRUH 

'LIIHUHQFHLQ$QQXDO7HDFKHU5HSRUWHG+RXUVRI5HDGLQJ7HFKQRORJ\ 

3URGXFW8VH%HWZHHQ7UHDWPHQWDQG&RQWURO&ODVVURRPV)RXUWK*UDGH 

,,, 6FKRRO/HYHO(IIHFW6L]HVE\'LVWULFW)RXUWK*UDGH 

6$75HDGLQJ6FRUH 

,,, 6FKRRO/HYHO(IIHFW6L]HVE\3URGXFW)RXUWK*UDGH 

6$75HDGLQJ6FRUH 

,9 

 

,9 

,9 

9 

 

9 

9 

'LIIHUHQFHLQ$QQXDO7HDFKHU5HSRUWHG+RXUVRI0DWK7HFKQRORJ\ 

3URGXFW8VH%HWZHHQ7UHDWPHQWDQG&RQWURO&ODVVURRPV6L[WK*UDGH 

6FKRRO/HYHO(IIHFW6L]HVE\'LVWULFW6L[WK*UDGH6$70DWK6FRUH 

6FKRRO/HYHO(IIHFW6L]HVE\3URGXFW6L[WK*UDGH6$70DWK6FRUH 

'LIIHUHQFHLQ$QQXDO7HDFKHU5HSRUWHG+RXUVRI0DWK7HFKQRORJ\ 

3URGXFW8VH%HWZHHQ7UHDWPHQWDQG&RQWURO&ODVVURRPV$OJHEUD 

6FKRRO/HYHO(IIHFW6L]HVE\'LVWULFW$OJHEUD(76)LQDO([DP 

6FKRRO/HYHO(IIHFW6L]HVE\3URGXFW$OJHEUD(76)LQDO([DP

([KLELWV 

 

([KLELW 

,, 

3DJH 

+RZ3URGXFW)HDWXUHV:HUH$VVHVVHG

([HFXWLYH6XPPDU\ 



)LQGLQJVIURPWKH)LUVW6WXGHQW&RKRUW 

 

: 

LWK FRPSXWHUV QRZ FRPPRQSODFH LQ $PHULFDQ FODVVURRPV DQG GLVWULFWV IDFLQJ 

VXEVWDQWLDO FRVWV RI KDUGZDUH DQG VRIWZDUH FRQFHUQV QDWXUDOO\ DULVH DERXW WKH 

FRQWULEXWLRQRIWKLVWHFKQRORJ\WRVWXGHQWV·OHDUQLQJ7KH1R&KLOG/HIW%HKLQG 

$FW 3/ VHFWLRQ FDOOHG IRU WKH 86 'HSDUWPHQW RI (GXFDWLRQ (' WR 

FRQGXFWDQDWLRQDOVWXG\RIWKHHIIHFWLYHQHVVRIHGXFDWLRQDOWHFKQRORJ\7KLVOHJLVODWLRQDOVR 

FDOOHG IRU WKH VWXG\ WR XVH ´VFLHQWLILFDOO\ EDVHG UHVHDUFK PHWKRGV DQG FRQWURO JURXSV RU 

FRQWURO FRQGLWLRQVµ DQG WR IRFXV RQ WKH LPSDFW RI WHFKQRORJ\ RQ VWXGHQW DFDGHPLF 

DFKLHYHPHQW 

 

,Q (' FRQWUDFWHG ZLWK 0DWKHPDWLFD 3ROLF\ 5HVHDUFK ,QF 035 DQG 65, 

,QWHUQDWLRQDOWRFRQGXFWWKHVWXG\7KHWHDPZRUNHGZLWK('WRVHOHFWWHFKQRORJ\SURGXFWV 

UHFUXLWVFKRROGLVWULFWVVFKRROVDQGWHDFKHUVWHVWVWXGHQWVREVHUYHFODVVURRPVDQGDQDO\]H 

WKHGDWD7KHVWXG\XVHGDQH[SHULPHQWDOGHVLJQWRDVVHVVWKHHIIHFWVRIWHFKQRORJ\SURGXFWV 

ZLWKYROXQWHHULQJWHDFKHUVUDQGRPO\DVVLJQHGWRXVHRUQRWXVHVHOHFWHGSURGXFWV 

7KHPDLQILQGLQJVRIWKHVWXG\DUH 

7HVW 6FRUHV :HUH 1RW 6LJQLILFDQWO\ +LJKHU LQ &ODVVURRPV 8VLQJ 6HOHFWHG 

5HDGLQJ DQG 0DWKHPDWLFV 6RIWZDUH 3URGXFWV 7HVW VFRUHV LQ WUHDWPHQW 

FODVVURRPV WKDW ZHUH UDQGRPO\ DVVLJQHG WR XVH SURGXFWV GLG QRW GLIIHU IURP WHVW 

VFRUHVLQFRQWUROFODVVURRPVE\VWDWLVWLFDOO\VLJQLILFDQWPDUJLQV 

 

(IIHFWV :HUH &RUUHODWHG :LWK 6RPH &ODVVURRP DQG 6FKRRO &KDUDFWHULVWLFV 

)RUUHDGLQJSURGXFWVHIIHFWVRQRYHUDOOWHVWVFRUHVZHUHFRUUHODWHGZLWKWKHVWXGHQW 

WHDFKHU UDWLR LQ ILUVW JUDGH FODVVURRPV DQG ZLWK WKH DPRXQW RI WLPH WKDW SURGXFWV 

ZHUHXVHGLQIRXUWKJUDGHFODVVURRPV)RUPDWKSURGXFWVHIIHFWVZHUHXQFRUUHODWHG 

ZLWKFODVVURRPDQGVFKRROFKDUDFWHULVWLFV

xiv 

6WXG\'HVLJQ 

,QWHUYHQWLRQ6L[WHHQSURGXFWVZHUHVHOHFWHGE\('EDVHGRQSXEOLFVXEPLVVLRQVDQGUDWLQJVE\WKHVWXG\ 

WHDPDQGH[SHUWUHYLHZSDQHOV3URGXFWVZHUHJURXSHGLQWRIRXUDUHDVILUVWJUDGHUHDGLQJIRXUWKJUDGH 

UHDGLQJVL[WKJUDGHPDWKDQGDOJHEUD 

 

3DUWLFLSDQWV7KLUW\WKUHHGLVWULFWVVFKRROVDQGWHDFKHUVSDUWLFLSDWHGLQWKHVWXG\,QILUVWJUDGH 

GLVWULFWV VFKRROV DQG WHDFKHUV SDUWLFLSDWHG ,Q IRXUWK JUDGH GLVWULFWV VFKRROV DQG 

WHDFKHUV SDUWLFLSDWHG ,Q VL[WK JUDGH GLVWULFWV VFKRROV DQG WHDFKHUV SDUWLFLSDWHG DQG IRU 

DOJHEUDGLVWULFWVVFKRROVDQGWHDFKHUVSDUWLFLSDWHG'LVWULFWVDQGVFKRROVFRXOGSDUWLFLSDWHLQWKH 

VWXG\DWPRUHWKDQRQHJUDGHOHYHODQGVRPHGLG'LVWULFWVZHUHUHFUXLWHGRQWKHEDVLVWKDWWKH\GLGQRW 

DOUHDG\XVHWHFKQRORJ\SURGXFWVWKDWZHUHVLPLODUWRVWXG\SURGXFWVLQSDUWLFLSDWLQJVFKRROV 

 

5HVHDUFK 'HVLJQ :LWKLQ HDFK VFKRRO WHDFKHUV ZHUH UDQGRPO\ DVVLJQHG WR EH DEOH WR XVH WKH VWXG\ 

SURGXFWWKHWUHDWPHQWJURXSRUQRWWKHFRQWUROJURXS&RQWUROJURXSWHDFKHUVZHUHDEOHWRXVHRWKHU 

WHFKQRORJ\SURGXFWVWKDWPD\KDYHEHHQLQWKHLUFODVVURRPV7KHVWXG\DGPLQLVWHUHGWHVWVWRVWXGHQWVLQ 

ERWKW\SHVRIFODVVURRPVQHDUWKHEHJLQQLQJDQGHQGRIWKHVFKRRO\HDU7KHVWXG\DOVRREVHUYHGWUHDWPHQW 

DQGFRQWUROFODVVURRPVWKUHHWLPHVGXULQJWKHVFKRRO\HDUDQGFROOHFWHGGDWDIURPWHDFKHUTXHVWLRQQDLUHV 

DQGLQWHUYLHZVVWXGHQWUHFRUGVDQGSURGXFWUHFRUGV%HFDXVHVWXGHQWVZHUHFOXVWHUHGLQFODVVURRPVDQG 

FODVVURRPVZHUHFOXVWHUHGLQVFKRROVHIIHFWVZHUHHVWLPDWHGXVLQJKLHUDUFKLFDOOLQHDUPRGHOV 

 

2XWFRPHV$QDO\]HG6WXGHQWWHVWVFRUHVFODVVURRPDFWLYLWLHVDQGUROHVRIWHDFKHUVDQGVWXGHQWV 

(GXFDWLRQDO WHFKQRORJ\ LV XVHG IRU ZRUG SURFHVVLQJ SUHVHQWDWLRQ VSUHDGVKHHWV 

GDWDEDVHVLQWHUQHWVHDUFKGLVWDQFHHGXFDWLRQYLUWXDOVFKRROVLQWHUDFWLRQVZLWKVLPXODWLRQV 

DQGPRGHOVDQGFROODERUDWLRQRYHUORFDODQGJOREDOQHWZRUNV7HFKQRORJ\DOVRLVXVHGDV 

DVVLVWLYHGHYLFHVIRUVWXGHQWVZLWKGLVDELOLWLHVDQGWRWHDFKFRQFHSWVRUVNLOOVWKDWDUHGLIILFXOW 

RULPSRVVLEOHWRFRQYH\ZLWKRXWWHFKQRORJ\7KLVVWXG\LVVSHFLILFDOO\IRFXVHGRQZKHWKHU 

VWXGHQWV KDG KLJKHU UHDGLQJ RU PDWK WHVW VFRUHV ZKHQ WHDFKHUV KDG DFFHVV WR VHOHFWHG 

VRIWZDUH SURGXFWV GHVLJQHG WR VXSSRUW OHDUQLQJ LQ UHDGLQJ RU PDWKHPDWLFV ,W ZDV QRW 

GHVLJQHGWRDVVHVVWKHHIIHFWLYHQHVVRIHGXFDWLRQDOWHFKQRORJ\DFURVVLWVHQWLUHVSHFWUXPRI 

XVHVDQGWKHVWXG\·VILQGLQJVGRQRWVXSSRUWFRQFOXVLRQVDERXWWHFKQRORJ\·VHIIHFWLYHQHVV 

EH\RQGWKHVWXG\·VFRQWH[WVXFKDVLQRWKHUVXEMHFWDUHDV 

7KLV UHSRUW LV WKH ILUVW RI WZR IURP WKH VWXG\ :KHWKHU UHDGLQJ DQG PDWKHPDWLFV 

VRIWZDUHLVPRUHHIIHFWLYHZKHQWHDFKHUVKDYHPRUHH[SHULHQFHXVLQJLWLVEHLQJH[DPLQHG 

ZLWK D VHFRQG \HDU RI GDWD 7KH VHFRQG \HDU LQYROYHV WHDFKHUV ZKR ZHUH LQ WKH ILUVW GDWD 

FROOHFWLRQWKRVHZKRDUHWHDFKLQJLQWKHVDPHVFKRRODQGDWWKHVDPHJUDGHOHYHORUVXEMHFW 

DUHDDQGDVHFRQGFRKRUWRIVWXGHQWV7KHVHFRQGUHSRUWZLOOSUHVHQWHIIHFWVIRULQGLYLGXDO 

SURGXFWV7KHFXUUHQWUHSRUWZLOOSUHVHQWHIIHFWVIRUJURXSVRISURGXFWV 

6HOHFWLQJ7HFKQRORJ\3URGXFWVIRUWKH6WXG\ 

7KHVWXG\ZDVEDVHGRQWKHYROXQWDU\SDUWLFLSDWLRQRIWHFKQRORJ\SURGXFWGHYHORSHUV 

GLVWULFWV DQG VFKRROV DQG WHDFKHUV 7KHLU FKDUDFWHULVWLFV SURYLGH DQ LPSRUWDQW SDUW RI WKH 

VWXG\·VVWUXFWXUHDQGFRQWH[WIRULQWHUSUHWLQJLWVILQGLQJV 

([HFXWLYH6XPPDU\

xv 

%HIRUHSURGXFWVFRXOGEHVHOHFWHGGHFLVLRQVZHUHQHHGHGDERXWWKHVWXG\·VIRFXV7KH 

OHJLVODWLRQPDQGDWLQJWKHVWXG\SURYLGHGJHQHUDOJXLGHOLQHVEXWGLGQRWGHVFULEHVSHFLILFDOO\ 

KRZ WKH VWXG\ ZDV WR EH LPSOHPHQWHG $ GHVLJQ WHDP FRQVLVWLQJ RI 86 'HSDUWPHQW RI 

(GXFDWLRQ VWDII UHVHDUFKHUV IURP 035 DQG LWV SDUWQHUV DQG UHVHDUFKHUV DQG HGXFDWLRQDO 

WHFKQRORJ\H[SHUWVUHFRPPHQGHGWKDWWKHVWXG\ 

• IRFXVDWWHQWLRQRQWHFKQRORJ\SURGXFWVWKDWVXSSRUWUHDGLQJRUPDWKLQVWUXFWLRQLQ 

ORZLQFRPHVFKRROVVHUYLQJWKHJUDGHV 

• XVH DQ H[SHULPHQWDO GHVLJQ WR HQVXUH WKDW PHDVXUHG DFKLHYHPHQW JDLQV FRXOG EH 

DWWULEXWHGWRSURGXFWVDQG 

• EDVHWKHDQDO\VLVRIVWXGHQWDFDGHPLFDFKLHYHPHQWRQDFRPPRQO\XVHGVWDQGDUGL]HG 

WHVW 

7KHWHDPDOVRLGHQWLILHGFRQGLWLRQVDQGSUDFWLFHVZKRVHUHODWLRQVKLSVWRHIIHFWLYHQHVV 

FRXOG EH VWXGLHG DQG UHFRPPHQGHG D SXEOLF SURFHVV LQ ZKLFK GHYHORSHUV RI WHFKQRORJ\ 

SURGXFWVZRXOGEHLQYLWHGWRSURYLGHLQIRUPDWLRQWKDWDSDQHOZRXOGFRQVLGHULQLWVVHOHFWLRQ 

RI SURGXFWV IRU WKH VWXG\ $ GHVLJQ UHSRUW SURYLGHG GLVFXVVLRQ DQG UDWLRQDOHV IRU WKH 

UHFRPPHQGDWLRQV 

$WRWDORIVXEPLVVLRQVZHUHUHFHLYHGLQUHVSRQVHWRDSXEOLFLQYLWDWLRQPDGHE\(' 

DQG 035 LQ 6HSWHPEHU $ WHDP UDWHG WKH VXEPLVVLRQV RQ HYLGHQFHRI HIIHFWLYHQHVV 

EDVHG RQ SUHYLRXV UHVHDUFK FRQGXFWHG E\ WKH FRPSDQLHV RU E\ RWKHU SDUWLHV ZKHWKHU 

SURGXFWV FRXOG RSHUDWH RQ D VFDOH WKDW ZDV VXLWDEOH IRU D QDWLRQDO VWXG\ DQG ZKHWKHU 

FRPSDQLHVKDGWKHFDSDFLW\WRSURYLGHWUDLQLQJWRVFKRROVDQGWHDFKHUVRQWKHXVHRIWKHLU 

SURGXFWV$OLVWRIFDQGLGDWHSURGXFWVZDVWKHQUHYLHZHGE\WZRH[WHUQDOSDQHOVRQHHDFK 

IRU UHDGLQJ DQG PDWK (' VHOHFWHG SURGXFWV IRU WKH VWXG\ IURP DPRQJ WKH 

UHFRPPHQGDWLRQVPDGHE\WKHSDQHOVDQGDQQRXQFHGWKHFKRLFHVLQ-DQXDU\('DOVR 

LGHQWLILHG IRXU JUDGH OHYHOV IRU WKH VWXG\ GHFLGLQJ WR VWXG\ UHDGLQJ SURGXFWV LQ ILUVW DQG 

IRXUWKJUDGHVDQGPDWKSURGXFWVLQVL[WKJUDGHDQGLQDOJHEUDFODVVHVW\SLFDOO\FRPSRVHGRI 

QLQWKJUDGHUV7ZHOYHRIWKHSURGXFWVKDYHHLWKHUUHFHLYHGRUEHHQQRPLQDWHGWRUHFHLYH 

DZDUGVVRPHDVUHFHQWO\DVIURPWUDGHDVVRFLDWLRQVPHGLDSDUHQWVDQGWHDFKHUV7KH 

VWXG\ GLG QRW GHWHUPLQH WKH QXPEHU RI VFKRROV WHDFKHUV DQG VWXGHQWV DOUHDG\ XVLQJ WKH 

VHOHFWHGSURGXFWV 

7KHYROXQWDU\DVSHFWRIFRPSDQ\SDUWLFLSDWLRQLQWKHVWXG\PHDQWWKDWSURGXFWVZHUH 

QRW D UHSUHVHQWDWLYH VDPSOLQJ RI UHDGLQJ DQG PDWK WHFKQRORJ\ XVHG LQ VFKRROV 1RW DOO 

SURGXFWV ZHUH VXEPLWWHG IRU FRQVLGHUDWLRQ E\ WKH VWXG\ DQG PRVW SURGXFWV WKDW ZHUH 

VXEPLWWHGZHUHQRWVHOHFWHG$OVRSURGXFWVWKDWZHUHVHOHFWHGZHUHDEOHWRSURYLGHDWOHDVW 

VRPH HYLGHQFH RI HIIHFWLYHQHVV IURP SUHYLRXV UHVHDUFK (' UHFRJQL]HG WKDW VHOHFWLQJ 

RVWHQVLEO\ PRUH HIIHFWLYH SURGXFWV FRXOG WLOW WKH VWXG\ WRZDUG ILQGLQJ KLJKHU OHYHOV RI 

HIIHFWLYHQHVVEXWWKHWLOWZDVYLHZHGDVDUHDVRQDEOHWUDGHRIIWRDYRLGLQYHVWLQJWKHVWXG\·V 

UHVRXUFHVLQSURGXFWVWKDWKDGOLWWOHRUQRHYLGHQFHRIHIIHFWLYHQHVV 

7KH VWXG\ ZDV GHVLJQHG WR UHSRUW UHVXOWV IRU JURXSV RI SURGXFWV UDWKHU WKDQ IRU 

LQGLYLGXDO SURGXFWV &RQJUHVV DVNHG ZKHWKHU WHFKQRORJ\ ZDV HIIHFWLYH DQG QRW KRZ WKH 

HIIHFWLYHQHVVRILQGLYLGXDOSURGXFWVFRPSDUHG)XUWKHUDVWXG\GHVLJQHGWRGHWHUPLQHWKH 

([HFXWLYH6XPPDU\

xvi 

HIIHFWLYHQHVV RI JURXSV RI SURGXFWV UHTXLUHG IHZHU FODVVURRPV DQG VFKRROV WR DFKLHYH D 

WDUJHW OHYHO RI VWDWLVWLFDO SUHFLVLRQ DQG WKXV KDG ORZHU FRVWV WKDQ D VWXG\ GHVLJQHG WR 

GHWHUPLQHWKHHIIHFWLYHQHVVRILQGLYLGXDOSURGXFWVDWWKHVDPHOHYHORISUHFLVLRQ'HYHORSHUV 

RIVRIWZDUHSURGXFWVYROXQWHHUHGWRSDUWLFLSDWHLQWKHVWXG\ZLWKWKHXQGHUVWDQGLQJWKDWWKH 

UHVXOWVZRXOGEHUHSRUWHGRQO\IRUJURXSVRISURGXFWV 

'XULQJWKHFRXUVHRILPSOHPHQWLQJWKHVWXG\YDULRXVSDUWLHVH[SUHVVHGDQLQWHUHVWLQ 

NQRZLQJUHVXOWVIRULQGLYLGXDOSURGXFWV7RDFFRPPRGDWHWKDWLQWHUHVWWKHGHVLJQRIWKH 

VWXG\ ZDV PRGLILHG LQ LWV VHFRQG \HDU RI GDWD FROOHFWLRQ $W WKH VDPH WLPH SURGXFW 

GHYHORSHUVZHUHDVNHGWRFRQVHQWWRKDYLQJLQGLYLGXDOUHVXOWVDERXWWKHLUSURGXFWVUHSRUWHG 

LQ WKH VHFRQG \HDU RI GDWD FROOHFWLRQ $ UHSRUW RI WKH UHVXOWV IURP WKH VHFRQG \HDU LV 

IRUWKFRPLQJ 

5HFUXLWLQJ'LVWULFWVDQG6FKRROVIRUWKH6WXG\ 

$IWHU SURGXFWV ZHUH VHOHFWHG WKH VWXG\ WHDP EHJDQ UHFUXLWLQJ VFKRRO GLVWULFWV WR 

SDUWLFLSDWH7KHWHDPIRFXVHGRQVFKRROGLVWULFWVWKDWKDGORZVWXGHQWDFKLHYHPHQWDQGODUJH 

SURSRUWLRQV RI VWXGHQWV LQ SRYHUW\ EXW WKHVH ZHUH JHQHUDO JXLGHOLQHV UDWKHU WKDQ VWULFW 

HOLJLELOLW\FULWHULD7KHVWXG\VRXJKWGLVWULFWVDQGVFKRROVWKDWGLGQRWDOUHDG\XVHSURGXFWV 

OLNHWKRVHLQWKHVWXG\VRWKDWWKHUHZRXOGEHDFRQWUDVWEHWZHHQWKHXVHRIWHFKQRORJ\LQ 

WUHDWPHQW DQG FRQWURO FODVVURRPV 3URGXFW YHQGRUV VXJJHVWHG PDQ\ RI WKH GLVWULFWV WKDW 

XOWLPDWHO\SDUWLFLSDWHGLQWKHVWXG\2WKHUVKDGSUHYLRXVO\SDUWLFLSDWHGLQVWXGLHVZLWK035 

RUOHDUQHGRIWKHVWXG\IURPQHZVDUWLFOHVDQGFRQWDFWHG035WRH[SUHVVLQWHUHVW 

,QWHUHVWHG GLVWULFWV LGHQWLILHG VFKRROV IRU WKH VWXG\ WKDW IHOO ZLWKLQ WKH JXLGHOLQHV 

*HQHUDOO\ VFKRROV ZHUH LGHQWLILHG E\ VHQLRU GLVWULFW VWDII EDVHG RQ EURDG FRQVLGHUDWLRQV 

VXFKDVZKHWKHUVFKRROVKDGDGHTXDWHWHFKQRORJ\LQIUDVWUXFWXUHDQGZKHWKHUVFKRROVZHUH 

SDUWLFLSDWLQJLQRWKHULQLWLDWLYHV%\6HSWHPEHUWKHVWXG\KDGUHFUXLWHGGLVWULFWVDQG 

VFKRROVWRSDUWLFLSDWH)LYHGLVWULFWVHOHFWHGWRLPSOHPHQWSURGXFWVLQWZRRUPRUHJUDGH 

OHYHOVDQGRQHGLVWULFWGHFLGHGWRLPSOHPHQWDSURGXFWLQDOOIRXUJUDGHOHYHOVUHVXOWLQJLQ 

FRPELQDWLRQVRIGLVWULFWV DQGSURGXFWLPSOHPHQWDWLRQV'LVWULFWVDQG VFKRROVLQWKH VWXG\ 

KDGKLJKHUWKDQDYHUDJHSRYHUW\OHYHOVDQGPLQRULW\VWXGHQWSRSXODWLRQVVHH7DEOH 

7RLPSOHPHQWWKHH[SHULPHQWDOGHVLJQWKHVWXG\WHDPUDQGRPO\DVVLJQHGYROXQWHHULQJ 

WHDFKHUVLQSDUWLFLSDWLQJVFKRROVWRXVHSURGXFWVWKH´WUHDWPHQWJURXSµRUQRWWKH´FRQWURO 

JURXSµ%HFDXVHRIWKHH[SHULPHQWDOGHVLJQWHDFKHUVLQWKHWUHDWPHQWDQGFRQWUROJURXSV 

ZHUHH[SHFWHGWREHHTXLYDOHQWRQDYHUDJHH[FHSWWKDWRQHJURXSLVXVLQJRQHRIWKHVWXG\·V 

WHFKQRORJ\SURGXFWV$VSHFWVRIWHDFKLQJWKDWDUHGLIILFXOWRULPSRVVLEOHWRREVHUYHVXFKDV 

DWHDFKHU·VDELOLW\WRPRWLYDWHVWXGHQWVWROHDUQDUH´FRQWUROOHGµE\WKHH[SHULPHQWDOGHVLJQ 

EHFDXVHWHDFKHUVZHUHUDQGRPO\DVVLJQHGDQGWKHUHIRUHVKRXOGEHWKHVDPHLQERWKJURXSV 

RQ DYHUDJH 7KH VWXG\ DOVR XVHG VWDWLVWLFDO PHWKRGV WR DGMXVW IRU UHPDLQLQJ GLIIHUHQFHV LQ 

PHDVXUHGFKDUDFWHULVWLFVRIVFKRROVWHDFKHUVDQGVWXGHQWVZKLFKDULVHEHFDXVHRIVDPSOLQJ 

YDULDELOLW\ 

 

 

([HFXWLYH6XPPDU\

xvii 

7DEOH 6DPSOH6L]HRIWKH(YDOXDWLRQRIWKH(IIHFWLYHQHVVRI5HDGLQJDQG 


6XEMHFWDQG*UDGH/HYHO 

1XPEHURI 

'LVWULFWV 

1XPEHURI 

6FKRROV 

1XPEHURI 

7HDFKHUV D 

1XPEHURI 

6WXGHQWV E 

5HDGLQJ*UDGH 

5HDGLQJ*UDGH 

0DWK*UDGH 

0DWK$OJHEUD 

7RWDO 

8QGXSOLFDWHG7RWDO F QD 

D7KHQXPEHURIWHDFKHUVLQFOXGHVWKHWUHDWPHQWDQGFRQWUROWHDFKHUV 

E7KH QXPEHU UHSUHVHQWV VWXGHQWV LQ WKH DQDO\VLV VDPSOH ZKR ZHUH WHVWHG LQ IDOO DQG LQ VSULQJ 

7KHWRWDOQXPEHURIVWXGHQWVZKRZHUHWHVWHGDWHLWKHUSRLQWLQWLPHLVODUJHUEHFDXVHVRPH 

VWXGHQWVWHVWHGLQWKHIDOOPRYHGRXWRIWKHLUVFKRROGLVWULFWE\WKHWLPHRIWKHVSULQJWHVWDQGVRPH 

VWXGHQWVWHVWHGLQWKHVSULQJKDGPRYHGLQWRVWXG\FODVVURRPVDIWHUWKHIDOOWHVW7KHWRWDOQXPEHURI 

VWXGHQWVWHVWHGZDVLQWKHIDOODQGLQWKHVSULQJ 

 

F%HFDXVH QLQH GLVWULFWV DQG HLJKW VFKRROV DUH SLORWLQJ PRUH WKDQ RQH SURGXFW IRU WKH VWXG\ WKH 

XQGXSOLFDWHGWRWDOJLYHVWKHQXPEHURIXQLTXHGLVWULFWVDQGVFKRROVLQWKHVWXG\ 

QD QRWDSSOLFDEOH 

7KHH[SHULPHQWDOGHVLJQSURYLGHVDEDVLVIRUXQGHUVWDQGLQJZKHWKHUVRIWZDUHSURGXFWV 

LPSURYH DFKLHYHPHQW 7HDFKHUV LQ WKH WUHDWPHQW JURXS ZHUH WR LPSOHPHQW D GHVLJQDWHG 

SURGXFWDVSDUWRIWKHLUUHDGLQJRUPDWKLQVWUXFWLRQ7HDFKHUVLQWKHFRQWUROJURXSZHUHWR 

WHDFK UHDGLQJ RU PDWK DV WKH\ ZRXOG KDYH QRUPDOO\ SRVVLEO\ XVLQJ WHFKQRORJ\ SURGXFWV 

DOUHDG\DYDLODEOHWRWKHP%HFDXVHWKHRQO\GLIIHUHQFHRQDYHUDJHEHWZHHQJURXSVLVZKHWKHU 

WHDFKHUVZHUHDVVLJQHGWRXVHVWXG\SURGXFWVWHVWVFRUHGLIIHUHQFHVFRXOGEHDWWULEXWHGWR 

EHLQJDVVLJQHGWRXVHDSURGXFWDIWHUDOORZLQJIRUVDPSOLQJYDULDELOLW\ 

%HFDXVHWKHVWXG\LPSOHPHQWHGSURGXFWVLQUHDOVFKRROVDQGZLWKWHDFKHUVZKRKDGQRW 

XVHG WKH SURGXFWV WKH ILQGLQJV SURYLGH D VHQVH RI SURGXFW HIIHFWLYHQHVV XQGHU UHDOZRUOG 

FRQGLWLRQV RI XVH :KLOH WKH VWXG\ ZRUNHG WR HQVXUH WKDW WHDFKHUV UHFHLYHG DSSURSULDWH 

WUDLQLQJRQXVLQJSURGXFWVDQGWKDWWHFKQRORJ\LQIUDVWUXFWXUHVZHUHDGHTXDWHYHQGRUVUDWKHU 

WKDQWKHVWXG\WHDPZHUHUHVSRQVLEOHIRUSURYLGLQJWHFKQLFDODVVLVWDQFHDQGIRUZRUNLQJZLWK 

VFKRROV DQG WHDFKHUV WR HQFRXUDJH WKHP WR XVH SURGXFWV PRUH RU XVH WKHP GLIIHUHQWO\ 

7HDFKHUVFRXOGGHFLGHWRVWRSXVLQJSURGXFWVLIWKH\EHOLHYHGSURGXFWVZHUHLQHIIHFWLYHRU 

GLIILFXOWWRXVHRUFRXOGXVHSURGXFWVLQZD\VWKDWYHQGRUVPD\QRWKDYHLQWHQGHG%HFDXVH 

RIWKLVIHDWXUHRIWKHVWXG\WKHUHVXOWVUHODWHWRFRQGLWLRQVRIXVHWKDWVFKRROVDQGGLVWULFWV 

ZRXOGIDFHLIWKH\ZHUHSXUFKDVLQJSURGXFWVRQWKHLURZQ 

&ROOHFWLQJ$FKLHYHPHQWDQG,PSOHPHQWDWLRQ'DWD 

7KH VWXG\·V DQDO\VHV UHO\ PRVWO\ RQ GDWD IURP VWXGHQW WHVW VFRUHV FODVVURRP 

REVHUYDWLRQV DQG WHDFKHU TXHVWLRQQDLUHV DQG LQWHUYLHZV 7KH VWXG\ DOVR FROOHFWHG VWXGHQW 

GDWD LWHPV IURP VFKRRO GLVWULFW UHFRUGV DQG LQFRUSRUDWHG GDWD DERXW GLVWULFWV DQG VFKRROV 

IURPWKH1DWLRQDO&HQWHUIRU(GXFDWLRQ6WDWLVWLFV·&RPPRQ&RUHRI'DWD 

7RPHDVXUHHIIHFWVWKHWHDPDGPLQLVWHUHGDVWXGHQWWHVWLQWKHIDOODQGVSULQJRIWKH 

VFKRRO\HDU7KHWHDPXVHGWKH6WDQIRUG$FKLHYHPHQW7HVWYHUVLRQUHDGLQJ 

EDWWHU\IRUILUVWJUDGHUVWKH6WDQIRUG$FKLHYHPHQW7HVW6$7UHDGLQJEDWWHU\IRUIRXUWK 

([HFXWLYH6XPPDU\

xviii 

JUDGHUVDQGWKH6$7PDWKEDWWHU\IRUVL[WKJUDGHUV7KHVHWHVWVZHUHDGPLQLVWHUHGLQIDOO 

DQGVSULQJ7KHWHDPDOVRXVHGWKH7HVWRI:RUG5HDGLQJ(IILFLHQF\72:5( 

DVKRUWDQGUHOLDEOHRQHRQRQHWHVWRIUHDGLQJDELOLW\IRUILUVWJUDGHUVWRDXJPHQWPHDVXUHV 

RIUHDGLQJVNLOOVSURYLGHGE\WKH6$77RUJHVHQHWDO 

7RPHDVXUHDOJHEUDDFKLHYHPHQWWKHVWXG\VHOHFWHG(GXFDWLRQDO7HVWLQJ6HUYLFHV·(76 

(QGRI&RXUVH$OJHEUD$VVHVVPHQW%HFDXVHEDVHOLQHPHDVXUHVRIDOJHEUDNQRZOHGJH 

ZHUHQRWDYDLODEOHRUZHUHFRQVLGHUHGXQVDWLVIDFWRU\WKHVWXG\ZRUNHGZLWK(76WRVHSDUDWH 

LWVDVVHVVPHQWZKLFKHVVHQWLDOO\LVDILQDOH[DPLQWRWZRFRPSRQHQWVWKDWKDGHTXDOOHYHOV 

RIGLIILFXOW\7KHVWXG\UDQGRPO\VHOHFWHGFODVVURRPVHLWKHUWRWDNHSDUW$LQWKHIDOODQG 

SDUW%LQWKHVSULQJRUWRWDNH%LQWKHIDOODQG$LQWKHVSULQJ6SOLWWLQJWKHWHVWLQWKLVZD\ 

PHDQWWKDWWKHIXOOWHVWZDVDGPLQLVWHUHGLQERWKWKHIDOODQGWKHVSULQJEXWHDFKVWXGHQW 

WRRNRQO\KDOIRIWKHWHVWDWHDFKSRLQW 

7KHWHDPDOVRFROOHFWHGVFRUHVRQGLVWULFWDFKLHYHPHQWWHVWVLIWKHVHGDWDZHUHDYDLODEOH 

7KH VWXG\·V DGPLQLVWUDWLRQ RI LWV RZQ WHVW SURYLGHG D FRQVLVWHQW PHDVXUH RI DFKLHYHPHQW 

DFURVVYDULHGGLVWULFWVDQGVFKRROVEXWH[DPLQLQJILQGLQJVEDVHGRQGLVWULFWWHVWVSURYLGHGD 

XVHIXOFKHFNRQWKHUREXVWQHVVRIWKHILQGLQJV 

&ODVVURRP REVHUYDWLRQV ZHUH WKH VWXG\·V SULPDU\ EDVLV IRU DVVHVVLQJ SURGXFW 

LPSOHPHQWDWLRQ$QREVHUYDWLRQSURWRFROZDVGHYHORSHGLQVSULQJDQGYLGHRWDSHVRI 

FODVVURRPV XVLQJ SURGXFWV ZHUH JDWKHUHG DQG ODWHU XVHG IRU REVHUYHU WUDLQLQJ 7KH 

REVHUYDWLRQ SURWRFRO ZDV GHVLJQHG WR JDWKHU VLPLODU LQIRUPDWLRQ LQ ERWK WUHDWPHQW DQG 

FRQWUROFODVVURRPVDQGDFURVVWKHGLIIHUHQWJUDGHOHYHOVDQGVXEMHFWDUHDVLQWKHVWXG\,Q 

DGGLWLRQWKHSURWRFROZDVGHVLJQHGWRIRFXVRQHOHPHQWVRILQVWUXFWLRQDQGLPSOHPHQWDWLRQ 

WKDWFRXOGEHREVHUYHGUHOLDEO$DFKFODVVURRPZDVYLVLWHGWKUHHWLPHVGXULQJWKHVFKRRO 

\HDU DQG REVHUYHUV XVHG WKH SURWRFRO IRU HDFK REVHUYDWLRQ ZKLFK ODVWHG DERXW KRXU 

2EVHUYDWLRQV ZHUH FRPSOHPHQWHG E\ D WHDFKHU LQWHUYLHZ WKDW JDWKHUHG LQIRUPDWLRQ DERXW 

LPSOHPHQWDWLRQ LVVXHV %DFNJURXQG LQIRUPDWLRQ DERXW WHDFKHUV ZDV DOVR JDWKHUHG IURP D 

TXHVWLRQQDLUHWKDWWHDFKHUVFRPSOHWHGLQ1RYHPEHUDQG'HFHPEHU 

6XPPDU\RI6WXG$LQGLQJV 

7KH IRXU JUDGH OHYHOV HVVHQWLDOO\ FRPSULVH VXEVWXGLHV ZLWKLQ WKH RYHUDOO VWXG\ DQG 

ILQGLQJVDUHUHSRUWHGVHSDUDWHO\IRUHDFK7KHVWXG\·VGDWDFROOHFWLRQDSSURDFKZDVWKHVDPH 

IRUWKHIRXUVXEVWXGLHV 

7KHLPSOHPHQWDWLRQDQDO\VLVIRFXVHGRQKRZSURGXFWVZHUHXVHGLQFODVVURRPVWKHLU 

H[WHQW RI XVDJH LVVXHV WKDW UHVXOWHG IURP WKHLU XVH DQG KRZ WKHLU XVH DIIHFWHG FODVVURRP 

DFWLYLWLHV7KUHHLPSOHPHQWDWLRQILQGLQJVHPHUJHGFRQVLVWHQWO\DFURVVWKHIRXUVXEVWXGLHV 

1HDUO\ $OO 7HDFKHUV 5HFHLYHG 7UDLQLQJ DQG %HOLHYHG WKH 7UDLQLQJ 3UHSDUHG 

7KHPWR8VHWKH3URGXFWV9HQGRUVWUDLQHGWHDFKHUVLQVXPPHUDQGHDUO\IDOORI 

RQ XVLQJ SURGXFWV 1HDUO\ DOO WHDFKHUV DWWHQGHG WUDLQLQJV SHUFHQW WR 

SHUFHQW GHSHQGLQJ RQ WKH JUDGH OHYHO $W WKH HQG RI WUDLQLQJV PRVW WHDFKHUV 

UHSRUWHGWKDWWKH\ZHUHFRQILGHQWWKDWWKH\ZHUHSUHSDUHGWRXVHWKHSURGXFWVZLWK 

WKHLUFODVVHV*HQHUDOO\WHDFKHUVUHSRUWHGDORZHUGHJUHHRIFRQILGHQFHLQZKDWWKH\ 

KDGOHDUQHGDIWHUWKH\EHJDQXVLQJSURGXFWVLQWKHFODVVURRP 

([HFXWLYH6XPPDU\

xix 

7HFKQLFDO 'LIILFXOWLHV 8VLQJ 3URGXFWV 0RVWO\ :HUH 0LQRU 0LQRU WHFKQLFDO 

GLIILFXOWLHV LQ XVLQJ SURGXFWV VXFK DV LVVXHV ZLWK VWXGHQWV ORJJLQJ LQ FRPSXWHUV 

ORFNLQJ XS RU KDUGZDUH SUREOHPV VXFK DV KHDGSKRQHV QRW ZRUNLQJ ZHUH IDLUO\ 

FRPPRQ0RVWRIWKHWHFKQLFDOGLIILFXOWLHVZHUHHDVLO\FRUUHFWHGRUZRUNHGDURXQG 

:KHQDVNHGZKHWKHUWKH\ZRXOGXVHWKHSURGXFWVDJDLQQHDUO\DOOWHDFKHUVLQGLFDWHG 

WKDWWKH\ZRXOG 

 

:KHQ3URGXFWV:HUH%HLQJ8VHG6WXGHQWV:HUH0RUH/LNHO\WR(QJDJHLQ 

,QGLYLGXDO 3UDFWLFH DQG 7HDFKHUV :HUH 0RUH /LNHO\ WR )DFLOLWDWH 6WXGHQW 

/HDUQLQJ5DWKHU7KDQ/HFWXUH'DWDIURPFODVVURRPREVHUYDWLRQVLQGLFDWHGWKDW 

FRPSDUHG WR VWXGHQWV LQ FRQWURO FODVVURRPV ZKHUH WKH VDPH VXEMHFW ZDV WDXJKW 

ZLWKRXWXVLQJWKHVHOHFWHGSURGXFWVVWXGHQWVXVLQJSURGXFWVZHUHPRUHOLNHO\WREH 

REVHUYHGZRUNLQJZLWKDFDGHPLFFRQWHQWRQWKHLURZQDQGOHVVOLNHO\WREHOLVWHQLQJ 

WR D OHFWXUH RU SDUWLFLSDWLQJ LQ TXHVWLRQDQGDQVZHU VHVVLRQV 7UHDWPHQW WHDFKHUV 

ZHUH PRUH OLNHO\ WKDQ FRQWURO WHDFKHUV WR EH REVHUYHG ZRUNLQJ ZLWK LQGLYLGXDO 

VWXGHQWVWRIDFLOLWDWHWKHLUOHDUQLQJVXFKDVE\SRLQWLQJRXWNH\LGHDVRUJLYLQJKLQWV 

RU VXJJHVWLRQV RQ WDFNOLQJ WKH WDVN VWXGHQWV ZHUH ZRUNLQJ RQ UDWKHU WKDQ OHDGLQJ 

ZKROHFODVVDFWLYLWLHV 

&RPSDULQJVWXGHQWWHVWVFRUHVIRUWUHDWPHQWWHDFKHUVXVLQJVWXG\SURGXFWVDQGFRQWURO 

WHDFKHUVQRWXVLQJVWXG\SURGXFWVLVWKHVWXG\·VPHDVXUHRISURGXFWHIIHFWLYHQHVV(IIHFWVRQ 

WHVWVFRUHVZHUHHVWLPDWHGXVLQJDVWDWLVWLFDOPRGHOWKDWDFFRXQWVIRUFRUUHODWLRQVRIVWXGHQWV 

ZLWKLQFODVVURRPVDQGFODVVURRPVZLWKLQVFKRROV7KHUREXVWQHVVRIWKHUHVXOWVZDVDVVHVVHG 

E\H[DPLQLQJILQGLQJVXVLQJGLIIHUHQWPHWKRGVRIHVWLPDWLRQDQGXVLQJGLVWULFWWHVWVFRUHVDV 

RXWFRPHVDQGWKHSDWWHUQVRIILQGLQJVZHUHVLPLODU 

(IIHFWVRI)LUVW*UDGH7HFKQRORJ\3URGXFWV 

7KH ILUVW JUDGH VWXG\ ZDV EDVHG RQ ILYH UHDGLQJ VRIWZDUH SURGXFWV WKDW ZHUH 

LPSOHPHQWHG LQ GLVWULFWV DQG VFKRROV 7KH VDPSOH LQFOXGHG WHDFKHUV DQG 

VWXGHQWV7KHILYHSURGXFWVZHUH'HVWLQDWLRQ5HDGLQJSXEOLVKHGE\5LYHUGHHSWKH 

:DWHUIRUG (DUO\ 5HDGLQJ 3URJUDP SXEOLVKHG E\ 3HDUVRQ 'LJLWDO /HDUQLQJ +HDGVSURXW 

SXEOLVKHGE\+HDGVSURXW3ODWR)RFXVSXEOLVKHGE\3ODWRDQGWKH$FDGHP\RI5HDGLQJ 

SXEOLVKHGE\$XWRVNLOO 

3URGXFWVSURYLGHGLQVWUXFWLRQDQGGHPRQVWUDWLRQLQWXWRULDOPRGXOHVDOORZHGVWXGHQWV 

WR DSSO\ VNLOOV LQ SUDFWLFH PRGXOHV DQG WHVWHG VWXGHQWV RQ WKHLU DELOLW\ WR DSSO\ VNLOOV LQ 

DVVHVVPHQWPRGXOHV7KHWXWRULDOSUDFWLFHDVVHVVPHQWPRGXODUVWUXFWXUHZDVFRPPRQIRU 

SURGXFWV DW RWKHU JUDGH OHYHOV DV ZHOO 7KHLU IRFXV ZDV RQ LPSURYLQJ VNLOOV LQ OHWWHU 

UHFRJQLWLRQ SKRQHPLF DZDUHQHVV ZRUG UHFRJQLWLRQ DQG ZRUG DWWDFN YRFDEXODU\ EXLOGLQJ 

DQGWH[WFRPSUHKHQVLRQ7KHVWXG\HVWLPDWHGWKHDYHUDJHOLFHQVLQJIHHVIRUWKHSURGXFWVWR 

EHDERXWDVWXGHQWIRUWKHVFKRRO\HDUZLWKDUDQJHRIWR 

$FFRUGLQJ WR UHFRUGV PDLQWDLQHG E\ SURGXFW VRIWZDUH XVDJH E\ LQGLYLGXDO VWXGHQWV 

DYHUDJHG DOPRVW KRXUV D \HDU ZKLFK WKH VWXG\ HVWLPDWHG WR EH DERXW SHUFHQW RI 

UHDGLQJ LQVWUXFWLRQDO WLPH 6RPH FRQWURO JURXS WHDFKHUV XVHG WHFKQRORJ\EDVHG UHDGLQJ 

SURGXFWVWKDWZHUHQRWLQWKHVWXG\7KHVHSURGXFWVJHQHUDOO\DOORZHGVWXGHQWVWRSUDFWLFH 

([HFXWLYH6XPPDU\

xx 

YDULRXV VNLOOV 6RIWZDUHEDVHG UHFRUGV RI VWXGHQW XVDJH RI WKHVH RWKHU SURGXFWV ZHUH QRW 

FROOHFWHG EXW FRQWURO WHDFKHUV UHSRUWHG XVLQJ WKHP DERXW D ILIWK DV PXFK DV WUHDWPHQW 

WHDFKHUVUHSRUWHGXVLQJVWXG\SURGXFWV 

)LUVWJUDGHUHDGLQJSURGXFWVGLGQRWDIIHFWWHVWVFRUHVE\DPRXQWVWKDWZHUHVWDWLVWLFDOO\ 

GLIIHUHQWIURP]HUR)LJXUHVKRZVREVHUYHGVFRUHGLIIHUHQFHVRQWKH6$7UHDGLQJWHVW 

DQG)LJXUHVKRZVREVHUYHGVFRUHGLIIHUHQFHVRQWKH7HVWRI:RUG5HDGLQJ(IILFLHQF\7KH 

GLIIHUHQFHVDUHVKRZQLQ´HIIHFWVL]HµXQLWVZKLFKDOORZWKHVWXG\WRFRPSDUHUHVXOWVIRU 

WHVWVZKRVHVFRUHVDUHUHSRUWHGLQGLIIHUHQWXQLWV7KHVWXG\·VSDUWLFXODUPHDVXUHRIHIIHFW 

VL]HLVWKHVFRUHGLIIHUHQFHGLYLGHGE\WKHVWDQGDUGGHYLDWLRQRIWKHFRQWUROJURXSWHVWVFRUH 

(IIHFWVL]HVDUHFRQVLVWHQWIRUWKHWZRWHVWVDQGWKHLUVXEWHVWVLQWKHUDQJHRIWR 

7KHVH HIIHFW VL]HV DUH HTXLYDOHQW WR LQFUHDVHV LQ VWXGHQW SHUFHQWLOH UDQNV RI DERXW WR 

SRLQWV1RQHLVVWDWLVWLFDOO\VLJQLILFDQW 

)LJXUH 

(IIHFWVRI)LUVW*UDGH5HDGLQJ3URGXFWVRQ6$75HDGLQJ6FRUH 

(IIHFW 

6L]H 

 

 

 

 

 

2YHUDOO6FRUH 6RXQGVDQG/HWWHUV :RUG5HDGLQJ 6HQWHQFH5HDGLQJ 

6$75HDGLQJ7HVW 

1RWH1RQHRIWKHHIIHFWVLVVLJQLILFDQWO\GLIIHUHQWIURP]HURDWWKHOHYHO 

 

Avtˆ…r! 

@ssrp‡†‚sAv…†‡B…hqrSrhqv tQ…‚qˆp‡†‚ Ur†‡‚sX‚…qSrhqv t@ssvpvr p’ 

Tp‚…r 

" 

! 

@ssrp‡ 

Tv“r 

 

 

2YHUDOO6FRUH 

3KRQHPLF'HFRGLQJ 

(IILFLHQF\ 

Ur†‡‚sX‚…qSrhqv t@ssvpvr p’ 

6LJKW:RUG(IILFLHQF\ 

I‚‡r)I‚ r‚s‡urrssrp‡†v††vt vsvph ‡y’qvssr…r ‡s…‚€“r…‚h‡‡ur$yr‰ry 

([HFXWLYH6XPPDU\

xxi 

/DUJHGLIIHUHQFHVLQHIIHFWVZHUHREVHUYHGEHWZHHQVFKRROV%HFDXVHRQO\DIHZWHDFKHUV 

LPSOHPHQWHG SURGXFWV LQ HDFK VFKRRO VDPSOLQJ YDULDQFH WKH DVVLJQPHQW RI WHDFKHUV WR 

WUHDWPHQWDQGFRQWUROJURXSVFDQH[SODLQPXFKRIWKHREVHUYHGGLIIHUHQFHVEXWWKHVWXG\ 

DOVR LQYHVWLJDWHG ZKHWKHU WKH GLIIHUHQFHV ZHUH FRUUHODWHG ZLWK VFKRRO DQG FODVVURRP 

FKDUDFWHULVWLFV 5HODWLRQVKLSV EHWZHHQ VFKRRO DQG FODVVURRP FKDUDFWHULVWLFV DQG VFRUH 

GLIIHUHQFHV FDQQRW EH LQWHUSUHWHG DV FDXVDO EHFDXVH GLVWULFWV DQG VFKRROV YROXQWHHUHG WR 

SDUWLFLSDWHLQWKHVWXG\DQGWRLPSOHPHQWSDUWLFXODUSURGXFWV7KHLUFKDUDFWHULVWLFVPDQ\RI 

ZKLFK WKH VWXG\ GLG QRW REVHUYH PD\ LQIOXHQFH REVHUYHG HIIHFWV )RU ILUVW JUDGH HIIHFWV 

ZHUHODUJHUZKHQVFKRROVKDGVPDOOHUVWXGHQWWHDFKHUUDWLRVDPHDVXUHRIFODVVVL]H2WKHU 

FKDUDFWHULVWLFVLQFOXGLQJWHDFKHUH[SHULHQFHDQGHGXFDWLRQVFKRROUDFLDOHWKQLFFRPSRVLWLRQ 

DQGWKHDPRXQWRIWLPHWKDWSURGXFWVZHUHXVHGGXULQJWKHVFKRRO\HDUZHUHQRWFRUUHODWHG 

ZLWKHIIHFWV 

(IIHFWVRI)RXUWK*UDGH5HDGLQJ3URGXFWV 

7KH IRXUWK JUDGH VWXG\ LQFOXGHG IRXU UHDGLQJ SURGXFWV WKDW ZHUH LPSOHPHQWHG LQ 

QLQHGLVWULFWVDQGVFKRROV7KHVDPSOHLQFOXGHGWHDFKHUVDQGVWXGHQWV7KHIRXU 

SURGXFWV ZHUH /HDSIURJ SXEOLVKHG E\ /HDSWUDFN 5HDG SXEOLVKHG E\ 6FKRODVWLF 

$FDGHP\ RI 5HDGLQJ SXEOLVKHG E\ $XWRVNLOO DQG QRZOHGJH%R[ SXEOLVKHG E\ 3HDUVRQ 

'LJLWDO/HDUQLQJ 

7KUHH RI WKH IRXU SURGXFWV SURYLGHG WXWRULDOV SUDFWLFH DQG DVVHVVPHQW JHDUHG WR 

VSHFLILFUHDGLQJVNLOOVRQHDVDFRUHUHDGLQJFXUULFXOXPDQGWZRDVVXSSOHPHQWVWRWKHFRUH 

FXUULFXOXP7KHIRXUWKSURGXFWRIIHUHGWHDFKHUVDFFHVVWRKXQGUHGVRIGLJLWDOUHVRXUFHVVXFK 

DV WH[W SDVVDJHV YLGHR FOLSV LPDJHV LQWHUQHW VLWHV DQG VRIWZDUH PRGXOHV IURP ZKLFK 

WHDFKHUV FRXOG FKRRVH WR VXSSOHPHQW WKHLU UHDGLQJ FXUULFXOXP 7KH VWXG\ HVWLPDWHG WKH 

DYHUDJHOLFHQVLQJIHHVIRUWKHSURGXFWVWREHDERXWDVWXGHQWIRUWKHVFKRRO\HDUZLWKD 

UDQJHRIWR 

$QQXDOXVDJHE\VWXGHQWVIRUWKHWZRIRXUWKJUDGHSURGXFWVWKDWFROOHFWHGWKLVPHDVXUH 

LQ WKHLU GDWDEDVHV ZDV KRXUV IRU RQH SURGXFW DQG IRU WKH RWKHU $VVXPLQJ D W\SLFDO 

UHDGLQJLQVWUXFWLRQSHULRGZDVPLQXWHVVWXGHQWVXVHGSURGXFWVIRUOHVVWKDQSHUFHQW 

RI UHDGLQJ LQVWUXFWLRQDO WLPH WKLV HVWLPDWH UHIHUV WR WKH FRPSXWHUEDVHG FRPSRQHQW RI 

SURGXFWV 7UHDWPHQW WHDFKHUV DOVR UHSRUWHG VFKHGXOLQJ KRXUV RI XVH RI RWKHU SURGXFWV 

GXULQJ WKH VFKRRO \HDU DQG FRQWURO WHDFKHUV UHSRUWHG VFKHGXOLQJ KRXUV RI XVH RI RWKHU 

SURGXFWV7UHDWPHQWWHDFKHUVDOVRUHSRUWHGVSHQGLQJKRXUPRUHDZHHNWHDFKLQJUHDGLQJ 

WKDQFRQWUROWHDFKHUVWKHLQFUHDVHZDVVWDWLVWLFDOO\VLJQLILFDQW 

)RXUWK JUDGH UHDGLQJ SURGXFWV GLG QRW DIIHFW WHVW VFRUHV E\ DPRXQWV WKDW ZHUH 

VWDWLVWLFDOO\GLIIHUHQWIURP]HUR)LJXUHVKRZVPHDVXUHGHIIHFWVL]HVIRUWKH6$7UHDGLQJ 

WHVWLQHIIHFWVL]HXQLWV 

0RVWVFKRRODQGFODVVURRPFKDUDFWHULVWLFVZHUHQRWFRUUHODWHGZLWKHIIHFWVEXWHIIHFWV 

ZHUH ODUJHU ZKHQ WHDFKHUV UHSRUWHG KLJKHU OHYHOV RI SURGXFW XVH $V QRWHG DERYH WKHVH 

UHODWLRQVKLSVGRQRWKDYHDFDXVDOLQWHUSUHWDWLRQ 

([HFXWLYH6XPPDU\

xxii 

Avtˆ…r" 

@ssrp‡†‚sA‚ˆ…‡uB…hqrSrhqv tQ…‚qˆp‡†‚ T6U Srhqv tTp‚…r 

" 

! 

@ssrp‡ 

Tv“r 

 

 

2YHUDOO6FRUH 9RFDEXODU\ :RUG6WXG\6NLOOV &RPSUHKHQVLRQ 

T6U Srhqv tUr†‡ 

X 

I‚‡r)I‚ r‚s‡urrssrp‡†v††vt vsvph ‡y’qvssr…r ‡s…‚€“r…‚h‡‡ur$yr‰ry 

Y)@†‡v€h‡rv†‡‚‚†€hyy‡‚†u‚ 

(IIHFWVRI6L[WK*UDGH0DWK3URGXFWV 

7KHVL[WKJUDGHVWXG\LQFOXGHGWKUHHSURGXFWVWKDWZHUHLPSOHPHQWHGLQGLVWULFWVDQG 

VFKRROV7KHVDPSOHLQFOXGHGWHDFKHUVDQGVWXGHQWV7KHWKUHHSURGXFWVZHUH 

/DUVRQ 3UH$OJHEUD SXEOLVKHG E\ +RXJKWRQ0LIIOLQ $FKLHYH 1RZ SXEOLVKHG E\ 3ODWR 

DQGL/HDUQ0DWKSXEOLVKHGE\L/HDUQ 

3URGXFWVSURYLGHGWXWRULDODQGSUDFWLFHRSSRUWXQLWLHVDQGDVVHVVHGVWXGHQWVNLOOV7RSLFV 

FRYHUHG LQFOXGH RSHUDWLRQV ZLWK IUDFWLRQV GHFLPDOV DQG SHUFHQWV SODQH DQG FRRUGLQDWH 

JHRPHWU\ UDWLRV UDWHV DQG SURSRUWLRQV RSHUDWLRQV ZLWK ZKROH QXPEHUV DQG LQWHJHUV 

SUREDELOLW\ DQG GDWD DQDO\VLV DQG PHDVXUHPHQW 7ZR SURGXFWV ZHUH VXSSOHPHQWV WR WKH 

PDWK FXUULFXOXP DQG RQH ZDV LQWHQGHG DV D FRUH FXUULFXOXP 7KH VWXG\ HVWLPDWHG WKH 


UDQJHRIWR 

6WXGHQW XVDJH ZDV DERXW KRXUV D \HDU RU DERXW SHUFHQW RI PDWK LQVWUXFWLRQDO 

WLPHDFFRUGLQJWRGDWDIURPSURGXFWUHFRUGVDYDLODEOHIRUWZRRIWKHWKUHHSURGXFWV,Q 

FRQWUROFODVVURRPVWHDFKHUVUHSRUWHGDERXWKRXUVRIXVHRIRWKHUWHFKQRORJ\SURGXFWV 

ZKLFK ZDV PXFK OHVV WKDQ WKH KRXUV RI VWXG\ SURGXFW XVDJH UHSRUWHG E\ WUHDWPHQW 

WHDFKHUV 

6L[WKJUDGHPDWKSURGXFWVGLGQRWDIIHFWWHVWVFRUHVE\DPRXQWVWKDWZHUHVWDWLVWLFDOO\ 

GLIIHUHQWIURP]HURVHH)LJXUH$VZLWKRWKHUSURGXFWVWKHVWXG\REVHUYHGODUJHHIIHFWV 

EHWZHHQ VFKRROV +RZHYHU VWDWLVWLFDO WHVWV LQGLFDWHG WKDW WKH VFKRRO DQG FODVVURRP 

FKDUDFWHULVWLFVPHDVXUHGLQWKHVWXG\ZHUHQRWUHODWHGWRWKHGLIIHUHQFHVLQWHVWVFRUHV 

([HFXWLYH6XPPDU\

xxiii 

)LJXUH 

(IIHFWVRI6L[WK*UDGH0DWK3URGXFWVRQ6$70DWK6FRUH 

 

 

(IIHFW 

6L]H 

 

 

2YHUDOO6FRUH 3URFHGXUHV 3UREOHP6ROYLQJ 

6$70DWK7HVW 


(IIHFWVRI$OJHEUD3URGXFWV 

7KH DOJHEUD VWXG\ LQFOXGHG WKUHH SURGXFWV WKDW ZHUH LPSOHPHQWHG LQ GLVWULFWV DQG 

VFKRROV7KHVDPSOHLQFOXGHGFODVVURRPVDQGVWXGHQWV7KHWKUHHSURGXFWVZHUH 

&RJQLWLYH 7XWRU $OJHEUD SXEOLVKHG E\ &DUQHJLH /HDUQLQJ 3ODWR $OJHEUD SXEOLVKHG E\ 

3ODWRDQG/DUVRQ$OJHEUDSXEOLVKHGE\+RXJKWRQ0LIIOLQ 

3URGXFWVFRYHUHGDFRQYHQWLRQDOUDQJHRIDOJHEUDWRSLFV7KH\LQFOXGHGIXQFWLRQVOLQHDU 

HTXDWLRQVDQGLQHTXDOLWLHVTXDGUDWLFHTXDWLRQVOLQHDUH[SUHVVLRQVSRO\QRPLDOVDQGVRRQ 

2QHSURGXFWFRQVWLWXWHGDIXOOFXUULFXOXPDQGWKHPDMRULW\RILWVDFWLYLWLHVZHUHFDUULHGRXW 

LQ´RIIOLQHµFODVVSHULRGV7KHRWKHUWZRZHUHVXSSOHPHQWVWRWKHUHJXODUFXUULFXOXP7KH 

VWXG\HVWLPDWHGWKHDYHUDJHOLFHQVLQJIHHVIRUWKHSURGXFWVWREHDERXWDVWXGHQWIRUWKH 

VFKRRO\HDUZLWKDUDQJHRIWR 

3URGXFW UHFRUGV VKRZHG WKDW VWXGHQW XVDJH ZDV KRXUV IRU WKH RYHUDOO VDPSOH 

HTXLYDOHQW WR DERXW SHUFHQW RI PDWK LQVWUXFWLRQDO WLPH 8VDJH DYHUDJHG WR KRXUV 

GHSHQGLQJRQWKHSURGXFW 

$OJHEUDSURGXFWVGLGQRWDIIHFWWHVWVFRUHVE\DPRXQWVWKDWZHUHVWDWLVWLFDOO\GLIIHUHQW 

IURP]HURVHH)LJXUH$VZLWKSURGXFWVLQWKHRWKHUJUDGHOHYHOVWKHVWXG\REVHUYHGODUJH 

GLIIHUHQFHV LQ HIIHFWV EHWZHHQ VFKRROV EXW VWDWLVWLFDO WHVWV LQGLFDWHG WKDW WKH VFKRRO DQG 

FODVVURRPFKDUDFWHULVWLFVPHDVXUHGLQWKHVWXG\ZHUHQRWUHODWHGWRWKHVHGLIIHUHQFHV 

)LJXUH 

(IIHFWVRI$OJHEUD3URGXFWVRQ(76$OJHEUD([DP 

 

 

(IIHFW 

6L]H 

 

 

 

 

2YHUDOO &RQFHSWV 3URFHVVHV 6NLOOV 


([HFXWLYH6XPPDU\

xxiv 

6XPPDU\ 

&RQJUHVVSRVHGTXHVWLRQVDERXWWKHHIIHFWLYHQHVVRIHGXFDWLRQDOWHFKQRORJ\DQGKRZ 

HIIHFWLYHQHVV LV UHODWHG WR FRQGLWLRQV DQG SUDFWLFHV 7KH VWXG\ LGHQWLILHG UHDGLQJ DQG 

PDWKHPDWLFVVRIWZDUHSURGXFWVEDVHGRQSULRUHYLGHQFHRIHIIHFWLYHQHVVDQGRWKHUFULWHULD 

DQGUHFUXLWHGGLVWULFWVVFKRROVDQGWHDFKHUVWRLPSOHPHQWWKHSURGXFWV2QDYHUDJHDIWHU 

RQH\HDUSURGXFWVGLGQRWLQFUHDVHRUGHFUHDVHWHVWVFRUHVE\DPRXQWVWKDWZHUHVWDWLVWLFDOO\ 

GLIIHUHQWIURP]HUR 

)RU ILUVW DQG IRXUWK JUDGH UHDGLQJ SURGXFWV WKH VWXG\ IRXQG VHYHUDO VFKRRO DQG 

FODVVURRP FKDUDFWHULVWLFV WKDW ZHUH FRUUHODWHG ZLWK HIIHFWLYHQHVV LQFOXGLQJ VWXGHQWWHDFKHU 

UDWLRVIRUILUVWJUDGHDQGWKHDPRXQWRIWLPHSURGXFWVZHUHXVHGIRUIRXUWKJUDGH7KH 

VWXG\GLGQRWILQGFKDUDFWHULVWLFVUHODWHGWRHIIHFWLYHQHVVIRUVL[WKJUDGHPDWKRUDOJHEUD7KH 

VWXG\DOVRIRXQGWKDWSURGXFWVFDXVHGWHDFKHUVWREHOHVVOLNHO\WROHFWXUHDQGPRUHOLNHO\WR 

IDFLOLWDWHZKLOHVWXGHQWVXVLQJUHDGLQJRUPDWKHPDWLFVVRIWZDUHSURGXFWVZHUHPRUHOLNHO\WR 

EHZRUNLQJRQWKHLURZQ 

7KHUHVXOWVUHSRUWHGKHUHDUHEDVHGRQ VFKRROVDQGWHDFKHUVZKRZHUHQRWXVLQJWKH 

SURGXFWVLQWKHSUHYLRXV VFKRRO\HDU:KHWKHUSURGXFWVDUHPRUHHIIHFWLYHZKHQWHDFKHUV 

KDYHPRUHH[SHULHQFHXVLQJWKHPLVEHLQJH[DPLQHGZLWKDVHFRQG\HDURIGDWD7KHVWXG\ 

ZLOO LQYROYH WHDFKHUV ZKR ZHUH LQ WKH ILUVW GDWD FROOHFWLRQ WKRVH ZKR DUH WHDFKLQJ LQ WKH 

VDPHVFKRRODQGDWWKHVDPHJUDGHOHYHORUVXEMHFWDUHDDQGDQHZJURXSRIVWXGHQWV7KH 

VHFRQG\HDUVWXG\ZLOODOVRUHSRUWUHVXOWVVHSDUDWHO\IRUWKHYDULRXVSURGXFWV 

 

 

([HFXWLYH6XPPDU\

&KDSWHU, 

 

,QWURGXFWLRQ 

, 

QWKH1R&KLOG/HIW%HKLQG$FWRI&RQJUHVVFDOOHGIRUDULJRURXVVWXG\RIWKH 

HIIHFWLYHQHVV RI HGXFDWLRQDO WHFKQRORJ\ IRU LPSURYLQJ VWXGHQW DFDGHPLF DFKLHYHPHQW 

7KHFDOOIRUWKHVWXG\ZDVFRQVLVWHQWZLWKWKHJURZLQJXVHRIFRPSXWHUVLQFODVVURRPV 

GHPDQGV IRU DFFRXQWDELOLW\ LQ SXEOLF VSHQGLQJ DQG WKH $FW·V HPSKDVLV RQ XVLQJ ULJRURXV 

UHVHDUFKPHWKRGVWRVWXG\HIIHFWLYHQHVV7KLVUHSRUWSUHVHQWVILQGLQJVIURPWKHVWXG\·VILUVW 

\HDURISURGXFWLPSOHPHQWDWLRQDQGGDWDFROOHFWLRQZKLFKFRUUHVSRQGHGWRWKH 

VFKRRO\HDU 

$ 5HVHDUFKRQWKH(IIHFWLYHQHVVRI5HDGLQJDQG0DWKHPDWLFV6RIWZDUH 

 

8VHRIVRIWZDUHWRKHOSWHDFKUHDGLQJDQGPDWKHPDWLFVVNLOOVLVFRPPRQLQ$PHULFDQ 

VFKRROV ,Q WKH ODWH QLQHWLHV SHUFHQW RI HOHPHQWDU\ VFKRRO WHDFKHUV UHSRUWHG XVLQJ 

VRIWZDUHSURGXFWVGHVLJQHGWRWHDFK(QJOLVKDQGODQJXDJHDUWVVNLOOV6LPLODUO\SHUFHQWRI 

HOHPHQWDU\VFKRROWHDFKHUVSHUFHQWRIPLGGOH VFKRROWHDFKHUVDQG SHUFHQWRIKLJK 

VFKRRO WHDFKHUV UHSRUWHG XVLQJ SURGXFWV GHVLJQHG WR WHDFK PDWK VNLOOV $QGHUVRQ DQG 

5RQQNYLVW 

 

2YHU WKH SDVW WZR GHFDGHV QXPHURXV VWXGLHV FRPSDULQJ FRPSXWHUEDVHG DQG 

FRQYHQWLRQDOLQVWUXFWLRQLQUHDGLQJDQGPDWKHPDWLFVKDYHEHHQFRQGXFWHG%RWKTXDOLWDWLYH 

UHVHDUFK V\QWKHVHV 6FKDFWHU 6LYLQDFKDOD DQG IRUPDO PHWDDQDO\VHV RI WKHVH 

VWXGLHV%ORNHWDOXOLNDQGXOLNXOLNXOLN0XUSK\HWDO 

3HDUVRQHWDO:D[PDQHWDOIRXQGWKDWFRPSXWHUDVVLVWHGLQVWUXFWLRQLQUHDGLQJ 

DQG PDWKHPDWLFV JHQHUDOO\ KDG D SRVLWLYH HIIHFW XOLN·V PHWDDQDO\VLV IRU H[DPSOH 

IRXQG D SRVLWLYH HIIHFW RQ ILQDO H[DPLQDWLRQ VFRUHV WKH HIIHFW VL]H³WKH HIIHFW DV D 

SURSRUWLRQRIWKHVWDQGDUGGHYLDWLRQRIH[DPLQDWLRQVFRUHV³ZDV 

 

0XUSK\ HW DO H[DPLQHG D ZLGH UDQJH RI UHVHDUFK VWXGLHV IURP WKH SXEOLVKHG 

OLWHUDWXUHDQGIURPVRIWZDUHYHQGRUV2IWKHH[SHULPHQWDORUTXDVLH[SHULPHQWDOVWXGLHV 

FRQGXFWHG EHWZHHQ DQG WKDW PHW WKH FULWHULD IRU LQFOXVLRQ VWXGLHV PHW 

PLQLPXP PHWKRGRORJLFDO UHTXLUHPHQWV IRU LQFOXVLRQ LQ WKH V\QWKHVLV )RU WKHVH VWXGLHV 

UHVHDUFKHUVHVWLPDWHGDQDYHUDJHHIIHFWVL]HRIIRUUHDGLQJDQGIRUPDWKHPDWLFV

2 

'HVSLWH WKH IDLUO\ VL]DEOH QXPEHU RI VWXGLHV DQG JHQHUDOO\ SRVLWLYH ILQGLQJV PHWD 

DQDO\VWVKDYHQRWHGWKDWPDQ\VWXGLHVFRQWDLQHGZHDNQHVVHVRUGHVLJQIODZV0XUSK\HWDO 

3HDUVRQHWDO2IWKHWHFKQRORJ\VWXGLHVUHYLHZHGE\:D[PDQHWDOIRU 

H[DPSOH KDOI KDG VDPSOH VL]HV RI IHZHU WKDQ VWXGHQWV 0DQ\ VWXGLHV KDG QR FRQWURO 

JURXSV RU HTXLYDOHQW FRPSDULVRQ JURXSV OHDGLQJ WR TXHVWLRQDEOH YDOLGLW\ IRU FODLPV RI 

HIIHFWV6WXGLHVZLWKVWURQJHUUHVHDUFKGHVLJQVVKRZHGVPDOOHUHIIHFWV3HDUVRQHWDO 

 

6HYHUDO UHFHQW H[SHULPHQWDO VWXGLHV H[DPLQHG SURGXFW HIIHFWLYHQHVV DQG UHDFKHG 

GLIIHUHQWFRQFOXVLRQV5RXVHDQGUXHJHUHYDOXDWHGWKHHIIHFWLYHQHVVRI)DVW)RU:RUG 

DVRIWZDUHDSSOLFDWLRQEDVHGRQDVHWRIH[HUFLVHVWKDWQHXURVFLHQWLVWVKDGIRXQGWRSURGXFH 

GUDPDWLFUHDGLQJJDLQVIRUVRPHFKLOGUHQ0HU]HQLFKHWDO7DOODOHWDO5RXVH 

DQGUXHJHUIRXQGDVPDOOSRVLWLYHHIIHFWIRU)DVW)RU:RUGRQDFRPSXWHUEDVHGPHDVXUHRI 

ODQJXDJHVNLOOVEXWQRHIIHFWRQUHDGLQJDFKLHYHPHQWPHDVXUHGXVLQJDVWDQGDUGL]HGWHVW,Q 

FRQWUDVWLQJ WKHLU ILQGLQJV ZLWK SUHYLRXVO\ UHSRUWHG ILQGLQJV 5RXVH DQG UXHJHU QRWHG 

SUREOHPVLQWKHGHVLJQRIDVWXG\E\UHVHDUFKHUVDIILOLDWHGZLWKWKHFRPSDQ\WKDWGLVWULEXWHV 

)DVW)RU:RUG,QWKDWVWXG\VWXGHQWVZHUHDVVLJQHGUDQGRPO\WRWKHWUHDWPHQWJURXSRUD 

FRQWUROJURXS0LOOHUHWDOEXWVWXGHQWVZKRGLGQRWFRPSOHWHWKHWUHDWPHQWEDVHG 

RQ D GHILQLWLRQ RI FRPSOHWLRQ SURYLGHG E\ WKH SURGXFW YHQGRU ZHUH GURSSHG IURP WKH 

VDPSOHWKHUHE\LQYDOLGDWLQJLWVH[SHULPHQWDOGHVLJQ 

 

,QFRQWUDVWDUDQGRPL]HGILHOGWULDORI$OJHEUD&RJQLWLYH7XWRUUHSRUWHGSRVLWLYHUHVXOWV 

0RUJDQ DQG 5LWWHU ,Q WKH VWXG\ HLJKW MXQLRU KLJK WHDFKHUV WDXJKW VRPH RI WKHLU 

FODVVHVXVLQJWKH&RJQLWLYH7XWRUDQGVRPHXVLQJWKHLUWUDGLWLRQDOWH[WERRN6WXGHQWVLQWKH 

&RJQLWLYH 7XWRU FODVVHV VFRUHG KLJKHU RQ DQ HQGRIFRXUVH DOJHEUD WHVW GHYHORSHG E\ 

(GXFDWLRQDO7HVWLQJ6HUYLFHDQGDOVRUHFHLYHGKLJKHUFRXUVHJUDGHV 

 

6LPLODUO\1XQQHU\HWDOIRXQGSRVLWLYHHIIHFWVIRU$FFHOHUDWHG5HDGHUDVRIWZDUH 

SURGXFWWKDWUHFRPPHQGVUHDGLQJPDWHULDODWDOHYHODSSURSULDWHIRUWKHLQGLYLGXDOVWXGHQW 

DQGSURYLGHVFRPSXWHUEDVHGTXL]]HVWHVWLQJVWXGHQWFRPSUHKHQVLRQRIWKHUHFRPPHQGHG 

PDWHULDOV7KHVWXG\UDQGRPO\DVVLJQHGWHDFKHUVIURPQLQHHOHPHQWDU\VFKRROVLQDODUJH 

XUEDQGLVWULFWWRXVHWKHSURGXFWRUWRDFRQWUROFRQGLWLRQ 

 

7KXV ZKLOH D SUHSRQGHUDQFH RI UHVHDUFK RQ WKH HIIHFWLYHQHVV RI UHDGLQJ DQG PDWK 

VRIWZDUHVXJJHVWVSRVLWLYHHIIHFWVPDQ\VWXGLHVKDYHEHHQVPDOOPHWKRGRORJLFDOO\IODZHGRU 

VSRQVRUHG E\ DQ RUJDQL]DWLRQ ZLWK DQ LQWHUHVW LQ WKH RXWFRPH 0RUH UHFHQW VWXGLHV XVLQJ 

ULJRURXVGHVLJQVKDYH\LHOGHGPL[HGILQGLQJV$JDLQVWWKLVEDFNGURSDODUJHVFDOHVWXG\RI 

HGXFDWLRQDOWHFKQRORJ\SURGXFWVFDQSURYLGHXVHIXOLQIRUPDWLRQDERXWWKHLUHIIHFWLYHQHVV 

% 'HVLJQRIWKH1DWLRQDO6WXG\ 

 

,QIDOOWKH86'HSDUWPHQWRI(GXFDWLRQ('EHJDQZRUNLQJZLWK0DWKHPDWLFD 

3ROLF\ 5HVHDUFK ,QF 035 DQG LWV SDUWQHUV WR GHVLJQ WKH QDWLRQDO VWXG\ FDOOHG IRU E\ 

&RQJUHVVH\UHFRPPHQGDWLRQVIURPWKHGHVLJQHIIRUWZHUHWRIRFXVWKHQDWLRQDOVWXG\RQ 

JUDGHVLQVFKRROVWKDWVHUYHGODUJHSHUFHQWDJHVRIVWXGHQWVLQSRYHUW\WRIRFXVRQWKH 

UHDGLQJDQGPDWKVXEMHFWDUHDVDQGWRXVHVWDQGDUGL]HGWHVWVFRUHVWRPHDVXUHHIIHFWLYHQHVV 

$JRGLQLHWDO7KHGHVLJQHIIRUWDOVRUHFRPPHQGHGWKDWDSXEOLFVXEPLVVLRQVSURFHVV 

,,QWURGXFWLRQ

3 

EH XVHG WR VHOHFW WKH WHFKQRORJ\ SURGXFWV LQFOXGHG LQ WKH HYDOXDWLRQ 7KH VWXG\·V PDLQ 

IHDWXUHVDUHVXPPDUL]HGLQWKHDFFRPSDQ\LQJER[ 

 

7KH OHJLVODWLRQ FDOOHG IRU WKH VWXG\ WR KDYH ´FRQWURO JURXSV RU FRQWURO FRQGLWLRQVµ 

ZKLFKFRQVLVWHQWZLWKFXUUHQWSUDFWLFHZDVLQWHUSUHWHGWRPHDQWKDWWKHVWXG\VKRXOGXVHDQ 

H[SHULPHQWDOGHVLJQ7KHVWXG\XVHGDGHVLJQLQZKLFKWHDFKHUVZKRZHUHQRWXVLQJRQHRI 

WKHVWXG\·VWHFKQRORJ\SURGXFWVYROXQWHHUHGWRSDUWLFLSDWHLQWKHVWXG\:LWKLQHDFKVFKRRO 

WKHVHWHDFKHUVZHUHWKHQUDQGRPO\DVVLJQHGWRHLWKHUDWUHDWPHQWJURXSWKDWKDGDFFHVVWR 

WKHDVVLJQHGSURGXFWRUWRDFRQWUROJURXSWKDWXVHGWKHLUFRQYHQWLRQDOWHDFKLQJDSSURDFKHV 

7KH H[SHULPHQWDO GHVLJQ ZDV WKH EDVLV IRU DQVZHULQJ WKH VWXG\·V PDLQ TXHVWLRQ ´'R 

VWXGHQWVDFKLHYHPRUHZKHQWHDFKHUVDUHDEOHWRXVHWKHVHOHFWHGWHFKQRORJ\SURGXFWVWKDQ 

ZKHQ WKH\ GR QRW"µ %HFDXVH WKH RQO\ GLIIHUHQFH RQ DYHUDJH EHWZHHQ JURXSV LV ZKHWKHU 

WHDFKHUV ZHUH DVVLJQHG WR XVH SURGXFWV VHOHFWHG IRU WKH VWXG\ VFRUH GLIIHUHQFHV FRXOG EH 

DWWULEXWHG DV HIIHFWV RI WKH SURGXFWV DIWHU DFFRXQWLQJ IRU VDPSOLQJ YDULDELOLW\ 6FRUH 

GLIIHUHQFHV FRXOG EH DIIHFWHG E\ ZKHWKHU FRQWURO JURXS WHDFKHUV XVHG RWKHU WHFKQRORJ\ 

SURGXFWVWKDWZHUHQRWDPRQJWKRVHVHOHFWHGIRUWKHVWXG\DQLVVXHWKDWZDVUHFRJQL]HGLQ 

WKHGHVLJQDQGZLOOEHDGGUHVVHGLQWKHDQDO\VLV 

 

7KHVWXG\·VPDLQTXHVWLRQLVHTXLYDOHQWWRWKHTXHVWLRQIDFHGE\VFKRROGLVWULFWVZDQWLQJ 

WRUDLVHVWXGHQWWHVWVFRUHVDQGFRQVLGHULQJLQYHVWLQJLQDWHFKQRORJ\SURGXFWWRGRVR'RHV 

SXUFKDVLQJ WKH SURGXFW OHDG WR KLJKHU VFRUHV" 7KH VWXG\ WHVWHG ZKHWKHU VWXGHQWV LQ 

FODVVURRPVRIWUHDWPHQWJURXSWHDFKHUVZKRZHUHDEOHWRXVHSURGXFWVVHOHFWHGWREHLQWKH 

VWXG\SHUIRUPHGEHWWHURUZRUVHWKDQVWXGHQWVLQFODVVURRPVRIFRQWUROJURXSWHDFKHUVZKR 

ZHUH QRW DEOH WR XVH WKRVH SDUWLFXODU SURGXFWV EXW PD\ KDYH XVHG RWKHU SURGXFWV ,Q 

 

6WXG\'HVLJQ 

,QWHUYHQWLRQ6L[WHHQSURGXFWVZHUHVHOHFWHGE\('EDVHGRQSXEOLFVXEPLVVLRQVDQGUDWLQJVE\WKHVWXG\ 

WHDPDQGH[SHUWUHYLHZSDQHOV3URGXFWVZHUHJURXSHGLQWRIRXUDUHDVILUVWJUDGHUHDGLQJIRXUWKJUDGH 

UHDGLQJVL[WKJUDGHPDWKDQGDOJHEUD 

 

3DUWLFLSDQWV7KLUW\WKUHHGLVWULFWVVFKRROVDQGWHDFKHUVSDUWLFLSDWHGLQWKHVWXG\,QILUVWJUDGH 

GLVWULFWV VFKRROV DQG WHDFKHUV SDUWLFLSDWHG ,Q IRXUWK JUDGH GLVWULFWV VFKRROV DQG 

WHDFKHUV SDUWLFLSDWHG ,Q VL[WK JUDGH GLVWULFWV VFKRROV DQG WHDFKHUV YROXQWHHUHG DQG IRU 

DOJHEUDGLVWULFWVVFKRROVDQGWHDFKHUVSDUWLFLSDWHG'LVWULFWVDQGVFKRROVFRXOGSDUWLFLSDWHLQWKH 

VWXG\DWPRUHWKDQRQHJUDGHOHYHODQGVRPHGLG'LVWULFWVZHUHUHFUXLWHGRQWKHEDVLVWKDWWKH\GLGQRW 

DOUHDG\XVHWHFKQRORJ\SURGXFWVWKDWZHUHVLPLODUWRVWXG\SURGXFWVLQSDUWLFLSDWLQJVFKRROV 

 

5HVHDUFK 'HVLJQ :LWKLQ HDFK VFKRRO WHDFKHUV ZHUH UDQGRPO\ DVVLJQHG WR EH DEOH WR XVH WKH VWXG\ 

SURGXFWWKHWUHDWPHQWJURXSRUQRWWKHFRQWUROJURXS&RQWUROJURXSWHDFKHUVZHUHDEOHWRXVHRWKHU 

WHFKQRORJ\SURGXFWVWKDWPD\KDYHEHHQLQWKHLUFODVVURRPV7KHVWXG\DGPLQLVWHUHGWHVWVWRVWXGHQWVLQ 

ERWKW\SHVRIFODVVURRPVQHDUWKHEHJLQQLQJDQGHQGRIWKHVFKRRO\HDU7KHVWXG\DOVRREVHUYHGWUHDWPHQW 

DQGFRQWUROFODVVURRPVWKUHHWLPHVGXULQJWKHVFKRRO\HDUDQGFROOHFWHGGDWDIURPWHDFKHUTXHVWLRQQDLUHV 

DQGLQWHUYLHZVVWXGHQWUHFRUGVDQGSURGXFWUHFRUGV 

 

2XWFRPHV$QDO\]HG6WXGHQWWHVWVFRUHVFODVVURRPDFWLYLWLHVDQGUROHVRIWHDFKHUVDQGVWXGHQWV 

,,QWURGXFWLRQ

4 

DGRSWLQJ WKLV DSSURDFK WKH QDWLRQDO VWXG\·V GHVLJQ HVVHQWLDOO\ LV VLPLODU WR WKH GHVLJQV RI 

PDQ\VWXGLHVRISURGXFWHIIHFWLYHQHVVFLWHGDERYH 

 

7KHVWXG\WHVWVZKHWKHUVHOHFWHGUHDGLQJDQGPDWKHPDWLFVSURGXFWVDUHHIIHFWLYHZKHQ 

GLVWULFWVYROXQWHHUWRSDUWLFLSDWHDQGVFKRROVDQGWHDFKHUVYROXQWHHUWRLPSOHPHQWSURGXFWV 

7KHYROXQWDU\DVSHFWRIWKHVWXG\DQGWKHIDFWWKDWGLVWULFWVDQGVFKRROVZHUHSDUWLFLSDWLQJLQ 

DVWXG\PD\LQWURGXFHDGLIIHUHQFHEHWZHHQPHDVXUHGHIIHFWLYHQHVVUHSRUWHGE\WKHVWXG\ 

HIIHFWLYHQHVV LQ DFWXDO XVH DQG HIIHFWLYHQHVV UHSRUWHG E\ RWKHU VWXGLHV )RU H[DPSOH 

HIIHFWLYHQHVV DV PHDVXUHG E\ WKLV VWXG\ PLJKW EH KLJKHU WKDQ HIIHFWLYHQHVV LQ DFWXDO XVH 

EHFDXVH VFKRROV DQG WHDFKHUV YROXQWHHUHG IRU WKH VWXG\ DQG WKH VWXG\ DOVR SXUFKDVHG 

VRIWZDUHDQGKDUGZDUHIRUFODVVURRPVDQGVFKRROVZKHQXSJUDGHVZHUHQHHGHGIRUSURGXFWV 

WRRSHUDWH,QDFWXDOXVHSURGXFWVPLJKWEHSODFHGLQFODVVURRPVRIWHDFKHUVZKRGRQRW 

ZDQWWRXVHWKHPDQGPD\QRWXVHWKHPHIIHFWLYHO\ZKLFKSUHVXPDEO\ZRXOGLPSO\ORZHU 

OHYHOVRIHIIHFWLYHQHVV 

 

(IIHFWLYHQHVVDVPHDVXUHGE\WKHVWXG\PLJKWEHORZHUWKDQHIIHFWLYHQHVVUHSRUWHGE\ 

RWKHU VWXGLHV EHFDXVH SURGXFWV ZHUH LPSOHPHQWHG E\ WHDFKHUV ZKR KDG QRW XVHG WKHVH 

SURGXFWVEHIRUH$VODWHUFKDSWHUVQRWHVRPHVFKRROVDQGFODVVURRPVHQFRXQWHUHGYDULRXV 

GLIILFXOWLHV LQ VWDUWLQJ WR XVH RU FRQWLQXLQJ WR XVH SURGXFWV 7HDFKHUV FRXOG VWRS XVLQJ 

SURGXFWVRUUHGXFHWKHLUXVHLIWHDFKHUVEHOLHYHGSURGXFWVZHUHLQHIIHFWLYHRUGLIILFXOWWRXVH 

RU WKH\ FRXOG XVH SURGXFWV LQ ZD\V WKDW YHQGRUV PD\ QRW KDYH LQWHQGHG RU SUHGLFWHG 

7HDFKHUVLQFRQWUROFODVVURRPVGLGQRWKDYHDFFHVVWRSURGXFWVLQWKHVWXG\EXWFRXOGXVH 

FRPSXWHUV LQ RWKHU ZD\V VXFK DV IRU ZHE EURZVLQJ IRU RIILFHUHODWHG IXQFWLRQV DQG WR 

RSHUDWHRWKHUSURGXFWV/DWHUFKDSWHUVDQDO\]HWKHH[WHQWWRZKLFKWKH\GLGVR 

(IIHFWLYHQHVVDVPHDVXUHGE\WKHVWXG\PLJKWEHORZHUWKDQZKDWKDVEHHQUHSRUWHGE\ 

RWKHU VWXGLHV EHFDXVH WKLV VWXG\ XVHG DQ H[SHULPHQWDO GHVLJQ %HFDXVH WHDFKHUV ZHUH 

UDQGRPO\DVVLJQHGDVSDUWRIWKHH[SHULPHQWIDFWRUVWKDWPD\KDYHSUHGLVSRVHGWHDFKHUVWR 

XVH SURGXFWV PRUH HIIHFWLYHO\ DQG WKDW FRQIRXQG DFWXDO HIIHFWLYHQHVV ZLWK WHDFKHU 

FKDUDFWHULVWLFVDUHFRQWUROOHGE\WKHH[SHULPHQWDOGHVLJQ 

6HOHFWLQJ3URGXFWVIRUWKH(YDOXDWLRQ 

,QIDOOGHYHORSHUVDQGYHQGRUVRIHGXFDWLRQDOWHFKQRORJ\SURGXFWVUHVSRQGHGWRD 

SXEOLFLQYLWDWLRQDQGVXEPLWWHGSURGXFWVIRUSRVVLEOHLQFOXVLRQLQWKHQDWLRQDOVWXG\035 

VWDIIVHOHFWHGRIWKHVXEPLVVLRQVIRUIXUWKHUUHYLHZE\WZRSDQHOVRIRXWVLGHH[SHUWV 

RQHIRUUHDGLQJSURGXFWVDQGRQHIRUPDWKSURGXFWV7KHWKUHHPDLQFULWHULDRIWKHUHYLHZV 

ZHUHZKHWKHUWKHSURGXFWKDGHYLGHQFHRIHIIHFWLYHQHVVDQGUHODWHGWRWKLVWKHYDOLGLW\RI 

WKH HYLGHQFH ZKHWKHU WKH SURGXFW ZDV DEOH WR RSHUDWH RQ D QDWLRQDO VFDOH DQG ZKHWKHU 

SURGXFW GHYHORSHUV FRXOG WUDLQ DQ DGHTXDWH QXPEHU RI WHDFKHUV IRU WKH QDWLRQDO VWXG\·V 

1 $QRWKHUSRVVLEOHWHVWRIWHFKQRORJ\·VHIIHFWLYHQHVVZRXOGEHWRLQWURGXFHFRPSXWHUVWKHKDUGZDUHSDUW 

RIHGXFDWLRQDOWHFKQRORJ\LQFODVVURRPVDQGDVVHVVZKHWKHUWHVWVFRUHVRURWKHUPHDVXUHVRIVWXGHQWOHDUQLQJ 

LQFUHDVH$QVZHULQJWKLVTXHVWLRQZRXOGKDYHUHTXLUHGIRFXVLQJWKHVWXG\RQWKHVPDOOQXPEHURIVFKRROVDQG 

FODVVURRPV WKDW KDG QRW \HW LQWURGXFHG FRPSXWHUV ZKLFK ZRXOG UHGXFH WKH VWXG\·V UHOHYDQFH WR WKH PXFK 

ODUJHUQXPEHURIVFKRROVWKDWDOUHDG\XVHGFRPSXWHUV 

,,QWURGXFWLRQ

5 

VDPSOH VL]HV 7KH SDQHOV GLG QRW UHYLHZ DQG FRPSDUH WKH LQVWUXFWLRQDO IHDWXUHV RI WKH 

SURGXFWV 035 LQIRUPHG WKH SDQHO PHPEHUV WKDW WKH\ ZHUH QRW OLPLWHG WR 035·V OLVW RI 

SURGXFWVEXWFRXOGUHYLHZDQ\RIWKHVXEPLVVLRQV 

 

,Q-DQXDU\('FRQVLGHUHGWKHSDQHO·VUHFRPPHQGDWLRQVDQGVHOHFWHGSURGXFWV 

IRUWKHVWXG\,QVHOHFWLQJSURGXFWV('JURXSHGWKHPLQWRIRXUDUHDVHDUO\UHDGLQJILUVW 

JUDGH UHDGLQJ FRPSUHKHQVLRQ IRXUWK JUDGH SUHDOJHEUD VL[WK JUDGH DQG 

DOJHEUDQLQWKJUDGH 7KHSURGXFWVUDQJHGZLGHO\LQWKHLULQVWUXFWLRQDODSSURDFKHVDQG 

KRZ ORQJ WKH\ KDG EHHQ LQ XVH ,Q JHQHUDO KRZHYHU WKH FULWHULD ZHLJKWHG WKH VHOHFWLRQ 

WRZDUG SURGXFWV WKDW KDG HYLGHQFH RI HIIHFWLYHQHVV IURP SUHYLRXV UHVHDUFK RU IRU QHZHU 

SURGXFWV HYLGHQFH WKDW WKHLU GHVLJQV ZHUH EDVHG RQ DSSURDFKHV IRXQG WR EH HIIHFWLYH 

E\UHVHDUFK7ZHOYHRIWKHSURGXFWVKDGUHFHLYHGDZDUGVRUEHHQQRPLQDWHGIRUDZDUGV 

VRPHDVUHFHQWO\DVE\WUDGHDVVRFLDWLRQVPHGLDWHDFKHUVRUSDUHQWV7KHVWXG\GLG 

QRW GHWHUPLQH WKH WRWDO QXPEHU RI VFKRROV WHDFKHUV DQG VWXGHQWV FXUUHQWO\ XVLQJ WKH 

SURGXFWV 

 

,QWKHVXEPLVVLRQSURFHVV('LQIRUPHGGHYHORSHUVWKDWWKHVWXG\ZRXOGIRFXVRQWKH 

DYHUDJH HIIHFWLYHQHVV RI UHDGLQJ DQG PDWKHPDWLFV VRIWZDUH SURGXFWV UDWKHU WKDQ RQ WKH 

HIIHFWLYHQHVV RI LQGLYLGXDO SURGXFWV 7KH LQWHQW ZDV WR PHDVXUH ZKHWKHU WHFKQRORJ\ DV 

UHSUHVHQWHGE\WKHVHOHFWHGUHDGLQJDQGPDWKHPDWLFVVRIWZDUHSURGXFWVLPSURYHGDFDGHPLF 

DFKLHYHPHQWUDWKHUWKDQKRZLQGLYLGXDOSURGXFWVLQFUHDVHGDFKLHYHPHQW7KHPDLQILQGLQJV 

IURPWKHQDWLRQDOVWXG\ZHUHWREHEDVHGRQWKHFRPELQHGSURGXFWUHVXOWVDWHDFKRIWKH 

IRXUJUDGHOHYHOV 

 

7KHYROXQWDU\DVSHFWRIFRPSDQ\SDUWLFLSDWLRQLQWKHVWXG\PHDQWWKDWSURGXFWVPD\ 

QRW EH D UHSUHVHQWDWLYH VDPSOLQJ RI UHDGLQJ DQG PDWK WHFKQRORJ\ SURGXFWV WKDW VFKRROV 

FRXOGSXUFKDVHRUXVH1RWDOOSURGXFWVZHUHVXEPLWWHGIRUSRWHQWLDOLQFOXVLRQLQWKHVWXG\ 

DQGPRVWSURGXFWVWKDWZHUHVXEPLWWHGZHUHQRWVHOHFWHG3URGXFWVWKDWZHUHVHOHFWHGPD\ 

KDYHEHHQPRUHHIIHFWLYHWKDQWKHDYHUDJHSURGXFWEHFDXVHVHOHFWHGSURGXFWVZHUHDEOHWR 

SURYLGH DW OHDVW VRPH HYLGHQFH RI HIIHFWLYHQHVV IURP SUHYLRXV UHVHDUFK RU D SURRI RI 

FRQFHSW('UHFRJQL]HGWKDWVHOHFWLQJRVWHQVLEO\PRUHHIIHFWLYHSURGXFWVSRVVLEO\WLOWHGWKH 

VWXG\WRZDUGILQGLQJKLJKHUOHYHOVRIHIIHFWLYHQHVVEXWWKHWLOWZDVYLHZHGDVDUHDVRQDEOH 

WUDGHRIIWRDYRLGLQYHVWLQJWKHVWXG\·VUHVRXUFHVLQSURGXFWVWKDWKDGOLWWOHRUQRHYLGHQFH 

RIHIIHFWLYHQHVV 

& 5HFUXLWLQJ'LVWULFWVDQG6FKRROVIRUWKH6WXG\ 

6DPSOHVL]HWDUJHWVZHUHVHWVRWKDWWKHVWXG\FRXOGGHWHFWDQHIIHFWVL]HRQWHVWVFRUHV 

RIDWOHDVWDWHDFKRILWVIRXUJUDGHOHYHOV$JRGLQLHWDO7KLVWDUJHWHIIHFWVL]HZDV 

DEDODQFHEHWZHHQWKHGHVLUHIRULQWHUYHQWLRQVWRVXEVWDQWLDOO\FORVHDFKLHYHPHQWJDSVDQG 

WKH UHDOLW\ WKDW IHZ ODUJHVFDOH HGXFDWLRQ HYDOXDWLRQV KDYH IRXQG HIIHFWV ODUJHU WKDQ WKH 

 

$OWKRXJKPDQ\VWXGHQWVWDNHDOJHEUDLQWKHLUILUVW\HDURIKLJKVFKRROGLVWULFWVLQFUHDVLQJO\DUHPRYLQJWR 

KDYHVWXGHQWVWDNHDOJHEUDLQHLJKWKJUDGH6WXGHQWVLQXSSHU\HDUVRIKLJKVFKRRODOVRFDQWDNHDOJHEUD 

,,QWURGXFWLRQ

6 

WDUJHW 7KH WHDP HVWLPDWHG WKDW WKH VWXG\ QHHGHG WR LQFOXGH DERXW VFKRROV 7KHVH 

VFKRROVLWZDVHVWLPDWHGZRXOG\LHOGFODVVURRPVLQHDFKJUDGHOHYHO$VVXPLQJD 

WHDFKHUKDGDQDYHUDJHRIVWXGHQWVWKHVDPSOHVL]HWDUJHWZDVLQHDFKJUDGHOHYHO 

 

7REHFRQVLVWHQWZLWKWKH1R&KLOG/HIW%HKLQGOHJLVODWLRQDQGWRVXSSRUWRWKHUVWXG\ 

REMHFWLYHV WKH VWXG\ XVHG WKUHH FULWHULD WR LGHQWLI\ SRWHQWLDO GLVWULFWV DQG VFKRROV 

JHRJUDSKLFDOGLYHUVLW\KLJKSRYHUW\ UDWHVDQGHQRXJKWHDFKHUVYROXQWHHULQJIRU 

WKHVWXG\$VDJHQHUDOJXLGHOLQHWKHVWXG\ZDQWHGJHRJUDSKLFDOO\GLYHUVHGLVWULFWV7KHVWXG\ 

DOVRZDQWHGGLVWULFWVWKDWKDGVL[RUPRUHVFKRROVUHFHLYLQJ7LWOH,IXQGVDQGZLWKLQGLVWULFWV 

VFKRROVWKDWKDGKLJKSRYHUW\UDWHV'LVFUHWLRQZDVH[HUFLVHGIRUVPDOOGLVWULFWVZKLFKPD\ 

KDYH KDG IHZHU WKDQ VL[ VFKRROV 7KH SRYHUW\ UDWH RI D VFKRRO ZDV QRW WKH RQO\ IDFWRU 

FRQVLGHUHGEHFDXVHVRPHVFKRROVZLWKKLJKSRYHUW\UDWHVPD\KDYHEHHQLQDSSURSULDWHIRU 

RWKHUUHDVRQVVXFKDVDODFNRIWHFKQRORJ\LQIUDVWUXFWXUHRUDODFNRILQWHUHVWLQSDUWLFLSDWLQJ 

LQ WKH VWXG\ 6FKRROV DOVR QHHGHG WR KDYH DW OHDVW WZR YROXQWHHULQJ WHDFKHUV DW WKH 

DSSURSULDWHJUDGHRUVXEMHFWVRWKDWUDQGRPDVVLJQPHQWRIWHDFKHUVZLWKLQHDFKVFKRROFRXOG 

EHLPSOHPHQWHG 

 

,Q)HEUXDU\WKHVWXG\VWDIIEHJDQFRQWDFWLQJVFKRROGLVWULFWVWROHDUQZKHWKHUWKH\ 

ZHUH LQWHUHVWHG LQ SDUWLFLSDWLQJ LQ WKH VWXG\ DQG PHW WKH VWXG\ FULWHULD 'HYHORSHUV 

QRPLQDWHGDERXWSHUFHQWRIWKHDOPRVWGLVWULFWVWKDWWKHVWXG\WHDPFRQWDFWHG2WKHU 

QRPLQDWLRQVFDPHIURPSUHYLRXVFRQWDFWVZLWKWKHVWXG\WHDPDQGIURPVHOIQRPLQDWLRQVE\ 

GLVWULFWVDQGVFKRROVWKDWKDGOHDUQHGDERXWWKHVWXG\IURPDUWLFOHVLQWKHPHGLD6WXG\VWDII 

YLVLWHGPRVWRIWKHGLVWULFWVWKDWH[SUHVVHGLQWHUHVWLQSDUWLFLSDWLQJLQWKHVWXG\WRGHVFULEHLW 

DQGWRDQVZHUTXHVWLRQV,QLQWHUHVWHGGLVWULFWVDGPLQLVWUDWRUVZRUNHGZLWKLQWKHGLVWULFWWR 

LGHQWLI\VFKRROVVXLWDEOHIRUWKHVWXG\ 

 

$VQRWHGDERYHWKHVWXG\FRQVLGHUHGVFKRROVWREHPRUHGHVLUDEOHIRUWKHVWXG\LIWKHLU 

WHDFKHUVZHUHQRWDOUHDG\XVLQJWKHUHDGLQJDQGPDWKHPDWLFVVRIWZDUHSURGXFWVLQWKHVWXG\ 

RUFORVHVXEVWLWXWHVIRUWKHP&ODVVURRPVLQZKLFKWKHUHZHUHORZLQWHQVLW\FRPSXWHUXVHV 

VXFKDVZRUGSURFHVVLQJRUZHEEURZVLQJZHUHPRUHGHVLUDEOHEHFDXVHWKHLQWURGXFWLRQRID 

VWXG\SURGXFWZRXOGLQFUHDVHWKHLQWHQVLW\RIWHFKQRORJ\EHLQJXVHGIRULQVWUXFWLRQ/DWHU 

FKDSWHUVUHSRUWPXFKORZHUUDWHVRIFRPSXWHUXVHLQWKHFRQWUROJURXSWKDQWKHWUHDWPHQW 

JURXS FRQVLVWHQW ZLWK WKLV DSSURDFK IRU LGHQWLI\LQJ DSSURSULDWH VFKRROV 7KRXJK VFKRROV 

WKDWSDUWLFLSDWHGLQWKHVWXG\ZHUHQRWXVLQJWKHSURGXFWV VHOHFWHGIRUWKH VWXG\WHDFKHUV 

WKDWSDUWLFLSDWHGLQWKHVWXG\PD\KDYHXVHGSURGXFWVLQWKHSDVWRUDWVRPHRWKHUVFKRRO 

7KH VWXG\ GLG QRW JDWKHU GDWD DERXW WKH IUHTXHQF\ RI WHDFKHUV ZLWK SUHYLRXV H[SHULHQFHV 

XVLQJSURGXFWV 

 

7KHVWXG\DVVXPHGWKDWGLVWULFWVZRXOGLPSOHPHQWRQO\RQHSURGXFWEXWDERXWDWKLUG 

HOHFWHGWRLPSOHPHQWPRUHWKDQRQH%HFDXVHWKHIRXUJUDGHOHYHOVHVVHQWLDOO\IRUPVHSDUDWH 

VXEVWXGLHVKDYLQJWKHVDPHGLVWULFWLPSOHPHQWPRUHWKDQRQHSURGXFWGLGQRWFDXVHD 

SUREOHPIRUWKHVWXG\DQGLWFUHDWHGVRPHFRVWHIILFLHQFLHVEHFDXVHGDWDFROOHFWLRQZDVPRUH 

3 7KHWDUJHWHIIHFWVL]HLVFRQVLVWHQWZLWKWKHVWXGLHVQRWHGDERYH$UHSRUWIURPWKH3UHVLGHQW·V 

&RPPLWWHHRI$GYLVRUVRQ6FLHQFHDQG7HFKQRORJ\REVHUYHGWKDWDQHIIHFWVL]HRIZDVDWWKHORZHUHQGRI 

WKHUDQJHRIHIIHFWVUHSRUWHGE\IRXUPHWDDQDO\VHVRIWHFKQRORJ\VWXGLHV3&$67 

,,QWURGXFWLRQ

7 

FOXVWHUHG7KHWHDPHQFRXUDJHGGLVWULFWVWKDWZDQWHGWRLPSOHPHQWPRUHWKDQRQHSURGXFW 

WRLPSOHPHQWDVHFRQGRUWKLUGSURGXFWLQDGLIIHUHQWJUDGHOHYHOVRWKDWRQHGLVWULFWZRXOG 

QRWSURYLGHDGLVSURSRUWLRQDWHO\ODUJHVKDUHRIWKHGDWDIRUDQ\RQHJUDGHOHYHO,QWKHHQG 

RQH GLVWULFW LPSOHPHQWHG D SURGXFW LQ DOO IRXU JUDGH OHYHOV DQG DQRWKHU LPSOHPHQWHG D 

SURGXFW LQ WKUHH JUDGH OHYHOV 2QH GLVWULFW LPSOHPHQWHG WZR SURGXFWV LQ WKH IRXUWK JUDGH 

OHYHO 

 

%\ -XQH QHDUO\ DOO GLVWULFWV KDG EHHQ LGHQWLILHG IRU WKH VWXG\ $JUHHPHQWV WR 

SDUWLFLSDWHZHUHUHDFKHGE\6HSWHPEHU$WRWDORIGLVWULFWVDQGVFKRROVDJUHHG 

WRSDUWLFLSDWH7DEOH,7KHGLVWULFWVDUHLQVWDWHVLQFOXGLQJWKHSRSXORXVVWDWHVRI 

&DOLIRUQLD)ORULGD*HRUJLD,OOLQRLV1HZ-HUVH\DQG7H[DV2QHGLVWULFWZLWKWKUHHVFKRROV 

ODWHUGURSSHGRXWRIWKHVWXG\EHFDXVHWHFKQLFDOSUREOHPVSUHYHQWHGWKHSURGXFWWKHGLVWULFW 

ZDVDWWHPSWLQJWRLPSOHPHQWIURPIXQFWLRQLQJDQGRQHVFKRROLQDQRWKHUGLVWULFWGURSSHG 

RXW7KHWDUJHWQXPEHURIVFKRROVDQGFODVVURRPVZDVH[FHHGHGIRUJUDGHVDQGEXWLW 

ZDV QRW UHDFKHG IRU JUDGH DQG DOJHEUD %HFDXVH VHFRQGDU\ VFKRROV KDYH PDQ\ FODVV 

VHFWLRQVWKHQXPEHURIVWXGHQWVLQWKHVWXG\ZDVFORVHUWRWKHWDUJHWVDPSOHVL]H7KHWDUJHW 

VWXGHQWVDPSOHVL]HZDVH[FHHGHGLQJUDGH$WWKHDFWXDOVDPSOHVL]HVPLQLPXPGHWHFWDEOH 

HIIHFWVL]HVZHUHDQGLQWKHIRXUJUDGHOHYHOVUHVSHFWLYHO\ 

7DEOH,VKRZVWKDWWKHVWXG\·VHPSKDVLVRQKLJKSRYHUW\VFKRROVUHVXOWHGLQGLVWULFWV 

KDYLQJ D KLJKHU SHUFHQWDJH RI VWXGHQWV HOLJLEOH IRU IUHH RU UHGXFHGSULFH OXQFK WKDQ WKH 

DYHUDJH GLVWULFW )UHH DQG UHGXFHGSULFH OXQFK UDWHV ZHUH SHUFHQW IRU VFKRROV LQ WKH 

UHDGLQJ VXEVWXGLHV DQG SHUFHQW IRU WKH PDWK VXEVWXGLHV FRPSDUHG WR SHUFHQW 

QDWLRQZLGH 7KHVWXG\GLVWULFWVDOVRZHUHPRUHOLNHO\WREHLQXUEDQORFDWLRQVSHUFHQWRI 

GLVWULFWVLQWKHVWXG\FRPSDUHGWRDERXWSHUFHQWRIGLVWULFWVQDWLRQZLGHDQGZHUHODUJHU 

WKDQWKHDYHUDJHGLVWULFWLQVHYHUDOPHDVXUHVIRUH[DPSOHGLVWULFWVLQWKHUHDGLQJVXEVWXGLHV 

KDG DERXW VFKRROV DQG LQ WKH PDWK VXEVWXGLHV DERXW VFKRROV FRPSDUHG WR DERXW 

VFKRROVLQWKHDYHUDJHGLVWULFW6LPLODUO\WKHSDUWLFXODUVFKRROVUHFUXLWHGIRUWKHVWXG\ZHUH 

PRUH OLNHO\ WR EH 7LWOH , VFKRROV DQG LQ XUEDQ DUHDV 7DEOH , &RQVLVWHQW ZLWK WKH KLJK 

SHUFHQWDJH RI XUEDQ VFKRROV VWXG\ VFKRROV KDG ODUJHU HQUROOPHQWV DQG ODUJHU PLQRULW\ 

VWXGHQWSRSXODWLRQVWKDQWKHDYHUDJHVFKRRO6FKRROVLPSOHPHQWLQJUHDGLQJSURGXFWVZHUH 

VLPLODUWRVFKRROVLPSOHPHQWLQJPDWKSURGXFWVEXWJHQHUDOO\KDGIHZHUVWXGHQWVPRVWZHUH 

HOHPHQWDU\VFKRROVZKHUHDVQHDUO\DOOVFKRROVLPSOHPHQWLQJPDWKSURGXFWVZHUHPLGGOHRU 

KLJKVFKRROV 

6FKRROVLQWKHIRXUWKJUDGHVWXG\ZHUHPRUHKLJKO\XUEDQL]HGDQGKDGODUJHUPLQRULW\ 

VWXGHQWSRSXODWLRQVWKDQVFKRROVLQWKHVWXG\·VRWKHUJUDGHOHYHOV 

4 0LQLPXP GHWHFWDEOH HIIHFW VL]HV GHSHQG RQ WKH GLVWULEXWLRQ RI WKH YDULDQFH RI WHVW VFRUHV EHWZHHQ 

VWXGHQWVFODVVURRPVDQGVFKRROVDIWHUDFFRXQWLQJIRUREVHUYHGVWXGHQWFODVVURRPDQGVFKRROFKDUDFWHULVWLFV 

7KHPLQLPXPGHWHFWDEOHHIIHFWVL]HVQRWHGLQWKHWH[WDUHEDVHGRQHVWLPDWHVRIVWXGHQWFODVVURRPDQGVFKRRO 

UHVLGXDO YDULDQFHV SUHVHQWHG LQ $SSHQGL[ 7DEOH % 'HWHFWDEOH HIIHFW VL]HV DOVR GHSHQG RQ WKH QXPEHU RI 

WHDFKHUVDVVLJQHGWRWUHDWPHQWVWDWXV7KHGHWHFWDEOHHIIHFWVL]HVDUHEDVHGRQWKHDFWXDOWUHDWPHQWDVVLJQPHQW 

UDWHVRISHUFHQWLQWKHILUVWJUDGHSHUFHQWLQWKHIRXUWKJUDGHSHUFHQWLQWKHVL[WKJUDGHDQG 

SHUFHQW LQ DOJHEUD 7KH QH[W VHFWLRQ GHVFULEHV ZK\ WKH WUHDWPHQW DVVLJQPHQW UDWH GLIIHUHG EHWZHHQ 

JUDGHOHYHOV 

 

7KH VWXG\ LQFOXGHV WZR YHU\ ODUJH GLVWULFWV 7KLV IDFW FRQWULEXWHV VLJQLILFDQWO\ WR WKHVH FKDUDFWHULVWLFV 

EHFDXVHWKHWZRGLVWULFWVFRQWDLQPDQ\KLJKSRYHUW\VFKRROV 

,,QWURGXFWLRQ

8 

 

7DEOH,1XPEHURI6WXG\'LVWULFWV6FKRROV7HDFKHUVDQG6WXGHQWVE\*UDGH/HYHO 

6SULQJ 

6XEMHFWDQG*UDGH/HYHO 

1XPEHURI 

'LVWULFWV 

1XPEHURI 

6FKRROV 

1XPEHURI 

7HDFKHUV D 

1XPEHURI 

6WXGHQWV F 

5HDGLQJ*UDGH 

5HDGLQJ*UDGH 

0DWK*UDGH 

0DWK$OJHEUD 

7RWDO 

8QGXSOLFDWHG7RWDO E QD QD 

D7KHQXPEHURIWHDFKHUVLQFOXGHVWUHDWPHQWDQGFRQWUROWHDFKHUV 

E7KHXQGXSOLFDWHGWRWDOJLYHVWKHQXPEHURIXQLTXHGLVWULFWVDQGVFKRROVLQWKHVWXG\1LQHGLVWULFWV 

DQGHLJKWVFKRROVSLORWHGPRUHWKDQRQHSURGXFWIRUWKHVWXG\ 

F7KHQXPEHUUHSUHVHQWVVWXGHQWVLQWKHDQDO\VLVVDPSOHWHVWHGLQERWKIDOODQGVSULQJ7KH 

WRWDOQXPEHURIVWXGHQWVLQWKHVWXG\LVODUJHUEHFDXVHVRPHVWXGHQWVWHVWHGLQWKHIDOOPRYHGRXWRI 

WKHLUVFKRROGLVWULFWE\WKHWLPHRIWKHVSULQJWHVWDQGVRPHVWXGHQWVWHVWHGLQWKHVSULQJKDGPRYHG 

LQWRVWXG\FODVVURRPVDIWHUWKHIDOOWHVW7KHWRWDOQXPEHURIVWXGHQWVWHVWHGZDVLQWKHIDOODQG 

LQWKHVSULQJ 


7DEOH,&KDUDFWHULVWLFVRI'LVWULFWVLQWKH6WXG\ 

$YHUDJH86 

&KDUDFWHULVWLFV 'LVWULFW 

D 

'LVWULFWVLQWKH 

5HDGLQJ6WXG\ 

'LVWULFWVLQWKH 

0DWK6WXG\ 

1XPEHURI7LWOH,VFKRROV E 

'LVWULFWORFDWLRQSHUFHQWDJH 

8UEDQ 

8UEDQIULQJH 

7RZQ 

5XUDODUHD 

1XPEHURIVFKRROVSHUGLVWULFW 

1XPEHURIIXOOWLPHWHDFKHUVSHUGLVWULFW 

1XPEHURIVWXGHQWVSHUGLVWULFW 

3HUFHQWDJHRIVWXGHQWVHOLJLEOHIRUIUHH 

RUUHGXFHGSULFHOXQFK F 

 

1XPEHURI'LVWULFWV 

6RXUFH 6WXG\WDEXODWLRQVE\035IURPWKH²&RPPRQ&RUHRI'DWD 

 

1RWH )RXUGLVWULFWVDUHLQERWKWKHUHDGLQJDQGPDWKVXEVWXGLHV 

 

D'DWDLQFOXGHGLVWULFWVZLWKRQHRUPRUHUHJXODUVFKRROV 

 

E'DWDPLVVLQJIRUSHUFHQWRIVWXG\GLVWULFWVDQGSHUFHQWRIGLVWULFWVQDWLRQZLGH 

 

F'DWDPLVVLQJIRUSHUFHQWRIVWXG\GLVWULFWVDQGSHUFHQWRIGLVWULFWVQDWLRQZLGH 

 

,,QWURGXFWLRQ

9 

7DEOH,&KDUDFWHULVWLFVRI6FKRROVLQWKH6WXG\ 

&KDUDFWHULVWLFV D 

 

6FKRROORFDWLRQSHUFHQWDJH 

$YHUDJH 

86 

6FKRRO 

 

6FKRROV 

LQ)LUVW 

*UDGH 

6WXG\ 

6FKRROV 

LQ)RXUWK 

*UDGH 

6WXG\ 

 

6FKRROV 

LQ6L[WK 

*UDGH 

6WXG\ 

 

 

 

8UEDQ 

8UEDQIULQJH 

7RZQ 

5XUDODUHD 

 

6WXGHQWVSHUWHDFKHU 

 

1XPEHURIVWXGHQWVSHU 

VFKRRO 

 

3HUFHQWDJHUHFHLYLQJ7LWOH, 

 

3HUFHQWDJHRIVWXGHQWVHOLJLEOH 

IRUIUHHRUUHGXFHGSULFH 

OXQFK 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

6FKRROV 

LQ 

$OJHEUD 

6WXG\ 

 

 

 

 

 

 

6WXGHQWUDFHHWKQLFLW\ 

SHUFHQWDJH 

:KLWH 

%ODFN 

+LVSDQLF 

$VLDQ 

1DWLYH$PHULFDQ 

 

 

1XPEHURI6FKRROV 

E 

6RXUFH 6WXG\WDEXODWLRQVE\035IURPWKH²&RPPRQ&RUHRI'DWD&&' 

D'DWDLQFOXGHUHJXODUVFKRROVRQO\ 

E&&'GDWDDUHPLVVLQJIRUVWXG\VFKRROV 

' 5HFUXLWLQJDQG$VVLJQLQJ7HDFKHUV 

7HDFKHUV LQ SDUWLFLSDWLQJ VFKRROV ZHUH DVNHG WR YROXQWHHU E\ VLJQLQJ D FRQVHQW IRUP 

LQGLFDWLQJWKH\XQGHUVWRRGWKDWWKH\ZRXOGEHSDUWRIDUHVHDUFKVWXG\DQGZRXOGLPSOHPHQW 

WKHSURGXFWLIVHOHFWHG 

,QHOLJLEOHVFKRROVWKRVHZLWKWZRRUPRUHYROXQWHHULQJWHDFKHUVWKHVWXG\UDQGRPO\ 

DVVLJQHGWHDFKHUVWRWKHSURGXFWIRUWKDWVFKRRO)LJXUH$LQ$SSHQGL[$VKRZVWKHIORZ 

RI WHDFKHUV LQWR WKH WUHDWPHQW DQG FRQWURO JURXSV 7KH VWXG\ UDQGRPO\ DVVLJQHG 

WHDFKHUVDQGODWHUGURSSHGWHDFKHUVIURPWKHVWXG\7KHPRVWFRPPRQUHDVRQVIRU 

GURSSLQJWHDFKHUVZHUHWKDWWHDFKHUVZKRKDGEHHQUDQGRPO\DVVLJQHGZHUHODWHUDVVLJQHGWR 

WHDFKDGLIIHUHQWJUDGHOHYHORUVXEMHFWPRYHGWRDGLIIHUHQWVFKRROUHWLUHGRUOHIWWHDFKLQJ 

,,QWURGXFWLRQ

10 

:KHWKHU H[FOXGHG WHDFKHUV ZHUH UHSODFHG GHSHQGHG RQ ZKHWKHU D VFKRRO FRXOG LGHQWLI\ D 

QHZWHDFKHUIRUWKHVWXG\,ILWGLGWKHVWXG\HLWKHUFRQGXFWHGUDQGRPDVVLJQPHQWDJDLQLI 

RQO\ RQH WHDFKHU ZDV LQ WKH WUHDWPHQW JURXS RU FRQWURO JURXS RU DVVLJQHG WKH DGGLWLRQDO 

WHDFKHUZLWKDSHUFHQWSUREDELOLW\WRXVHWKHSURGXFW6FKRROVZHUHGURSSHGIURP WKH 

VWXG\ LI WKH\ KDG RQH WHDFKHU LQ HLWKHU WKH WUHDWPHQW JURXS RU WKH FRQWURO JURXS ORVW D 

WHDFKHU DQG FRXOG QRW UHSODFH WKDW WHDFKHU 7KH ZHLJKWLQJ WRZDUG WKH WUHDWPHQW JURXS 

XOWLPDWHO\UHVXOWHGLQSHUFHQWRIVWXG\WHDFKHUVEHLQJLQWKHWUHDWPHQWJURXS 

( &ROOHFWLQJ&ODVVURRPDQG6WXGHQW'DWD 

$ UHYLHZ RI WKH UHVHDUFK OLWHUDWXUH RQ WKH LPSOHPHQWDWLRQ RI FODVVURRPEDVHG 

LQVWUXFWLRQDO WHFKQRORJLHV DQG GHVFULSWLRQV RI UHFRPPHQGHG LPSOHPHQWDWLRQ SUDFWLFHV 

SURYLGHG E\ VRIWZDUH YHQGRUV ZHUH XVHG WR LGHQWLI\ WKH FRQGLWLRQV DQG SUDFWLFHV WR EH 

PHDVXUHG $JRGLQL HW DO 5HOHYDQW OLWHUDWXUH RQ WKH LPSOHPHQWDWLRQ GLPHQVLRQV RQ 

ZKLFKGDWDZHUHFROOHFWHGLVVXPPDUL]HGEULHIO\EHORZIROORZHGE\DEULHIGLVFXVVLRQRIGDWD 

FROOHFWLRQPHWKRGV$SSHQGL[$SURYLGHVGHWDLOVDERXWWKHGDWDFROOHFWLRQPHWKRGV 

5HVHDUFK(YLGHQFHRQ,PSRUWDQW,PSOHPHQWDWLRQ'LPHQVLRQV 

 

7HDFKHU 7UDLQLQJ DQG $FWLRQV 8VLQJ WHFKQRORJ\ SURGXFWV LQ FODVVURRPV SODFHV 

GHPDQGVRQWHDFKHUV·WLPHDQGVNLOOV7HDFKHUVPXVWSUHSDUHWKHSURGXFWIRUVWXGHQWXVH 

PRQLWRUDQGKHOSVWXGHQWVDVWKH\XVHWKHSURGXFWPDLQWDLQWKHWHFKQRORJ\DQGPRQLWRU 

VWXGHQWSURJUHVVRQLW6LQFHWKHVREVHUYHUVKDYHUHSRUWHGWKDWW\SLFDOO\RQO\DPLQRULW\ 

RI WHDFKHUV UHFHLYHV DGHTXDWH WUDLQLQJ WR PDQDJH VWXGHQW XVH RI WHFKQRORJ\ LQ WKHLU 

FODVVURRPVHUU86&RQJUHVV2IILFHRI7HFKQRORJ\$VVHVVPHQW5HFHQWVHOI 

UHSRUWVIURPWHDFKHUVDUHFRQVLVWHQWZLWKWKHVHILQGLQJV,QDUHFHQWVXUYH\SHUFHQWRI 

WHDFKHUVVDLGWKDWWKH\KDGDPHGLXPRUKLJKQHHGIRUSURIHVVLRQDOGHYHORSPHQWRQ´KRZWR 

PDQDJHFODVVURRPDFWLYLWLHVWKDWLQWHJUDWHWHFKQRORJ\µ$GHOPDQHWDO 

 

$PRXQW RI 6RIWZDUH 8VH 7UDFNLQJ XVDJH ZDV LPSRUWDQW IRU WKH VWXG\ EHFDXVH 

UHVHDUFKKDVIRXQGWKDWWKHDYHUDJHFODVVURRPGRHVQRWXVHSURGXFWVIRUWKHDPRXQWRIWLPH 

YHQGRUVUHFRPPHQG9DQ'XVHQDQG:RUWKHQDWWULEXWHGVPDOOLPSDFWVRILQWHJUDWHG 

OHDUQLQJ V\VWHPV WR WKH IDFW WKDW WKH V\VWHPV ZHUH QRW XVHG IRU HQRXJK WLPH $ UHFHQW 

HYDOXDWLRQ RI WKH :DWHUIRUG (DUO\ 5HDGLQJ VRIWZDUH LQ WKH /RV $QJHOHV 8QLILHG 6FKRRO 

'LVWULFW IRXQG WKDW ILUVW JUDGHUV VSHQW RQO\ SHUFHQW RI WKH DPRXQW RI WLPH ZLWK WKH 

VRIWZDUHWKDW:DWHUIRUGUHFRPPHQGHG+DQVHQHWDO 

 

/RFXVDQG*URXSLQJIRU3URGXFW8VH,VVXHVRIOLPLWHGWHDFKHUDQGVWXGHQWDFFHVVWR 

ZRUNLQJFRPSXWHUVDUHRIWHQFLWHGDVEDUULHUVWRWKHLQWHJUDWLRQRIWHFKQRORJ\%HFNHUHWDO 

(UWPHU/HJJHWWDQG3HUVLFKLWWH0HDQVDQG2OVRQ6HYHUDOVWXGLHV 

KDYHUHSRUWHGWKDWEDUULHUVWRDFFHVVLQJWHFKQRORJ\DUHDVRXUFHRIWHDFKHUPLVJLYLQJVDERXW 

XVLQJFRPSXWHUVIRULQVWUXFWLRQ$GHOPDQHWDO&XEDQ6KHLQJROGDQG+DGOH\ 

DQGWHDFKHUVFLWHWKHLQFRQYHQLHQFHRIVFKHGXOLQJDQGPRYLQJVWXGHQWVWRDFRPSXWHU 

ODE DV UHDVRQV IRU VSHQGLQJ OHVV WLPH RQ WHFKQRORJ\GHSHQGHQW FXUULFXOD $GHOPDQ HW DO 

0RUHRYHUDVWXG\RIDVWDWHZLGHLPSOHPHQWDWLRQRIEDVLFVNLOOVVRIWZDUHIRXQGODUJHU 

DFKLHYHPHQWJDLQVIRUPDWKDQGUHDGLQJVRIWZDUHLQVFKRROVZKHUHWKHVRIWZDUHZDVXVHGLQ 

UHJXODUFODVVURRPVUDWKHUWKDQLQFRPSXWHUODEV0DQQHWDO 

,,QWURGXFWLRQ

11 

7HFKQLFDO'LIILFXOWLHVDQG7HDFKHU6XSSRUW&RPSXWHUKDUGZDUHFDQEHXQUHOLDEOH 

FRPSXWHUQHWZRUNVXQVWDEOHDQGWHFKQLFDOVXSSRUWLQDGHTXDWHWRNHHSDOOPDFKLQHVUXQQLQJ 

SURSHUO\&XEDQ&XOSHWDO$VDUHVXOWRQDJLYHQGD\WHDFKHUVDQGVWXGHQWV 

PD\ILQGWKHPVHOYHVZLWKRXWHQRXJKZRUNLQJFRPSXWHUVDQGSHULSKHUDOVVXFKDVSULQWHUV 

WR HIIHFWLYHO\ XVH WKH SURGXFW 7KH W\SH DQG IUHTXHQF\ RI WHFKQLFDO GLIILFXOWLHV DQG RWKHU 

DFFHVVSUREOHPVZHUHWUDFNHGIRUHDFKFODVVURRP$FFHVVZDVH[SHFWHGWREHOHVVRIDQLVVXH 

IRUWKHVWXG\EHFDXVHLWSURYLGHGUHVRXUFHVWRHQVXUHWKDWHQRXJKZRUNLQJFRPSXWHUVZHUH 

DYDLODEOH5HVHDUFKDOVRKDVVXJJHVWHGWKDWWHDFKHUVQHHGRQJRLQJWHFKQLFDODQGSHGDJRJLFDO 

VXSSRUWWRXVHWHFKQRORJ\ZHOO$GHOPDQHWDO0LOOVDQG5DJDQ7KHIUHTXHQF\ 

RI WHFKQRORJ\ XVH KDV EHHQ QRWHG WR EH DVVRFLDWHG PRUH ZLWK TXDOLW\ RI VXSSRUW IRU 

LQWHJUDWLQJ WHFKQRORJ\ ZLWK FXUULFXOXP WKDQ ZLWK WKH SHUFHLYHG TXDOLW\ RI WHFKQLFDO 

WURXEOHVKRRWLQJ DQG PDLQWHQDQFH VXSSRUW %RWK RI WKHVH W\SHV RI VXSSRUW DQG WHDFKHUV· 

VDWLVIDFWLRQZLWKWKHPZHUHPHDVXUHGLQWKHSUHVHQWVWXG\ 

 

3URGXFW·V5ROHLQ,QVWUXFWLRQ3URGXFWVFDQEHWKHFRUHFXUULFXOXPSURYLGHXQLWVWKDW 

UHSODFHVRPHXQLWVRIWKHFRUHFXUULFXOXPVXSSOHPHQWLQVWUXFWLRQRUSURYLGHRSSRUWXQLWLHV 

WRSUDFWLFHEH\RQGWKRVHSURYLGHGE\FRUHFXUULFXOXPPDWHULDOV7HDFKHUV·NQRZOHGJHRIWKH 

VXEMHFWDUHDDQGWKHH[WHQWWRZKLFKWKH\YLHZWKHSURGXFWWREHDOLJQHGZLWKWKHFXUULFXOXP 

PD\LQIOXHQFHWKHH[WHQWWRZKLFKWKH\VXFFHVVIXOO\LQWHJUDWHWHFKQRORJ\LQWKHLUFODVVURRPV 

(UWPHU5HVHDUFKHUVKDYHQRWHGWKDWWHDFKHUVGRQRWXVHWHFKQRORJ\ZKHQWKH\WKLQN 

LWLVQRWFRQQHFWHGWRWKHFXUULFXOXP6DUDPDHWDO4XHVWLRQVDERXWZKHWKHUSURGXFWV 

ZHUHPDSSHGWRVWDQGDUGVZHUHLQFOXGHGLQWKHLPSOHPHQWDWLRQGDWDFROOHFWLRQ 

 

6WXGHQW DQG 7HDFKHU 5ROHV 2QH RI WKH DUJXPHQWV PDGH IRU XVLQJ WHFKQRORJ\ LQ 

FODVVURRPVLVWKDWLWVKLIWVVWXGHQWDQGWHDFKHUUROHVLQZD\VWKDWOHDGWRPRUHOHDUQLQJ)RU 

H[DPSOHZKHQVWXGHQWVDUHZRUNLQJZLWKVRIWZDUHHYHU\VWXGHQWFDQFRQVWUXFWDUHVSRQVH 

WR D TXHVWLRQ UDWKHU WKDQ MXVW WKH VWXGHQW FDOOHG RQ E\ WKH WHDFKHU 6WXGLHV RI FODVVURRP 

LQWHUDFWLRQV KDYH IRXQG WKDW LQ FODVVHV XVLQJ WHFKQRORJ\ LQGLYLGXDO VWXGHQWV PDNH PDQ\ 

PRUHUHVSRQVHV6FKRILHOGDQG9HUEDQ:RUWKHQHWDODQGWKHWHDFKHUVKLIWVRXW 

RIWKHUROHDVOHFWXUHUDQGPD\GRPRUHFRDFKLQJRILQGLYLGXDOVRUVPDOOJURXSV+HQULTXH] 

DQG5LFRQVFHQWH6ZDQDQG0LWUDQL6WXGHQWVDOVRPD\EHPRUHOLNHO\WREHRQ 

WDVN:D[PDQDQG+XDQJ 

 

8VHRI6WXGHQW3HUIRUPDQFH5HSRUWV7KHSURGXFWVSURYLGHLQGLYLGXDOVWXGHQWDQG 

FODVVURRPUHSRUWVRISHUIRUPDQFH0DQ\FRPSDQLHVLQGLFDWHGWKDWWHDFKHUVVKRXOG UHYLHZ 

WKHVHUHSRUWVUHJXODUO\WRHQVXUHWKDWVWXGHQWVDUHSURJUHVVLQJDQGWRPDNHDGMXVWPHQWVDV 

QHHGHG5HVHDUFK RQ IRUPDWLYH DVVHVVPHQW UHYLHZHG E\ %ODFNDQG :LOLDP VXJJHVWV 

WKDWWHDFKHUV·XVHRILQIRUPDWLRQIURPPLGFRXUVHDVVHVVPHQWVFDQLQFUHDVHOHDUQLQJJDLQV 

'DWD&ROOHFWLRQ0HWKRGV 

7KH VWXG\·V GDWD IDOO LQWR WZR EURDG FDWHJRULHV GDWD UHODWHG WR SURGXFW 

LPSOHPHQWDWLRQ DQG FODVVURRP FKDUDFWHULVWLFV LQFOXGLQJ SURGXFW XVDJH DQG WHDFKHU 

FKDUDFWHULVWLFVDQGGDWDUHODWHGWRVWXGHQWFKDUDFWHULVWLFVLQSDUWLFXODUDFKLHYHPHQWEXW 

DOVRDYHUDJHFKDUDFWHULVWLFVRIVWXGHQWVDWWHQGLQJWKHVWXG\·VVFKRROV,QWKHILUVWFDWHJRU\ 

WKH VWXG\ REVHUYHG FODVVURRPV LQWHUYLHZHG WHDFKHUV DQG DGPLQLVWHUHG D TXHVWLRQQDLUH WR 

WHDFKHUV,QWKHVHFRQGFDWHJRU\WKHVWXG\DGPLQLVWHUHGDFKLHYHPHQWWHVWVFROOHFWHGUHFRUGV 

,,QWURGXFWLRQ

12 

IRULQGLYLGXDOVWXGHQWVDQGPHUJHGGDWDIURPSXEOLFVRXUFHVDERXWVWXGHQWFKDUDFWHULVWLFV 

RIVFKRROV 

 

,PSOHPHQWDWLRQDQG&ODVVURRP'DWD 

&ODVVURRP 2EVHUYDWLRQV $ WHPSODWH RI D FODVVURRP REVHUYDWLRQ SURWRFRO ZDV 

GHYHORSHGIRUXVHLQREVHUYDWLRQVRIERWKWUHDWPHQWDQGFRQWUROFODVVURRPVDFURVVDOOJUDGH 

OHYHOV7KHVWUXFWXUHRIWKHSURWRFROGUHZRQHOHPHQWVRIH[LVWLQJREVHUYDWLRQLQVWUXPHQWV 

IRXQGWREHUHOLDEOHLQWKHILHOG*RRGDQG%URSK\7KHFRQWHQWRIWKHSURWRFROZDV 

EDVHGRQUHVHDUFKOLWHUDWXUHRQIDFWRUVDVVRFLDWHGZLWKXVLQJWHFKQRORJ\VRPHRIZKLFKLV 

FLWHGDERYHDVZHOODVRQLPSOHPHQWDWLRQPRGHOVIRUHDFKSURGXFWZKLFKWKHVWXG\ZRUNHG 

ZLWKSURGXFWYHQGRUVWRGHYHORS 

 

7KH REVHUYDWLRQ SURWRFRO KDG WKUHH VHFWLRQV³RQH HDFK IRU VWXGHQW DFWLYLWLHV 

WHFKQRORJ\XVHDQGJHQHUDOREVHUYDWLRQV2EVHUYHUVFROOHFWHGGDWDDWILYHSRLQWVGXULQJD 

PLQXWH SHULRG 7KH\ FRPSOHWHG D VHFWLRQ RQ VWXGHQW DFWLYLWLHV HYHU\ PLQXWHV 

UHFRUGLQJWKHQXPEHURIDFWLYLWLHVWDNLQJSODFHWKHW\SHRIDFWLYLWLHVWKHWHDFKHU·VUROHWKH 

SHUFHQW RI VWXGHQWV ZKR ZHUH RIIWDVN DQG WKH QXPEHU RI VWXGHQWV XVLQJ SURGXFWV 7KH\ 

FRPSOHWHG D VHFWLRQ RQ SURGXFW XVH HYHU\ PLQXWHV FKDUDFWHUL]LQJ DFWLYLWLHV VXFK DV 

WHDFKHUV·UROHVLQPRWLYDWLQJDQGKHOSLQJVWXGHQWVZKRZHUHKDYLQJWHFKQLFDOGLIILFXOWLHVZLWK 

WKHSURGXFWV7KH\DOVRUHFRUGHGWKHWRWDODPRXQWRIWLPHVWXGHQWVXVHGSURGXFWVLIXVHG 

WKHORFDWLRQRIWKHREVHUYDWLRQZKHWKHURWKHUSURGXFWVZHUHXVHGSURGXFWVWKDWZHUHQRW 

WKHIRFXVRIWKHVWXG\DQGKRZSURGXFWVPD\KDYHEHHQXVHGLQZD\VWKDWGLIIHUHGIURP 

WKHSURGXFW·VLPSOHPHQWDWLRQPRGHO 

 

2EVHUYHUV ZHUH H[SHULHQFHG UHVHDUFKHUV DQG D PDMRULW\ KDG H[SHULHQFH FRQGXFWLQJ 

REVHUYDWLRQVRIFODVVURRPLQVWUXFWLRQ3ULRUWRREVHUYDWLRQVREVHUYHUVZHUHWUDLQHGWRXVH 

WKH SURWRFRO UHOLDEO\ E\ ZDWFKLQJ YLGHRWDSHV RI FODVVURRPV XVLQJ SURGXFWV LQ WKH VWXG\ 

$SSHQGL[$SURYLGHVDGGLWLRQDOGHWDLOVRQWKHGHYHORSPHQWRIWKHSURWRFRODQGWKHWUDLQLQJ 

RI REVHUYHUV 2EVHUYHUV FRQGXFWHG REVHUYDWLRQV LQ 2FWREHU DQG 1RYHPEHU LQ 

'HFHPEHUDQG-DQXDU\DQGLQ0DUFKDQG$SULO7KH\FRPSOHWHGSHUFHQWRI 

VFKHGXOHGFODVVURRPREVHUYDWLRQV 

 

7HDFKHU,QWHUYLHZV7HDFKHUVZHUHLQWHUYLHZHGDIWHUREVHUYDWLRQVWRJDWKHUGDWDDERXW 

SURGXFW XVH LQ WUHDWPHQW FODVVURRPV DQG WKH XVH RI VRIWZDUH LQ FRQWURO FODVVURRPV 7KH 

LQWHUYLHZLQFOXGHGTXHVWLRQVDERXWFXUULFXOXPDQGLQVWUXFWLRQDFFHVVDQGIUHTXHQF\RIXVH 

ZKHWKHUVWXGHQWVXVHGSURGXFWVDWKRPHDQGVWXGHQWJURXSLQJVWUDWHJLHV,WDOVRLQFOXGHG 

TXHVWLRQV DERXW KRZ WHDFKHUV PDQDJHG LQVWUXFWLRQ ZLWK WKH SURGXFW H[SHULHQFHV ZLWK 

WHFKQLFDOSUREOHPVDQGWKHW\SHVRILQIRUPDWLRQWHFKQRORJ\DQGYHQGRUVXSSRUWVDYDLODEOH 

DQG DFFHVVHG ,QWHUYLHZHUV FODVVURRP REVHUYHUV VHOHFWHG D UHVSRQVH FDWHJRU\ WKDW EHVW 

PDWFKHGWKHWHDFKHUUHVSRQVHRULIDUHVSRQVHZDVGLIILFXOWWRFRGHWKH\UHDGWKHUHVSRQVH 

RSWLRQVWRWHDFKHUVZKRVHOHFWHGWKHPRVWDSSURSULDWHRQH$SSHQGL[$SURYLGHVDGGLWLRQDO 

GHWDLOVUHJDUGLQJWKHGHYHORSPHQWRIWKHLQWHUYLHZDQGWKHWUDLQLQJRIILHOGVWDIIRQLWVXVH 

2EVHUYHUVLQWHUYLHZHGDOOWHDFKHUVDIWHUWKHILUVWDQGWKLUGREVHUYDWLRQVDQGLQVRPHFDVHV 

EHIRUH WKH REVHUYDWLRQ WR ILW ZLWK WHDFKHU DYDLODELOLW\ )RU WKH VHFRQG REVHUYDWLRQ 

WUHDWPHQWWHDFKHUVZHUHLQWHUYLHZHGRQWRSLFVUHODWHGWRSURGXFWXVH 

 

,,QWURGXFWLRQ

13 

7HDFKHU 6XUYH\ $ TXHVWLRQQDLUH DGPLQLVWHUHG WR DOO WHDFKHUV FRPSOHPHQWHG WKH 

REVHUYDWLRQVDQGLQWHUYLHZV%DVHGRQTXHVWLRQQDLUHVGHYHORSHGE\WKH1DWLRQDO&HQWHUIRU 

(GXFDWLRQ6WDWLVWLFVDQGRWKHUVWXGLHVRIHGXFDWLRQDOWHFKQRORJ\WKHTXHVWLRQQDLUHJDWKHUHG 

GDWD DERXW WHDFKHU GHPRJUDSKLF DQG HGXFDWLRQDO EDFNJURXQG WHDFKLQJ FUHGHQWLDOV 

H[SHULHQFHV XVLQJ WHFKQRORJ\ DQG LQVWUXFWLRQDO SUDFWLFHV 7HDFKHUV DOVR SURYLGHG 

LQIRUPDWLRQRQSURIHVVLRQDOGHYHORSPHQWDFWLYLWLHVDQGWKHLUILUVWIHZPRQWKVRIH[SHULHQFH 

XVLQJWKHSURGXFWVLQFOXGLQJWKHDYDLODELOLW\RIWHFKQLFDOVXSSRUWDQGWKHLUDVVHVVPHQWVRI 

WKHSURGXFW7KHVWXG\PDLOHGWKHPLQXWHTXHVWLRQQDLUHWRWHDFKHUVDWWKHLUVFKRROVLQODWH 

1RYHPEHUDQGUHFHLYHGUHVSRQVHVIURPSHUFHQWRIWHDFKHUV 

 

6WXGHQW'DWD 

6WXGHQW$FKLHYHPHQW)RUILUVWIRXUWKDQGVL[WKJUDGHUVWKHVWXG\DGPLQLVWHUHGWKH 

VKRUWYHUVLRQRIWKH6WDQIRUG$FKLHYHPHQW7HVWYHUVLRQFRPPRQO\UHIHUUHGWRDVWKH 

6$7 )RU ILUVW DQG IRXUWK JUDGHUV WKH VWXG\ XVHG WKH UHDGLQJ SRUWLRQ DQG IRU VL[WK 

JUDGHUV WKH WHDP XVHG WKH PDWK SRUWLRQ )RU ILUVW JUDGHUV WKH VWXG\ VXSSOHPHQWHG WKH 

JURXSDGPLQLVWHUHG6$7ZLWKWKH7HVWRI:RUG5HDGLQJ(IILFLHQF\72:5(DVKRUWRQH 

RQRQHWHVWFRQVLGHUHGWREHDUHOLDEOHDQGYDOLGPHDVXUHRIHDUO\UHDGLQJDELOLW\)RUDOJHEUD 

WKH VWXG\ XVHG (GXFDWLRQDO 7HVWLQJ 6HUYLFH·V (76 (QGRI&RXUVH $OJHEUD $VVHVVPHQW 

ZKLFK HVVHQWLDOO\ LV D ILQDO H[DP %HFDXVH EDVHOLQH DVVHVVPHQWV RI DOJHEUD VNLOOV ZHUH QRW 

DYDLODEOHWKHVWXG\ZRUNHGZLWK(76WRVSOLWWKHWHVWLQWRWZRHTXLYDOHQWSDUWVWKDWKDYHWKH 

VDPHOHYHORIGLIILFXOW\³RQHDGPLQLVWHUHGDWWKHEHJLQQLQJRIWKHFRXUVHDQGWKHRWKHUDW 

WKHHQGRIWKHFRXUVH &ODVVURRPVZHUHUDQGRPO\VHOHFWHGWRWDNHHLWKHUSDUW$LQWKHIDOO 

DQGSDUW%LQWKHVSULQJRUWRWDNHSDUW%LQWKHIDOODQGSDUW$LQWKHVSULQJ%HFDXVHPRVW 

VWXGHQWVZHUHWDNLQJDOJHEUDLQDIXOO\HDUFRXUVHWKHWHVW·VWLPLQJFRUUHVSRQGHGURXJKO\WR 

WKHEHJLQQLQJDQGHQGRIWKHVFKRRO\HDU$IHZVFKRROVWDXJKWDOJHEUDLQDRQHVHPHVWHU 

FRXUVHLQZKLFKFDVHWKHWHVWZDVDGPLQLVWHUHGDWWKHEHJLQQLQJDQGHQGRIWKHVHPHVWHU 

7DEOH , SURYLGHV LQIRUPDWLRQ DERXW DVSHFWV RI WKH WHVWV LQFOXGLQJ WKHLU UHOLDELOLW\ DQG 

QRUPLQJSRSXODWLRQVWKH(76WHVWLVXQQRUPHGEXWRWKHUWHVWVKDYHQDWLRQDOQRUPV 

 

7KH LQLWLDO WHVW ZDV DGPLQLVWHUHG LQ IDOO DW HDFK JUDGH OHYHO 6WXG\ VWDII W\SLFDOO\ 

DGPLQLVWHUHG WHVWV LQ VWXGHQWV· UHJXODU FODVVURRPV PRVWO\ GXULQJ 2FWREHU DQG 1RYHPEHU 

VRPHWHVWLQJRFFXUUHGLQ'HFHPEHU7HVWVZHUHDGPLQLVWHUHGDJDLQEHJLQQLQJLQODWH 

VSULQJDVFORVHWRWKHHQGRIWKHVFKRRO\HDUDVSRVVLEOHWRHQVXUHPD[LPXPH[SRVXUH 

WRWKHSURGXFWV7HVWVW\SLFDOO\ODVWHGWKHOHQJWKRIDFODVVSHULRGWKRXJKLQVRPHVFKRROV 

WKHILUVWJUDGHWHVWZDVDGPLQLVWHUHGLQWZRGD\V EHFDXVHRILWVOHQJWKDQGWKHDJHRIWKH 

VWXGHQWV 

 

)RUILUVWJUDGHUVLQWKHIDOOWKHWHVWZDVWKH6WDQIRUG(DUO\6FKRRO$FKLHYHPHQW7HVW6(6$7%HFDXVH 

WKH WK YHUVLRQZDVQRWDYDLODEOHDWWKHWLPHWKHVWXG\ZDVSXUFKDVLQJWHVWVLQVXPPHUWKH WK YHUVLRQ 

ZDVVXEVWLWXWHG 

 

7KH6$7QLQWKJUDGHWHVWZDVFRQVLGHUHGEXWXOWLPDWHO\QRWDGRSWHGEHFDXVHWKH(76WHVWIRFXVHV 

VSHFLILFDOO\RQDOJHEUDZKHUHDVWKH6$7LQFOXGHVRWKHU PDWKWRSLFDUHDVVXFKDVJHRPHWU\DQGVWDWLVWLFV 

$OJHEUD FRXUVHV DOVR LQFOXGH VWXGHQWV DW KLJKHU DQG ORZHU JUDGH OHYHOV ZKLFK ZRXOG KDYH UHTXLUHG 

DGPLQLVWHULQJGLIIHUHQWYHUVLRQVRIWKH6$7WRVWXGHQWVLQGLIIHUHQWJUDGHOHYHOV7KHVWXG\WHDPDVVXPHG 

WKDWVNLOOVLQWKHVHRWKHUDUHDVZRXOGQRWDOLJQZLWKWHFKQRORJ\SURGXFWVWKDWIRFXVHGRQO\RQDOJHEUD 

,,QWURGXFWLRQ

14 

7DEOH,)HDWXUHVRI7HVWV8VHGLQWKH6WXG\ 

*HQHUDO 

,QIRUPDWLRQ 

6WDQIRUG$FKLHYHPHQW7HVW 

1LQWK(GLWLRQ6$7 

$EEUHYLDWHG%DWWHU\ 

&RPPHUFLDOO\DYDLODEOHXVHGE\ 

ODUJHQXPEHURIVWDWHVDQGVFKRRO 

GLVWULFWV 

1RUP6DPSOH 1DWLRQDOQRUPVEDVHGRQVDPSOHV 

RIVWXGHQWVLQVSULQJ 

DQGLQWKHIDOO 

5HOLDELOLW\DQG 

9DOLGLW\ 

 

7KHDYHUDJHVWXGHQWLQWKHQRUP 

VDPSOHKDVDQRUPDOFXUYH 

HTXLYDOHQWVFRUHRIDQGWKH 

VWDQGDUGGHYLDWLRQRIQRUPDOFXUYH 

HTXLYDOHQWVFRUHVLV 

,QWHUQDOFRQVLVWHQF\5 

FRHIILFLHQWVUDQJHGIURPVWRV 

IRUPRVWWHVWVDQGVXEWHVWV 

(YLGHQFHRIFRQWHQWFULWHULRQ 

UHODWHGDQGFRQVWUXFWYDOLGLW\ 

6WDQIRUG$FKLHYHPHQW7HVW7HQWK 

(GLWLRQ6$7$EEUHYLDWHG 

%DWWHU\ 

&RPPHUFLDOO\DYDLODEOHXVHGE\ODUJH 

QXPEHURIVWDWHVDQGVFKRROGLVWULFWV 

1DWLRQDOQRUPVEDVHGRQVDPSOHVRI 

VWXGHQWVLQVSULQJDQG 

VDPSOHVRILQIDOO 

 


VDPSOHKDVDQRUPDOFXUYHHTXLYDOHQW 

VFRUHRIDQGWKHVWDQGDUG 

GHYLDWLRQRIQRUPDOFXUYHHTXLYDOHQW 

VFRUHVLV 

,QWHUQDOFRQVLVWHQF\5 

FRHIILFLHQWVDUHVWRVIRUIXOO 

PXOWLSOHFKRLFHEDWWHU\WHVWDQG 

VXEWHVWV(YLGHQFHRIFRQWHQW 

FULWHULRQUHODWHGDQGFRQVWUXFW 

YDOLGLW\ 

7HVWRI:RUG5HDGLQJ(IILFLHQF\ 

72:5( 

&RPPHUFLDOO\DYDLODEOH&RQWDLQV 

WZRVXEWHVWV7KH6LJKW:RUG 

(IILFLHQF\6:(VXEWHVWDVVHVVHVWKH 

QXPEHURIUHDOSULQWHGZRUGVWKDW 

FDQEHDFFXUDWHO\LGHQWLILHGZLWKLQ 

VHFRQGVDQGWKH3KRQHWLF 

'HFRGLQJ(IILFLHQF\3'(VXEWHVW 

PHDVXUHVWKHQXPEHURI 

SURQRXQFHDEOHSULQWHGQRQZRUGV 

WKDWFDQEHDFFXUDWHO\GHFRGHGZLWKLQ 

VHFRQGV 

 

 

1DWLRQDOQRUPVEDVHGRQDVDPSOHRI 

VWXGHQWVLQVWDWHVLQIDOO 

DQGVSULQJ 


VDPSOHKDVDVWDQGDUGVFRUHRI 

DQGWKHVWDQGDUGGHYLDWLRQRI 

VWDQGDUGVFRUHVLV 

$YHUDJHDOWHUQDWHIRUPVUHOLDELOLW\ 

FRHIILFLHQWVH[FHHG7HVWUHWHVW 

FRHIILFLHQWVUDQJHIURPWR 

(GXFDWLRQDO7HVWLQJ6HUYLFH(QGRI 

&RXUVH$OJHEUD$VVHVVPHQW 

&XVWRPL]HG 

)XOOIRUPLVFRPPHUFLDOO\DYDLODEOH7HVW 

LVEDVHGRQDOJHEUDVWDQGDUGVRIWKH 

1DWLRQDO&RXQFLORI7HDFKHUVRI 

0DWKHPDWLFV)RUWKHVWXG\(76 

VHSDUDWHGWKHWHVWLWHPVLQWRWZR 

EDODQFHGKDOYHVZLWKHTXDOOHYHOVRI 

GLIILFXOW\VXFKWKDWRQHFRXOGEH 

DGPLQLVWHUHGLQWKHIDOODQGWKHRWKHULQ 

WKHVSULQJ 

1RWQDWLRQDOO\QRUPHG 

,QLQIRUPDWLRQIURPWHVW 

WDNHUVLQGLFDWHGDPHDQVFRUHRI 

TXHVWLRQVFRUUHFWRXWRIZLWK 

UHOLDELOLW\RIDQGDVWDQGDUGHUURURI 

PHDVXUHPHQWRI7KHWZRIRUPV 

IURPZKLFKWKHKDOYHVRIWKHWHVWXVHG 

LQWKHVWXG\ZHUHWDNHQKDGVLPLODU 

UHOLDELOLW\FKDUDFWHULVWLFV 

 

6RXUFH %XURV,QVWLWXWHRI0HQWDO0HDVXUHPHQW8QLYHUVLW\RI1HEUDVND/LQFROQ/LQFROQ1(%XURV7HVW5HYLHZV2QOLQH+DUFRXUW(GXFDWLRQDO 

0HDVXUHPHQW7RUJHVHQHWDO7HVWRI:RUG5HDGLQJ(IILFLHQF\72:5(([DPLQHUV0DQXDO3UR(G$XVWLQ7;,QIRUPDWLRQ 

DERXWWKH(76DOJHEUDWHVWZDVSURYLGHGLQWKHDGPLQLVWUDWRUV·PDQXDOSURYLGHGE\(76DQGJHQHUDOLQIRUPDWLRQDERXWWKHWHVWFDQEHIRXQGDW 

ZZZHWVRUJ 

,,QWURGXFWLRQ

15 

2YHUDOOSHUFHQWRIVWXGHQWVRQIDOOFODVVURVWHUVFRPSOHWHGWKHIDOOWHVWSHUFHQWRI 

VWXGHQWVRQVSULQJFODVVURVWHUVFRPSOHWHGWKHVSULQJWHVWDQGSHUFHQWRIVWXGHQWVZKR 

FRPSOHWHGWKHIDOOWHVWDOVRFRPSOHWHGWKHVSULQJWHVW5HVSRQVHUDWHVGHSHQGHGRQWKHJUDGH 

OHYHOZLWKWKHKLJKHVWWHVWLQJUDWHVIRUILUVWJUDGHDERYHSHUFHQWDQGWKHORZHVWWHVWLQJ 

UDWHV IRU DOJHEUD DERXW SHUFHQW 5HVSRQVH UDWH GLIIHUHQWLDOV IRU WUHDWPHQW DQG FRQWURO 

FODVVURRPV ZHUH QHJOLJLEOH XVXDOO\ RQH RU WZR SHUFHQWDJH SRLQWV $SSHQGL[ 7DEOH $ 

SURYLGHVGHWDLOVDERXWVWXGHQWVDPSOHVL]HVDQGUHVSRQVHUDWHV 

 

7HFKQRORJ\·VHIIHFWRQVWXGHQWDFKLHYHPHQWLVUHSRUWHGLQ´HIIHFWVL]HµXQLWV$QHIIHFW 

VL]HZDVFDOFXODWHGDVWKHGLIIHUHQFHLQDYHUDJHWHVWVFRUHVEHWZHHQWKHWUHDWPHQWDQGFRQWURO 

JURXSV GLYLGHG E\ WKH VWDQGDUG GHYLDWLRQ RI WKH FRQWURO JURXS·V WHVW VFRUH 7KLV PHWULF 

DOORZVWKHVWXG\WRFRPSDUHUHVXOWVIRUWHVWVZKRVHVFRUHVDUHUHSRUWHGLQGLIIHUHQWXQLWV)RU 

H[DPSOHDQHIIHFWVL]HRIRURQHVWDQGDUGGHYLDWLRQLVHTXLYDOHQWWRQRUPDOFXUYH 

HTXLYDOHQWV1&(VRQWKH6$7WHVWDQGSRLQWVRQWKH72:5($QHIIHFWVL]HRI 

LVHTXLYDOHQWWRLQFUHDVLQJDVWXGHQWDWWKHWKSHUFHQWLOHWRWKHWKSHUFHQWLOH 

 

6FKRRO5HFRUGV6WXGHQWGDWDZHUHJDWKHUHGIURPVFKRROUHFRUGVVWDUWLQJDWWKHHQGRI 

WKHVSULQJVHPHVWHUDQGFRQWLQXLQJWKURXJKWKHVXPPHUDQGHDUO\IDOO'DWDLWHPVLQFOXGHG 

DJH DQG UDFH VWDQGDUGL]HG WHVW VFRUHV IRU WKH SUHYLRXV DQG FXUUHQW DFDGHPLF \HDUV DQG 

ZKHWKHUVWXGHQWVKDGDQLQGLYLGXDOL]HGHGXFDWLRQSODQZHUHOLPLWHG(QJOLVKSURILFLHQWRU 

ZHUHHOLJLEOHIRUWKHIUHHOXQFKSURJUDP6FKRROUHFRUGVGDWDZHUHUHDVRQDEO\FRPSOHWHIRU 

VWXGHQW DJH DQG JHQGHU +RZHYHU GLVWULFWV W\SLFDOO\ GLG QRW SURYLGH DOO LWHPV DQG JDSV 

RFFXUUHG IRU WHVW VFRUHV DQG IRU SDUWLFLSDWLRQ LQ WKH IUHH OXQFK VSHFLDO HGXFDWLRQ DQG 

(QJOLVK ODQJXDJH OHDUQLQJ SURJUDPV LQ SDUWLFXODU 2IWHQ LI GDWD LWHPV ZHUH PLVVLQJ WKH\ 

ZHUHPLVVLQJIRUDOOVWXGHQWVLQDVFKRRO%HFDXVHWKHVWXG\·VHVWLPDWLRQDSSURDFKGLVFXVVHG 

LQ$SSHQGL[%UHOLHGRQDWOHDVWVRPHVWXGHQWGDWDEHLQJDYDLODEOHIRUHDFKFODVVURRPWKH 

JDSVLQUHFRUGVGDWDOHGWRWKHGHFLVLRQWRXVHDJJUHJDWHVFKRROOHYHOGDWDIRULWHPVWKDWZHUH 

DYDLODEOHLQWKH&RPPRQ&RUHRI'DWD&&' 

) /RRNLQJ$KHDG 

7KH UHSRUW·V FKDSWHU VWUXFWXUH IROORZV WKH VWXG\·V JUDGHOHYHO VWUXFWXUH 7R DYRLG 

UHSHDWLQJWKHVDPHLQIRUPDWLRQDERXWWKHVWXG\·VPHWKRGVDQGDSSURDFKGHWDLOVRQWKHVHDUH 

SUHVHQWHGLQWKHQH[WFKDSWHURQWKHILUVWJUDGHVWXG\DQGODWHUFKDSWHUVIRFXVPRVWO\RQWKH 

ILQGLQJV5HDGHUVDUHHQFRXUDJHGWRUHDGWKHVHFRQGFKDSWHUWRIDPLOLDUL]HWKHPVHOYHVZLWK 

GHWDLOVDERXWWKHPHWKRGV 

$SSHQGL[HV $DQG % UHSRUW RQ WKH VWXG\·V GDWD FROOHFWLRQ DSSURDFK DQG LWV UHVSRQVH 

UDWHVIRUWKHYDULRXVW\SHVRIGDWDLWFROOHFWHGPHWKRGVLWXVHGWRHVWLPDWHHIIHFWLYHQHVVDQG 

ILQGLQJVIURPDQDO\VHVXVLQJDOWHUQDWLYHHVWLPDWRUVDQGRWKHUWHVWV$SSHQGL[%DOVRSUHVHQWV 

8 7KH &RPPRQ &RUH RI 'DWD &&' DQQXDOO\ FROOHFWV ILVFDO DQG QRQILVFDO GDWD DERXW DOO SXEOLF VFKRROV 

SXEOLFVFKRROGLVWULFWVDQGVWDWHHGXFDWLRQDJHQFLHVLQWKH8QLWHG6WDWHV,QIRUPDWLRQDERXWLWFDQEHIRXQGDW 

KWWSQFHVHGJRYFFG 7KH LQIRUPDWLRQ XVHG LQ WKH VWXG\ ZDV UHSRUWHG E\ WKH &&' IRU WKH 

VFKRRO\HDU 

,,QWURGXFWLRQ

16 

WKHIXOOVHWRIHVWLPDWHVIURPWKHPDLQSURGXFWHIIHFWLYHQHVVPRGHOVIRUUHDGHUVZKRZDQW 

WRH[DPLQHWKHGHWDLOHGUHVXOWV 

7KHUHSRUWEDVHGRQDVHFRQG\HDURIGDWDZLOOIRFXVRQZKHWKHUDQDGGLWLRQDO\HDURI 

H[SHULHQFH XVLQJ UHDGLQJ DQG PDWKHPDWLFV VRIWZDUH SURGXFWV LV DVVRFLDWHG ZLWK JUHDWHU 

HIIHFWLYHQHVV)LQGLQJVZLOODOVREHUHSRUWHGIRULQGLYLGXDOSURGXFWV 

 

,,QWURGXFWLRQ

&KDSWHU,, 

(IIHFWVRI)LUVW*UDGH5HDGLQJ6RIWZDUH 

3URGXFWV 

 

7KLVFKDSWHUSUHVHQWVILQGLQJVRQWKHLPSOHPHQWDWLRQRIILUVWJUDGHUHDGLQJVRIWZDUH 

SURGXFWV HIIHFWV RQ VWXGHQW WHVW VFRUHV DQG WKH UHODWLRQVKLSV EHWZHHQ HIIHFWV DQG 

FRQGLWLRQVDQGSUDFWLFHVUHODWHGWRSURGXFWXVH7KHILUVWJUDGHVWXG\LQFOXGHGILYH 

UHDGLQJVRIWZDUHSURGXFWVWKDWZHUHLPSOHPHQWHGLQGLVWULFWVDQGVFKRROV7KHVDPSOH 

LQFOXGHG WHDFKHUV DQG VWXGHQWV 7KH ILYH SURGXFWV ZHUH 'HVWLQDWLRQ 5HDGLQJ 

SXEOLVKHG E\ 5LYHUGHHS WKH :DWHUIRUG (DUO\ 5HDGLQJ 3URJUDP SXEOLVKHG E\ 3HDUVRQ 

'LJLWDO/HDUQLQJ+HDGVSURXWSXEOLVKHGE\+HDGVSURXW3ODWR)RFXVSXEOLVKHGE\3ODWR 

DQGWKH$FDGHP\RI5HDGLQJSXEOLVKHGE\$XWRVNLOO 

 

(IIHFWVZHUHHVWLPDWHGXVLQJDKLHUDUFKLFDOOLQHDUPRGHO+/0LQZKLFKVWXGHQWVZHUH 

QHVWHG LQ FODVVURRPV DQG VFKRROV %HFDXVH RI WKH VWXG\·V H[SHULPHQWDO GHVLJQ WHVW VFRUH 

GLIIHUHQFHVEHWZHHQFODVVURRPVXVLQJSURGXFWVDQGFODVVURRPVQRWXVLQJSURGXFWVFDQEH 

DWWULEXWHGWRWKHSURGXFWVDIWHUDOORZLQJIRUVDPSOLQJYDULDELOLW\7KHDQDO\VLVUHOLHGRQWHVWV 

DGPLQLVWHUHGWRVWXGHQWVLQIDOODQGVSULQJDVZHOODVRQGDWDIURPVWXGHQWUHFRUGVWHDFKHU 

TXHVWLRQQDLUHVDQGWKH&RPPRQ&RUHRI'DWDIRUVFKRROFKDUDFWHULVWLFV 

 

7KH KLHUDUFKLFDO OLQHDU PRGHO DOVR ZDV XVHG WR H[DPLQH FODVVURRP DQG VFKRRO 

FKDUDFWHULVWLFVFRUUHODWHGZLWKHIIHFWV7KHVWXG\·VGHVLJQGRHVQRWVXSSRUWFDXVDOVWDWHPHQWV 

WKDWWKHVHFKDUDFWHULVWLFVGHWHUPLQHHIIHFWV'LVWULFWVDQGVFKRROVZHUHQRWUDQGRPO\DVVLJQHG 

WR XVH SDUWLFXODU SURGXFWV ,QVWHDG WKH\ VHOHFWHG SURGXFWV WKH\ EHOLHYHG ZHUH VXLWDEOH IRU 

WKHLU QHHGV 7KH XQFRQWUROOHG VHOHFWLRQ FRXOG DFFRXQW IRU WKH PHDVXUHG FRUUHODWLRQV 

+RZHYHU H[DPLQLQJ WKH FRUUHODWLRQV LV XVHIXO DV DQ LQGLFDWLRQ RI ZKHWKHU HIIHFWLYHQHVV 

PLJKWYDU\ZLWKFRQGLWLRQVDQGSUDFWLFHVHYHQLIWKHSDUWLFXODUPHFKDQLVPVSURGXFLQJWKH 

YDULDWLRQFDQQRWEHHVWDEOLVKHG 

$ ,PSOHPHQWDWLRQ$QDO\VLV 

7KH PDLQ TXHVWLRQV DGGUHVVHG LQ WKH LPSOHPHQWDWLRQ DQDO\VLV ZHUH :KDW GR 

SURGXFWV GR" +RZ PXFK ZHUH SURGXFWV XVHG DQG KRZ GLG WHDFKHUV XVH WKHP" DQG 

+RZ GLG SURGXFWV DIIHFW FODVVURRP DFWLYLWLHV RU UROHV" 7R DQVZHU WKHVH TXHVWLRQV WKH 

VWXG\FROOHFWHGGDWDLQVL[DUHDVIHDWXUHVRIWKHSURGXFWVLQWKHVWXG\WHDFKHUWUDLQLQJDQG

18 

VXSSRUW RQ XVLQJ SURGXFWV WKH GXUDWLRQ H[WHQW DQG ORFDWLRQ RI SURGXFW XVH WHFKQLFDO 

GLIILFXOWLHVLQXVLQJSURGXFWVUROHRISURGXFWVLQWKHFXUULFXOXPDQGWKHHIIHFWVWKDWSURGXFW 

XVHKDGRQFODVVURRPDFWLYLWLHV7KHILUVWWKUHHDUHDVUHODWHWRSURGXFWVDVFRPSXWHUEDVHG 

WRROVDQGWKH IRXUWKDQGILIWKUHODWHWRSURGXFWV DVLQVWUXFWLRQDO VXSSRUWV7KH VL[WKDUHD 

UHODWHV WR KRZ SURGXFWV PD\ KDYH FKDQJHG ZKDW WHDFKHUV DQG VWXGHQWV ZHUH GRLQJ LQ 

FODVVURRPVDQGKRZWKH\ZHUHLQWHUDFWLQJ 

3URGXFW)HDWXUHV 

 

8QGHUVWDQGLQJWKHFKDUDFWHULVWLFVRIWKHUHDGLQJVRIWZDUHSURGXFWVLVXVHIXODVDFRQWH[W 

IRUWKHILQGLQJV7KHILYHUHDGLQJSURGXFWVLQWKHILUVWJUDGHVWXG\DOOSURYLGHWXWRULDOVDQG 

SUDFWLFH LQ HDUO\ UHDGLQJ VNLOOV 6NLOOV FRYHUHG E\ WKH VRIWZDUH LQFOXGH OHWWHU UHFRJQLWLRQ 

SKRQHPLFDZDUHQHVVZRUGUHFRJQLWLRQDQGZRUGDWWDFNVNLOOVYRFDEXODU\EXLOGLQJDQGWH[W 

FRPSUHKHQVLRQ0RVWRIWKHSURGXFWVSURYLGHVWXGHQWVZLWKRSSRUWXQLWLHVWRUHDGGLIIHUHQW 

NLQGV RI WH[W LQFOXGLQJ LQIRUPDWLRQDO WH[W ILFWLRQ DQG SRHWU\ 7KH VWXG\ HVWLPDWHG WKH 


UDQJHRIWR 

 

6WXG\VWDIIDVVHVVHGSURGXFWIHDWXUHVUHODWHGWRILYHEURDGDUHDVRILQVWUXFWLRQDOGHVLJQ 

WKDW DUH FRPPRQO\ XVHG LQ WKH ILHOG WXWRULDO RSSRUWXQLWLHV SUDFWLFH RSSRUWXQLWLHV 

LQGLYLGXDOL]DWLRQIHHGEDFNWRWHDFKHUVDQGIHHGEDFNWRVWXGHQWV7KHVHFDWHJRULHV 

DOVR DUH FRQVLVWHQW ZLWKYHQGRU VWDWHPHQWV DERXW WKHLU SURGXFWV VXFK DV WKDW WKH SURGXFW 

VXSSRUWV LQGLYLGXDOL]DWLRQ RI OHDUQLQJ RU SURYLGHV VWXGHQWV ZLWK SUDFWLFH RSSRUWXQLWLHV WR 

VXSSOHPHQWLQVWUXFWLRQ3URGXFWIHDWXUHVZHUHDVVHVVHGEDVHGRQDFRGLQJJXLGHGHYHORSHG 

E\WKHVWXG\WHDP7ZRFRGHUVLQGHSHQGHQWO\UHYLHZHGSURGXFWVDQGFDWHJRULHVIRUZKLFK 

LQWHUFRGHUDJUHHPHQWZDVSHUFHQWRUJUHDWHUZHUHUHWDLQHG)RUUDWLQJVRQZKLFKLQLWLDO 

FRGHUV GLVDJUHHG D WKLUG FRGHU UHYLHZHG WKH SURGXFW DQG PDGH D GHWHUPLQDWLRQ 2QO\ 

FRPSXWHUEDVHG LQVWUXFWLRQDO FRPSRQHQWV ZHUH DVVHVVHG 6RPH SURGXFWV LQFOXGHG WH[W 

FRPSRQHQWVWKDWZHUHQRWDVVHVVHG 

 

:LWKLQWKHFDWHJRULHVRIWKHILYHPDLQIHDWXUHVWKHVWXG\WHDPDVVHVVHGPRUHGHWDLOHG 

DVSHFWV RI SURGXFW GHVLJQ )RU LQGLYLGXDOL]DWLRQ DQG IRU VWXGHQW IHHGEDFN SURGXFWV ZHUH 

DVVHVVHGIRUWKHLUIHDWXUHVZLWKLQWKUHHPRGHVWXWRULDOSUDFWLFHRUDVVHVVPHQW,QWXWRULDOPRGH 

VWXGHQWVDUHEHLQJLQVWUXFWHGRQDVNLOORUFRQFHSWWKDWLVGHILQHGH[SODLQHGRUGHPRQVWUDWHG 

E\WKHSURGXFW,QSUDFWLFHPRGHVWXGHQWVDQVZHUTXHVWLRQVRUVROYHSUREOHPVLQDVNLOODUHD 

IRU ZKLFK WKH\ UHFHLYHG LQVWUXFWLRQ HLWKHU RII RU RQ WKH FRPSXWHU ,Q DVVHVVPHQW PRGH 

VWXGHQWVDQVZHUTXHVWLRQVRUVROYHSUREOHPVRQLQVWUXFWLRQWKH\KDYHUHFHLYHGDQGSURGXFWV 

WDOO\ UHVSRQVHV WR DVVHVV SHUIRUPDQFH RU PDVWHU\ RI WKH FRQWHQW RU VNLOO )XUWKHU ZLWKLQ 

LQGLYLGXDOL]DWLRQ SURGXFWV FRXOG VHTXHQFH PRGXOHV DXWRPDWLFDOO\ RU DOORZ WHDFKHUV RU 

VWXGHQWVWRVHOHFWPRGXOHVWRFUHDWHDÓHDUQLQJSDWKµWKURXJKWKHSURGXFWIRUHDFKRIWKH 

WKUHHPRGHV7KHWKUHHW\SHVRILQGLYLGXDOL]DWLRQDQGWKHWKUHHPRGHVLQWHUDFWWRFUHDWHQLQH 

SRVVLEOH FDWHJRULHV 6LPLODUO\ IRU WKH ´RSSRUWXQLWLHVµ IHDWXUH SURGXFWV FRXOG SURYLGH 

GLIIHUHQW OHYHOV RI RSSRUWXQLWLHV LQ WZR PRGHV WXWRULDO DQG SUDFWLFH OHDGLQJ WR WZR 

FDWHJRULHV 

)RU WHDFKHU IHHGEDFN WKH WHDP DVVHVVHG ZKHWKHU WKH IHHGEDFN ZDV DERXW VWXGHQW 

PDVWHU\VWXGHQWOHDUQLQJSDWKVRUFODVVURRPSHUIRUPDQFH)RUVWXGHQWIHHGEDFNWKHWHDP 

,,(IIHFWVRI)LUVW*UDGH5HDGLQJ6RIWZDUH3URGXFWV

19 

DVVHVVHG ZKHWKHU IHHGEDFN ZDV ´LPPHGLDWHµ ´PDVWHU\µ DQG ´GLDJQRVWLFµ DQG ZKHWKHU LW 

RFFXUUHGLQSUDFWLFHDQGDVVHVVPHQWPRGHV)HHGEDFNRIWHQLVFLWHGDVDQLPSRUWDQWDVSHFW 

RI LQVWUXFWLRQ %DQJHUW'URZQV HW DO %ODFN DQG :LOLDP %XWOHU &URRNV 

OXJHU DQG GH1LVL DQG OHDUQLQJ WKHRULVWV KDYH VWUHVVHG WKH LPSRUWDQFH RI 

GLDJQRVWLFIHHGEDFNWKDWJRHVEH\RQGZKHWKHUVWXGHQWVJRWDQVZHUVULJKW%UDQVIRUGHWDO 

 

7DEOH,,VXPPDUL]HVDVVHVVPHQWVRIWKHLQVWUXFWLRQDOIHDWXUHVRIWKHILYHSURGXFWV$OO 

SURYLGHGIRULQGLYLGXDOL]HGLQVWUXFWLRQWKHFDSDELOLW\WRVHWLQGLYLGXDOVWXGHQWOHDUQLQJSDWKV 

GHSHQGLQJ RQ D VWXGHQW·V VNLOO OHYHO KDG QXPHURXV WXWRULDO FRPSRQHQWV DQG SUDFWLFH 

RSSRUWXQLWLHV DQG SURYLGHG IHHGEDFN WR VWXGHQWV GXULQJ SUDFWLFH 6RPH SURGXFWV DOVR 

SURYLGHG IHHGEDFN GXULQJ DVVHVVPHQW DFWLYLWLHV $OO SURYLGHG UHSRUWV WR WHDFKHUV IRU WKH 

RYHUDOOFODVVDQGIRUHDFKVWXGHQWVHSDUDWHO\IRUWKHGLIIHUHQWSURGXFWPRGXOHV2QHSURGXFW 

DOVRSURYLGHGUHSRUWVRIVWXGHQWUHVSRQVHVWRLQGLYLGXDOTXHVWLRQV7KUHHSURGXFWVSURYLGHG 

UHFRPPHQGDWLRQV DERXW PRGXOHV WR ZKLFK LQGLYLGXDO VWXGHQWV VKRXOG SURJUHVV EDVHG RQ 

WKHLUSHUIRUPDQFH 

([KLELW,,+RZ3URGXFW)HDWXUHV:HUH$VVHVVHG 

 

3URGXFW IHDWXUHV ZHUH DVVHVVHG EDVHG RQ D FRGLQJ JXLGH GHYHORSHG E\ WKH VWXG\ WHDP 7ZR FRGHUV 

LQGHSHQGHQWO\UHYLHZHGSURGXFWVDQGFDWHJRULHVZHUHLQFOXGHGLILQWHUFRGHUDJUHHPHQWZDVSHUFHQWRU 

JUHDWHU )RU UDWLQJV RQ ZKLFK LQLWLDO FRGHUV GLVDJUHHG D WKLUG FRGHU UHYLHZHG WKH SURGXFW DQG PDGH D 

GHWHUPLQDWLRQ 

 

,QWHUFRGHUUHOLDELOLW\ZDVUHDFKHGIRUILYHLQVWUXFWLRQDOIHDWXUHV 

 

7XWRULDO2SSRUWXQLWLHV$FWLYLWLHVLQZKLFKVWXGHQWVUHFHLYHLQVWUXFWLRQLQDVNLOORUFRQFHSW 

 

3UDFWLFH 2SSRUWXQLWLHV $FWLYLWLHV LQ ZKLFK VWXGHQWV SUDFWLFH DQVZHULQJ TXHVWLRQV RU VROYLQJ 

SUREOHPV LQ D VNLOO DUHD IRU ZKLFK WKH\ KDG UHFHLYHG VRPH LQVWUXFWLRQ HLWKHU RQ RU RII WKH 

FRPSXWHU 

,QGLYLGXDOL]DWLRQ7KHGHJUHHWRZKLFKWKHSURGXFWDOORZVIRULQGLYLGXDOOHDUQLQJSDWKVWREH 

VSHFLILHGDXWRPDWLFDOO\RUE\WKHWHDFKHURUVWXGHQW 

 

 

)HHGEDFNWR7HDFKHUV,QIRUPDWLRQWHDFKHUVUHFHLYHIURPWKHSURGXFWDERXWVWXGHQWPDVWHU\RI 

FRQFHSWVRUVNLOOV 

)HHGEDFN WR 6WXGHQWV ,QIRUPDWLRQ VWXGHQWV UHFHLYH IURP WKH SURGXFW DERXW WKHLU OHYHO RI 

XQGHUVWDQGLQJRUPDVWHU\RIDFRQFHSWRUVNLOOGXULQJWXWRULDOVSUDFWLFHRUDVVHVVPHQWV 

 

2QO\ FRPSXWHUEDVHG LQVWUXFWLRQDO FRPSRQHQWV ZHUH DVVHVVHG VRPH SURGXFWV KDG QRQFRPSXWHUEDVHG 

FRPSRQHQWVWKDWZHUHQRWDVVHVVHG 


20 

7DEOH,,,QVWUXFWLRQDO)HDWXUHVRI)LUVW*UDGH5HDGLQJ3URGXFWV 

 

 

,QGLYLGXDOL]DWLRQ D )HHGEDFNWR7HDFKHUV )HHGEDFNWR6WXGHQWV E 

$XWRPDWLF 7HDFKHU,QSXW 6WXGHQW,QSXW ,PPHGLDWH 0DVWHU\ 'LDJQRVWLF 

3URGXFW 

7XWRULDO 

2SSRUWXQLWLHV 

3UDFWLFH 

2SSRUWXQLWLHV 7 3 $ 7 3 $ 7 3 $ 

6WXGHQW 

0DVWHU\ 

/HDUQLQJ 

3DWKV 

&ODVVURRP 

3HUIRUPDQFH 3 $ 3 $ 3 $ 

$ 0DQ\ 0DQ\ 9 9 9 9 9 9 9 9 9 9 9 

% 0DQ\ 0DQ\ 9 9 9 9 9 9 9 9 9 9 

& 0DQ\ 0DQ\ 9 9 9 9 9 9 9 9 9 9 9 

' 0DQ\ 0DQ\ 9 9 9 9 9 9 9 9 9 9 9 9 9 9 

( 0DQ\ 0DQ\ 9 9 9 9 9 9 9 9 9 9 9 9 

 

6RXUFH6WDIIUHYLHZ 

D 7 7XWRULDOPRGH3 3UDFWLFHPRGH$ $VVHVVPHQWPRGH 

E ,PPHGLDWHIHHGEDFN/HDUQHUWROGZKHWKHUUHVSRQVHLVFRUUHFWLPPHGLDWHO\DIWHUFRPSOHWLQJPRGXOH'LDJQRVWLFIHHGEDFN/HDUQHUUHFHLYHVKLQWVRURWKHULQIRUPDWLRQFRQFHUQLQJWKHSUREDEOH 

VRXUFHRIHUURU0DVWHU\IHHGEDFN/HDUQHULQIRUPHGRIWKHQXPEHUFRUUHFWDQGZKHWKHUDVNLOORUFRQFHSWKDVEHHQDFTXLUHG´PDVWHUHGµDIWHUFRPSOHWLQJDVHTXHQFHRILWHPV/HDUQHUFDQUHWXUQ 

WRPLVVHGLWHPV 


21 

7HDFKHU7UDLQLQJDQG6XSSRUW 

3URGXFWYHQGRUVWUDLQHGWHDFKHUVZKRZRXOGEHLPSOHPHQWLQJWKHSURGXFWVRQKRZWR 

XVH WKHP 7UDLQLQJ JHQHUDOO\ WRRN SODFH LQ WKH KRVW GLVWULFWV DQG VRPHWLPHV WKH KRVW 

VFKRROV GXULQJ VXPPHU RU HDUO\ IDOO RI 7UDLQLQJ WRSLFV LQFOXGHG FODVVURRP 

PDQDJHPHQWFXUULFXOXPDQGVWDQGDUGVDOLJQPHQWDQGJHQHUDOO\WHDFKHUVKDGRSSRUWXQLWLHV 

WRSUDFWLFHXVLQJWKHSURGXFWV1HDUO\DOOWHDFKHUVSHUFHQWDWWHQGHGWKHLQLWLDOWUDLQLQJ 

DFFRUGLQJWRDWWHQGDQFHORJV 

 

2QDYHUDJHYHQGRUVSURYLGHGDERXWRQHGD\RIWUDLQLQJKRXUVYDU\LQJIURPWR 

KRXUVDFURVVSURGXFWV9HQGRUVDOVRSURYLGHGVXSSRUWGXULQJWKHVFKRRO\HDU0RGHVIRU 

RQJRLQJVXSSRUWLQFOXGHGHPDLORUWHOHSKRQHKHOSGHVNVSHUFHQWRIWHDFKHUVUHSRUWHG 

UHFHLYLQJ WKLV NLQG RI KHOS SURGXFW UHSUHVHQWDWLYHV YLVLWLQJ WHDFKHUV SHUFHQW DQG 

DGGLWLRQDOWUDLQLQJDWVFKRROVSHUFHQW7KHQHHGIRUVXFKDGGLWLRQDOVXSSRUWLVVXJJHVWHG 

E\WKHILQGLQJWKDWE\WKHWLPHRIWKHILUVWFODVVURRPREVHUYDWLRQJHQHUDOO\DERXWPLGIDOO 

ZKHQPRVWWHDFKHUVKDGEHJXQWRXVHSURGXFWVWKHSURSRUWLRQRIWHDFKHUVLQGLFDWLQJWKDW 

WKHLQLWLDOWUDLQLQJKDGDGHTXDWHO\SUHSDUHGWKHPKDGGHFOLQHGIURPSHUFHQWDWWKHHQGRI 

WKHLQLWLDOWUDLQLQJWRSHUFHQW 

 

,Q DGGLWLRQ WR HQVXULQJ WKDW WHDFKHUV UHFHLYHG WUDLQLQJ WKH VWXG\ WHDP ZRUNHG ZLWK 

GLVWULFWVWRLGHQWLI\KDUGZDUHDQGVRIWZDUHQHHGVVXFKDVFRPSXWHUVKHDGSKRQHVPHPRU\ 

DQGRSHUDWLQJV\VWHPXSJUDGHVDQGWKHVWXG\SXUFKDVHGWKHXSJUDGHVDVQHHGHG&RPPRQ 

XSJUDGHV LQFOXGHG GHVNWRS DQG ODSWRS FRPSXWHUV VHUYHUV PHPRU\ DQG KHDGSKRQHV 7KH 

VWXG\GLGQRWXSJUDGHQHWZRUNLQJLQIUDVWUXFWXUHVWKRXJKVRPHSXUFKDVHVRIVHUYHUVHQDEOHG 

SURGXFWV WR RSHUDWH PRUH VPRRWKO\ RQ ORFDO QHWZRUNV $V QRWHG LQ WKH SUHYLRXV FKDSWHU 

SURYLGLQJ KDUGZDUH DQG VRIWZDUH XSJUDGHV PD\ KDYH FRQWULEXWHG WR KLJKHU OHYHOV RI 

PHDVXUHG HIIHFWLYHQHVV LI GLVWULFWV QRUPDOO\ ZRXOG QRW KDYH EHHQ DEOH WR SXUFKDVH WKH 

XSJUDGHV 7KH VWXG\ GLG QRW SURYLGH VRIWZDUH RU KDUGZDUH VXSSRUW IRU FRQWURO JURXS 

WHDFKHUV 

 

6WXG\REVHUYHUVQRWHGWKDWILUVWJUDGHWUHDWPHQWWHDFKHUVDYHUDJHGDERXWVL[FRPSXWHUV 

SHUFODVVURRPFODVVHVKDGDYHUDJHDWWHQGDQFHRIVWXGHQWV:KHQSURGXFWVZHUHXVHGLQ 

VFKRRO ODEV WKHUH ZDV W\SLFDOO\ EXW QRW DOZD\V D FRPSXWHU IRU HYHU\ VWXGHQW :LWK WKH 

DGGLWLRQDOWHFKQRORJ\SURYLGHGE\WKHVWXG\LQSULQFLSOHWKHQXPEHURIRSHUDEOHFRPSXWHUV 

DSSHDUHGDGHTXDWHIRUVWXGHQWVWRUHDFKUHFRPPHQGHGOHYHOVRISURGXFWXVH 

'XUDWLRQDQG([WHQWRI3URGXFW8VH 

 

$OOWUHDWPHQWWHDFKHUVXVHGWKHDVVLJQHGSURGXFWWRVRPHGHJUHHDQGVRPHSURGXFWV 

ZHUH XVHG KHDYLO\ GXULQJ WKH VFKRRO \HDU 5HVHDUFKHUV DVNHG WHDFKHUV ´+RZ RIWHQ KRZ 

PDQ\VHVVLRQVSHUZHHNDQGIRUKRZPDQ\PLQXWHVSHUZHHNGRHVDW\SLFDOVWXGHQWXVHWKH 

SURGXFW"µ 7DEOH ,, VKRZV WKH KRXUV WKDW VWXGHQWV ZHUH H[SRVHG WR VWXG\ SURGXFWV LQ 

WUHDWPHQW FODVVURRPV RU WR WKH PRVW IUHTXHQWO\ XVHG RWKHU WHFKQRORJ\EDVHG UHDGLQJ 

SURGXFWLQERWKWUHDWPHQWDQGFRQWUROFODVVURRPVEDVHGRQWHDFKHUUHSRUWV 

 


22 

7DEOH,, 7HDFKHU5HSRUWHG8VHRI6WXG\3URGXFWVDQG2WKHU5HDGLQJ6RIWZDUH3URGXFWV 

)LUVW*UDGH 

6WXG\3URGXFWV 2WKHU5HDGLQJ3URGXFWV 

 

7UHDWPHQW 

*URXS 

&RQWURO 

*URXS 

SYDOXH D 

 

7UHDWPHQW 

*URXS 

&RQWURO 

*URXS 

SYDOXH D 

3HUFHQWRIWHDFKHUVXVLQJ 

DSURGXFW 

0LQXWHVRIZHHNO\XVH QD 

+RXUVRIDQQXDOXVH QD 

6DPSOHVL]H Ã 

6RXUFHV&ODVVURRPREVHUYDWLRQVWHDFKHULQWHUYLHZV 

D 7HVWVRIGLIIHUHQFHZHUHFRQGXFWHGXVLQJWZROHYHOKLHUDUFKLFDOPRGHOVZLWKDWHDFKHUOHYHODQGDVFKRRO 

OHYHOZLWKWKHWUHDWPHQWHIIHFWDWOHYHORQHDQGEHWZHHQVFKRROYDULDQFHDWOHYHOWZR7KHSYDOXHLVWKH 

VPDOOHVWOHYHORIVLJQLILFDQFHDWZKLFKWKHQXOOK\SRWKHVLVWKDWWKHGLIIHUHQFHLV]HURFDQEHUHMHFWHG 

6DPSOHLVWRRVPDOOWRFRPSXWHPHDQV 


 

&RQWURODQGWUHDWPHQWWHDFKHUVFRXOGXVHSURGXFWVRWKHUWKDQWKRVHLQWKHVWXG\DQG 

7DEOH,,VKRZVWKHH[WHQWWRZKLFKWKH\GLG$ERXWSHUFHQWRIFRQWUROWHDFKHUVUHSRUWHG 

XVLQJVRPHRWKHUSURGXFWSRVVLEO\PRUHWKDQRQHDQGDYHUDJHXVHIRUWKHFRQWUROJURXSDV 

D ZKROH LQFOXGLQJ WHDFKHUV ZKR GLG QRW XVH SURGXFWV ZDV KRXUV D \HDU 7KH PRVW 

FRPPRQO\ XVHG RWKHU SURGXFWV ZHUH UHDGLQJ SUDFWLFH RU DVVHVVPHQW SURGXFWV RQH ZDV D 

SURGXFW DYDLODEOH RQ WKH :HE DW QR FRVW ,Q FRQWUDVW SHUFHQW RI WUHDWPHQW WHDFKHUV 

UHSRUWHGXVLQJDSURGXFWRWKHUWKDQWKHRQHLQWKHVWXG\DQGDYHUDJHXVHIRUDOOWUHDWPHQW 

WHDFKHUVZDVDERXWKRXUVD\HDU7KHVXPRIXVHRIERWKW\SHVRISURGXFWVSURGXFWVLQ 

WKHVWXG\DQGSURGXFWVQRWLQWKHVWXG\ZDVKRXUVD\HDUIRUWUHDWPHQWWHDFKHUVYHUVXV 

KRXUVD\HDUIRUFRQWUROWHDFKHUV 

 

7KHGLIIHUHQFHLQSURGXFWXVHEHWZHHQWUHDWPHQWDQGFRQWUROWHDFKHUVYDULHGE\GLVWULFW 

DQGVFKRRO)LJXUH,,6RPHVFKRROVKDGGLIIHUHQFHVRIKRXUVRUIHZHUZKHUHDVRWKHUV 

KDGGLIIHUHQFHVRIKRXUVRUPRUH1RVFKRROVKDGQHJDWLYHGLIIHUHQFHVZKLFKZRXOG 

DULVHLIFRQWUROWHDFKHUVXVHGRWKHUSURGXFWVPRUHWKDQWUHDWPHQWWHDFKHUVXVHGWKHVWXG\ 

SURGXFW DQG RWKHU SURGXFWV WKRXJK RQH VFKRRO KDG D GLIIHUHQFH WKDW ZDV FORVH WR ]HUR 

8VDJH GLIIHUHQFHV DOVR DUH HYLGHQW EHWZHHQ GLVWULFWV )RU H[DPSOH WKH GLIIHUHQFH EHWZHHQ 

WUHDWPHQWDQGFRQWUROWHDFKHUWHFKQRORJ\XVDJHZDVUHODWLYHO\ODUJHLQGLVWULFWFRPSDUHGWR 

GLVWULFWVDQG&RUUHODWLRQVEHWZHHQXVDJHDQGSURGXFWHIIHFWVZLOOEHH[DPLQHGODWHULQ 

WKHFKDSWHU 

 

'DWDIURPSURGXFWUHFRUGVRQVWXGHQWXVDJHDOVRSURYLGHGLQIRUPDWLRQDERXWSURGXFW 

XVH )RXU RI WKH ILYH ILUVW JUDGH SURGXFWV LQFOXGHG GDWDEDVHV WKDW WUDFNHG WKH WLPH ZKHQ 

VWXGHQWVZHUHORJJHGRQVRPHSURGXFWVWUDFNHGXVDJHPRUHFORVHO\JDWKHULQJGDWDRQHYHU\ 

UHVSRQVHDQGNH\VWURNH$QDO\VLVRIWKHVHGDWDLQGLFDWHGWKDWZKHQVWXGHQWVXVHGSURGXFWV 

WKHLUXVDJHDYHUDJHGDERXWPLQXWHVDGD\DQGKRXUVD\HDU7DEOH,,8VDJHYDULHG 

 


23 

)LJXUH,, 

'LIIHUHQFHLQ$QQXDO7HDFKHU5HSRUWHG+RXUVRI5HDGLQJ7HFKQRORJ\3URGXFW8VH%HWZHHQ 

7UHDWPHQWDQG&RQWURO&ODVVURRPV 

)LUVW*UDGH 

 

 

+RXUV 

 

 

 

3 

3 

4 

5 

7 

8 

8 

8 

9 

9 

9 

9 

9 

10 

10 

14 

14 

 

 

1 

2 

2 

5 

6 

6 7 

6 

8 

10 

11 

11 

12 

13 

13 

14 

 

6FKRROV*URXSHGE\'LVWULFW 

1XPEHUVLQGLFDWHGLVWULFWVDQGHDFKSRLQWUHSUHVHQWVDVFKRRO 

6RXUFH7HDFKHU,QWHYLHZV 

7DEOH,,'DLO\DQG$QQXDO8VDJH)URP3URGXFW5HFRUGV 

 

3URGXFW 

$ 

3URGXFW 

% 

3URGXFW 

& 

3URGXFW 

' 

2YHUDOO 

7RWDOGD\VXVHGGXULQJVFKRRO\HDU 

0LQXWHVRIGDLO\XVHZKHQXVHG 

+RXUVRIDQQXDOXVH 

 

6RXUFH3URGXFWGDWDRQXVDJH2QHSURGXFWGLGQRWFROOHFWLQIRUPDWLRQRQVWXGHQWXVDJH2YHUDOOXVDJHLV 

SURGXFWXVDJHZHLJKWHGE\VWXGHQWVDPSOHVL]HV 

DFURVVSURGXFWVIURPPLQXWHVDGD\WRPLQXWHVDQGDQQXDOXVDJHYDULHGIURPKRXUV 

WRKRXUV)RUDW\SLFDOGD\VFKRRO\HDUDYHUDJHGDLO\XVDJHLVDERXWPLQXWHVIRUDOO 

SURGXFWVFRPELQHG $VVXPLQJWKDWUHDGLQJLVWDXJKWLQDPLQXWHEORFNSURGXFWVZHUH 

XVHGIRUDERXWSHUFHQWRIWRWDOUHDGLQJLQVWUXFWLRQWLPH 

 

8QOLNHSURGXFWUHSRUWVRIXVDJHWHDFKHUUHSRUWVRIXVDJHDUHDYDLODEOHIRUDOOSURGXFWV 

DQGFRPSOHWHQHVVLVDXVHIXOIHDWXUHIRUODWHUDQDO\VHV7HDFKHUUHSRUWVDERXWXVDJHDUHPRUH 

LQFOXVLYHWKDQSURGXFWXVDJHZKLFKLVDFWXDOVWXGHQWORJJHGLQWLPH7KH\FDQGLIIHUEHFDXVH 

RI VWXGHQW DEVHQWHHLVP FRPSXWHU RU QHWZRUN SUREOHPV DQG VWXGHQWV ZRUNLQJ WRJHWKHU 

0XOWLSO\LQJWRWDOGD\VRIXVDJHE\PLQXWHVXVHG\LHOGVPLQXWHVRIDQQXDOXVHZKLFKLV 

GLYLGHGE\WRDUULYHDWDYHUDJHXVHRIPLQXWHVSHUDFWXDOVFKRROGD\ 


24 

XQGHUDVLQJOHORJLQ+RZHYHUFRUUHODWLRQVEHWZHHQWKHWZRPHDVXUHVZHUHKLJKFRUUHODWLRQ 

FRHIILFLHQWV ZHUH DQG IRU ZHHNO\ DQG DQQXDO XVDJH DQG WKH KLJK FRUUHODWLRQV 

SURYLGHDEDVLVIRUXVLQJWHDFKHUUHSRUWVRIXVDJHLQWKHHIIHFWLYHQHVVDQDO\VLVODWHULQWKH 

FKDSWHU 

 

7KHOHYHOVRIXVDJHIRXQGKHUHUHODWHWRWHDFKHUVXVLQJSURGXFWVIRUWKHILUVWWLPHDQG 

ZLWKLQ D QDWLRQDO VWXG\ %RWK ILUVWWLPH XVDJH DQG WKH SUHVHQFH RI WKH VWXG\ FRXOG KDYH 

DIIHFWHGXVDJHFRPSDUHGWR´W\SLFDOµOHYHOVRIXVDJH:KHWKHUWHDFKHUVXVHSURGXFWVPRUHDV 

WKH\DUHPRUHH[SHULHQFHGLVEHLQJH[DPLQHGLQWKHVHFRQG\HDURIWKHVWXG\+RZWKHVWXG\ 

LWVHOIDIIHFWHGXVDJHLVQRWNQRZQ7KHVWXG\PD\KDYHLQFUHDVHGXVDJHEHFDXVHLWSXUFKDVHG 

KDUGZDUH DQG VRIWZDUH XSJUDGHV ZLWKRXW QHHGLQJ WR JR WKURXJK GLVWULFW SURFXUHPHQW 

SURFHVVHV7HDFKHUVUHFHLYHGKRQRUDULDIRUDWWHQGLQJWUDLQLQJRQKRZWRXVHSURGXFWVDQG 

QHDUO\DOOWHDFKHUVDWWHQGHGWUDLQLQJ$OVRWKHVWXG\WHDPSURYLGHGIHHGEDFNWRGHYHORSHUV 

DERXW DQ\ SUREOHPV RU LVVXHV HQFRXQWHUHG ZLWK WKH SURGXFW GXULQJ FODVVURRP YLVLWV LI 

WHDFKHUVDVNHGWKHPGRVR2QWKHRWKHUKDQGGLVWULFWVGLGQRWLQYHVWWKHLURZQUHVRXUFHVLQ 

SXUFKDVLQJSURGXFWVDQGWUDLQLQJWHDFKHUVZKLFKFRXOGKDYHUHGXFHGXVDJHEHFDXVHGLVWULFWV 

GLGQRWKDYHDVWDNHLQWKHSURGXFWV 

7HFKQLFDO'LIILFXOWLHV 

 

6WXG\ REVHUYHUV QRWHG WHFKQLFDO SUREOHPV GXULQJ FODVVURRP REVHUYDWLRQV LQ DERXW 

SHUFHQWRIWKHWLPHVHJPHQWVWKH\REVHUYHGDQREVHUYDWLRQFRQVLVWHGRIIRXUWRILYHWLPH 

VHJPHQWVZLWKLQDFODVVSHULRG0RVWSUREOHPVODVWHGRQO\DVKRUWWLPHDQGDIIHFWHGRQO\D 

IHZVWXGHQWV&RPPRQSUREOHPVLQYROYHGORJJLQJRQWRSURGXFWVFRPSXWHUVIUHH]LQJDQG 

QHHGLQJWREHUHERRWHGDQGWURXEOHZLWKSHULSKHUDOKDUGZDUHVXFKDVKHDGSKRQHV 

6DWLVIDFWLRQZLWK3URGXFWV 

1HDUO\DOOWHDFKHUVSHUFHQWVDLGWKH\ZRXOGXVHWKHSURGXFWLQWKHQH[WVFKRRO\HDU 

LIJLYHQWKHFKRLFH:KHQDVNHGZKDWWKH\ZRXOGFKDQJHSHUFHQWVDLGWKH\ZRXOGIRFXV 

RQ FODVVURRP PDQDJHPHQW LVVXHV UHODWHG WR SURGXFW XVH SHUFHQW VDLG WKH\ ZRXOG QRW 

FKDQJHDQ\WKLQJSHUFHQWVDLGWKH\ZRXOGVWDUWXVLQJSURGXFWVHDUOLHULQWKHVFKRRO\HDU 

DQGSHUFHQWVDLGWKH\ZRXOGPRQLWRUVWXGHQWSURJUHVVPRUHFORVHO\ 

5ROHRI3URGXFWVDQG7LPHDQG3ODFHRI8VH 

 

5HDGLQJ VRIWZDUH SURGXFWV JHQHUDOO\ IXQFWLRQHG DV VXSSOHPHQWV WR WKH UHDGLQJ 

FXUULFXOXP )RXU SURGXFWV ZHUH H[SUHVVO\ GHVLJQHG DV VXSSOHPHQWV DQG SHUFHQW RI 

WUHDWPHQWWHDFKHUVLQGLFDWHGWKH\XVHGSURGXFWVDVVXSSOHPHQWV2QHSURGXFWFRXOGEHXVHG 

DVHLWKHUDVXSSOHPHQWWRDUHDGLQJSURJUDPRUDVDFRUHUHDGLQJSURJUDPWKRXJKDOO 

WUHDWPHQWWHDFKHUVXVHGLWDVDVXSSOHPHQW 

 

7HDFKHUV YDULHG LQ KRZ WKH\ VFKHGXOHG SURGXFW XVH -XVW RYHU D WKLUG SHUFHQW 

VFKHGXOHGSURGXFWXVHH[FOXVLYHO\GXULQJUHJXODUFODVVWLPHSHUFHQWVFKHGXOHGXVHGXULQJ 

´RWKHUµ WLPHV VXFK DV EHIRUH VFKRRO OXQFKWLPH RU WLPH XVXDOO\ VHW DVLGH IRU VFLHQFH RU 

VRFLDO VFLHQFH DQG WKH ODUJHVW JURXS³ SHUFHQW³VFKHGXOHG XVH ERWK GXULQJ FODVV WLPH 


25 

DQG DW RWKHU WLPHV 0RVW WHDFKHUV SHUFHQW XVHG SURGXFWV LQ UHJXODU FODVVURRPV DQG 

SHUFHQWRIWHDFKHUVXVHGSURGXFWVLQDFRPSXWHUODE 

 

9HQGRUVVWUHVVHGWKHLPSRUWDQFHRIWHDFKHUVEHLQJSUHVHQWWRRIIHUDVVLVWDQFHRUNHHS 

VWXGHQWV RQ WDVN UDWKHU WKDQ UHO\LQJ RQ ODE PRQLWRUV RU SDUDSURIHVVLRQDOV 1HDUO\ DOO ILUVW 

JUDGH WUHDWPHQW WHDFKHUV SHUFHQW UHSRUWHG EHLQJ SUHVHQW ZKHQ WKHLU VWXGHQWV XVHG 

SURGXFWV 9HQGRUV DOVR VWUHVVHG WKH LPSRUWDQFH RI UHYLHZLQJ SURGXFW UHSRUWV RQ VWXGHQW 

SHUIRUPDQFHSHUFHQWRIWHDFKHUVUHSRUWHGUHYLHZLQJUHSRUWVWZRWRWKUHHWLPHVDPRQWK 

RU PRUH IUHTXHQWO\ DQG SHUFHQW UHSRUWHG UHYLHZLQJ SHUIRUPDQFH UHSRUWV RQFH D ZHHN 

RUPRUH 

,PSDFWRQ&ODVVURRP$FWLYLWLHV 

 

3UHYLRXVVWXGLHVKDYHUHSRUWHGWKDWWHFKQRORJ\FDQFKDQJHWKHUROHRIWHDFKHUV+RQH\ 

DQG +HQULTXH] /LQQ DQG +VL 6DQGKROW] HW DO 7KLV UROH FKDQJH LV 

VRPHWLPHV YLHZHG DV WKH GHVLUHG RXWFRPH ZLWK WHDFKHUV HQFRXUDJHG QRW WR VSHQG WLPH 

GLVSHQVLQJLQIRUPDWLRQ´WKHVDJHRQWKHVWDJHµEXWLQVWHDGWRDFWDVDIDFLOLWDWRU´WKHJXLGH 

RQWKHVLGHµKHOSLQJVWXGHQWVRUVPDOOJURXSVZKRDUHHQJDJHGLQWKHLURZQOHDUQLQJWDVNV 

%HFDXVHWKHVDPHREVHUYDWLRQSURWRFROZDVXVHGIRUWUHDWPHQWDQGFRQWUROFODVVURRPVWKH 

VWXG\FRXOGFRQWUDVWFODVVURRPDFWLYLWLHVWRDVVHVVZKHWKHUSURGXFWVDIIHFWHGWKHDFWLYLWLHV 

'XULQJ REVHUYDWLRQ LQWHUYDOV WHDFKHUV ZHUH FODVVLILHG DV OHDGHUV IDFLOLWDWRUV PRQLWRUV 

VFDQQLQJWKHFODVVWRGHWHFWDQ\EHKDYLRUDOLVVXHVRURWKHUZLVHHQJDJHG7DEOH,,VKRZV 

WKDW GXULQJ REVHUYDWLRQ LQWHUYDOV WKH WLPH SHULRGV GXULQJ ZKLFK REVHUYHUV QRWHG WHDFKHU 

UROHV SHUFHQW RI REVHUYDWLRQV LQ WUHDWPHQW FODVVURRPV FRGHG WKH WHDFKHU·V UROH DV 

ÍDFLOLWDWLQJµFRPSDUHGWRSHUFHQWRIFRQWUROFODVVURRPREVHUYDWLRQVS 

 

3URGXFWV DOVR FKDQJHG WKH W\SLFDO DFWLYLW\ LQ ZKLFK VWXGHQWV ZHUH HQJDJHG 6WXGHQWV 

ZHUHPRUHOLNHO\WREHHQJDJHGLQLQGLYLGXDOZRUNGXULQJWUHDWPHQWFODVVURRPREVHUYDWLRQV 

WKDQGXULQJFRQWUROFODVVURRPREVHUYDWLRQVS6WXGHQWVLQFRQWUROFODVVHVZHUHPRUH 

OLNHO\WREHOLVWHQLQJWRDWHDFKHURUSDUWLFLSDWLQJLQDTXHVWLRQDQGDQVZHUVHVVLRQGLUHFWHGE\ 

WKHWHDFKHU 

 

10 7KHREVHUYDWLRQSURWRFROFDOOHGIRUREVHUYHUVWRREVHUYHSHULRGVGXULQJZKLFKWUHDWPHQWWHDFKHUVZHUH 

XVLQJUHDGLQJSURGXFWV7RWKHH[WHQWSRVVLEOHFRQWUROFODVVURRPVZHUHREVHUYHGGXULQJWKHVDPHWLPHSHULRG 

WKDWWUHDWPHQWWHDFKHUVZHUHXVLQJSURGXFWV)RUH[DPSOHLIWUHDWPHQWWHDFKHUVLQDSDUWLFXODUVFKRROXVHGWKH 

SURGXFWGXULQJWKHODVWKDOIRIWKHUHDGLQJSHULRGREVHUYHUVDWWHPSWHGWRREVHUYHFRQWUROFODVVURRPVGXULQJ 

WKHODVWKDOIRIWKHUHDGLQJSHULRG,IREVHUYHUVKDGREVHUYHGFODVVURRPVDWUDQGRPWLPHVUDWKHUWKDQZKHQ 

SURGXFWVZHUHXVHGWKHGLIIHUHQFHVVKRZQLQWKHWDEOHPD\KDYHEHHQVPDOOHUEHFDXVHSURGXFWVZRXOGQRWEH 

LQXVHGXULQJVRPHRIWKHREVHUYDWLRQV 


26 

3UHYLRXV VWXGLHV KDYH REVHUYHG WKDW VWXGHQWV PD\ EH PRUH DFDGHPLFDOO\ IRFXVHG ZKHQ 

ZRUNLQJRQFRPSXWHUV-R\QHU6ZDQHWDO7DEOH,,VKRZVWKDWWKHSURSRUWLRQ 

RIWUHDWPHQWDQGFRQWUROFODVVURRPREVHUYDWLRQVLQZKLFKPRUHWKDQSHUFHQWRIVWXGHQWV 

ZHUHRQWDVNZDVKLJKRYHUDOODQGDERXWWKHVDPHSHUFHQWRIWUHDWPHQWFODVVURRPVDQG 

SHUFHQWRIFRQWUROFODVVURRPV 

 

 

7DEOH,,$FWLYLWLHVLQ7UHDWPHQWDQG&RQWURO&ODVVURRPV)LUVW*UDGH3HUFHQWDJHRI 

2EVHUYDWLRQ,QWHUYDOV 

 

 

7UHDWPHQW 

&ODVVURRPV 

&RQWURO 

&ODVVURRPV 

SYDOXH D 

7HDFKHU5ROH3HUFHQW E 

/HDGHU 

)DFLOLWDWRU 

0RQLWRUREVHUYHU 

:RUNLQJRQRWKHUWDVNV 

2WKHU ! 

,QVWUXFWLRQDO$FWLYLW\3HUFHQW E 

,QGLYLGXDOZRUN 

/HFWXUH 

4XHVWLRQDQGDQVZHU 

5HYLHZRIVWXGHQWZRUN 

2WKHU ! 

6WXGHQW2Q7DVN%HKDYLRU3HUFHQW 

3HUFHQWRIWLPHLQWHUYDOVZLWKPRUHWKDQ 

 

 

SHUFHQWRIVWXGHQWVRQWDVN 

 

! 

6DPSOH6L]H 

1XPEHURIFODVVURRPV 

1XPEHURIREVHUYDWLRQV 

 

 

 

6RXUFH&ODVVURRPREVHUYDWLRQVDWPLQXWHVDQGIRUHDFKFODVV 

 

 

 

D7HVWVRIGLIIHUHQFHZHUHFRQGXFWHGXVLQJWZROHYHOKLHUDUFKLFDOPRGHOVZLWKDWHDFKHUOHYHODQGDVFKRRO 

OHYHOZLWKWKHWUHDWPHQWHIIHFWDWOHYHORQHDQGEHWZHHQVFKRROYDULDQFHDWOHYHOWZR7KHSYDOXHLVWKH 

VPDOOHVWOHYHORIVLJQLILFDQFHDWZKLFKWKHQXOOK\SRWKHVLVWKDWWKHGLIIHUHQFHLV]HURFDQEHUHMHFWHG,I 

WKHSYDOXHLVOHVVWKDQWKHGLIIHUHQFHLVVLJQLILFDQWDWWKHSHUFHQWOHYHO,IWKHSYDOXHLVOHVVWKDQ 

WKHGLIIHUHQFHLVVLJQLILFDQWDWWKHSHUFHQWOHYHODQGVRRQ 

E2EVHUYHUVFRGHG´DOOWKDWDSSO\µ1XPEHUVFDQDGGWRPRUHWKDQSHUFHQW 

 

$QRWKHU DVSHFW RI LQVWUXFWLRQ LV WKH DPRXQW RI WLPH DOORWWHG IRU UHDGLQJ LQVWUXFWLRQ 

ZKLFKLVZLWKLQWKHFRQWURORIWHDFKHUVWRVRPHGHJUHHDQGFRXOGEHLQIOXHQFHGE\WKHXVHRI 

VWXG\SURGXFWV7KHVWXG\DVNHGWUHDWPHQWDQGFRQWUROWHDFKHUVWRHVWLPDWHKRZPXFKWLPH 

 

2EVHUYHUV HVWLPDWHG WKH SURSRUWLRQ RI VWXGHQWV ZKR ZHUH GRLQJ VRPHWKLQJ RWKHU WKDQ WKH DVVLJQHG 

DFDGHPLFWDVNGXULQJDRQHPLQXWHVHJPHQWXVLQJFDWHJRULHVVXFKDVZDONLQJDURXQGWKHFODVVURRPIRUUHDVRQV 

XQUHODWHGWRWKHWDVNWDONLQJZLWKRWKHUVWXGHQWVRQWRSLFVXQUHODWHGWRWKHWDVNWDONLQJZLWKRWKHUVWXGHQWV 

ZKLOHWKHWHDFKHUZDVDGGUHVVLQJWKHZKROHFODVVVLWWLQJDWWKHFRPSXWHUIRUORQJSHULRGVZLWKQRLQWHUDFWLRQV 

ZLWKNH\ERDUGRUPRXVHRUVOHHSLQJRUKDYLQJWKHLUKHDGVRQWKHLUGHVNV 

 


27 

WKH\ VSHQW RQ UHDGLQJ LQVWUXFWLRQ 7UHDWPHQW WHDFKHUV UHSRUWHG VSHQGLQJ DQ DYHUDJH RI 

KRXUVDZHHNFRPSDUHGWRKRXUVRQDYHUDJHIRUFRQWUROWHDFKHUV7KHGLIIHUHQFHRI 

KRXUVZDVQRWVWDWLVWLFDOO\VLJQLILFDQWS 

% (IIHFWVRQ5HDGLQJ7HVW6FRUHV 

$ FHQWUDO TXHVWLRQ IRU WKH VWXG\ LV ZKHWKHU SURGXFWV UHVXOWHG LQ KLJKHU WHVW VFRUHV 

(IIHFWV RQ WHVW VFRUHV ZHUH HVWLPDWHG XVLQJ D PRGHO WKDW DFFRXQWHG IRU WKH QHVWLQJ RI 

VWXGHQWVLQFODVVURRPVDQGFODVVURRPVLQVFKRROV7KHHVWLPDWHVVKRZWKDWHIIHFWVRQWHVW 

VFRUHVJHQHUDOO\ZHUHQRWVWDWLVWLFDOO\GLIIHUHQWIURP]HURDQGWKDWPRVWWHDFKHUDQGVFKRRO 

FKDUDFWHULVWLFV ZHUH XQFRUUHODWHG ZLWK HIIHFWV 'LIIHUHQW HVWLPDWLRQ DSSURDFKHV \LHOGHG 

VLPLODUHVWLPDWHV,QWZRGLVWULFWVIRUZKLFKGLVWULFWWHVWVFRUHVZHUHDYDLODEOHXVHRIGLVWULFW 

WHVW VFRUHV UDWKHU WKDQ WKH VWXG\DGPLQLVWHUHG WHVW DV WKH PHDVXUH RI DFKLHYHPHQW \LHOGHG 

VLPLODUUHVXOWV$SSHQGL[%SURYLGHVGHWDLOVRIWKHUREXVWQHVVDQDO\VLV 

&KDUDFWHULVWLFVRI7UHDWPHQWDQG&RQWURO7HDFKHUVDQG6WXGHQWVLQ7UHDWPHQWDQG 

&RQWURO&ODVVURRPV 

 

7KH VWXG\ UDQGRPO\ DVVLJQHG WHDFKHUV WR WUHDWPHQW DQG FRQWURO JURXSV :KHWKHU 

UDQGRP DVVLJQPHQW DFKLHYHG LWV REMHFWLYH FDQ EH DVVHVVHG E\ H[DPLQLQJ EDVHOLQH 

FKDUDFWHULVWLFV RI WHDFKHUV LQ WKH WZR JURXSV 7DEOH ,, VKRZV WHDFKHU FKDUDFWHULVWLFV DQG 

SYDOXHV RI WHVWV RI HTXLYDOHQFH $IWHU DFFRXQWLQJ IRU PXOWLSOH FRPSDULVRQV QRQH RI WKH 

WHDFKHUGLIIHUHQFHVLVVWDWLVWLFDOO\VLJQLILFDQW+RZHYHUDOOWKHFKDUDFWHULVWLFVDUHHQWHUHGLQWR 

PRGHOVWRDGMXVWIRUUHPDLQLQJGLIIHUHQFHV 

 

7KH VWXG\ GLG QRW UDQGRPO\ DVVLJQ VWXGHQWV WR WHDFKHUV EXW 7DEOH ,, VKRZV WKDW 

VWXGHQWV LQ WUHDWPHQW DQG FRQWURO FODVVURRPV ZHUH VLPLODU RQ IDOO WHVW VFRUHV DJH DQG 

JHQGHU$IWHUDFFRXQWLQJIRUPXOWLSOHFRPSDULVRQVQRQHRIWKHGLIIHUHQFHVLVVLJQLILFDQW 

6WDQGDUGVFRUHVIRUWKH72:5(WHVWZKLFKDYHUDJHGDERXWSODFHVWXGHQWVLQDERXWWKH 

WK SHUFHQWLOHQDWLRQDOO\KLJKHUWKDQWKHLUSHUIRUPDQFHRQWKH6(6$7ZKHUHWKHDYHUDJH 

VWXGHQWVZHUHDWDERXWWKH WK SHUFHQWLOH7KHVLPSOHFRUUHODWLRQEHWZHHQVFRUHVZDVDERXW 

7KHVHGLIIHUHQFHVPD\DULVHEHFDXVHRIGLIIHUHQFHVLQZKDWLVEHLQJWHVWHGGLIIHUHQFHV 

LQKRZWKHWHVWLVFRQGXFWHGWKH72:5(LVRQHRQRQHDQGWKH6(6$7LVDGPLQLVWHUHGLQ 

JURXSVRUGLIIHUHQFHVLQWKHQRUPVDPSOHVRQZKLFKWKHSHUFHQWLOHVDUHEDVHG 

12 7KHIDOOWHVWZDVDGPLQLVWHUHGDIWHUWKHVFKRRO\HDUZDVXQGHUZD\DQGLQSULQFLSOHVFRUHVFRXOGKDYH 

EHHQDIIHFWHGE\WKHXVHRISURGXFWV7KHIDFWWKDWWKHDYHUDJHWUHDWPHQWJURXSVFRUHZDVQRWVWDWLVWLFDOO\ 

GLIIHUHQWIURPWKHDYHUDJHFRQWUROJURXSVFRUHVXJJHVWVWKDWWKHXVHRISURGXFWVGLGQRWKDYHPXFKLIDQ\ 

HIIHFWRQIDOOVFRUHV 

13 $UHFHQWVWXG\WKDWH[DPLQHGLQWHUYHQWLRQVIRUVWUXJJOLQJUHDGHUVDGPLQLVWHUHGDYDULHW\RIUHDGLQJWHVWV 

DQGDOVRIRXQGWKDWVWXGHQWSHUFHQWLOHUDQNLQJVYDULHGGHSHQGLQJRQWKHWHVW6HHKWWSZZZPDWKHPDWLFD 

PSUFRPSXEOLFDWLRQV3')V&75*H[HFSGI 


28 

7DEOH,,&KDUDFWHULVWLFVRI7HDFKHUVDQG6WXGHQWVLQ7UHDWPHQWDQG&RQWURO&ODVVURRPV 

)LUVW*UDGH 

 

7UHDWPHQW 

&ODVVURRPV 

&RQWURO 

&ODVVURRPV 

SYDOXHRIWKH 

'LIIHUHQFH D 

7HDFKHU&KDUDFWHULVWLFV 

7HDFKLQJH[SHULHQFH\HDUV 

+DVDPDVWHU·VGHJUHHSHUFHQW 

6FKRROKDVFRPSXWHUVSHFLDOLVWSHUFHQW 

5HFHLYHGSURIHVVLRQDOGHYHORSPHQWRQXVLQJ 

WHFKQRORJ\ODVW\HDUSHUFHQW 

)HPDOHSHUFHQW 

7HDFKHU6DPSOH6L]H 

6WXGHQW&KDUDFWHULVWLFV 

)HPDOHSHUFHQW 

$JHDVRI2FWREHU\HDUV 

8QDGMXVWHGVFRUHRQIDOO7HVWRI:RUG5HDGLQJ 

(IILFLHQF\VWDQGDUGVFRUH 

8QDGMXVWHGVFRUHRQIDOO6$75HDGLQJ7HVW 

1&( 

6WXGHQW6DPSOH6L]H 

 

6RXUFHV 7HDFKHUTXHVWLRQQDLUHVWXGHQWUHFRUGVDQGWHVWVDGPLQLVWHUHGE\VWXG\VWDII 

1RWH 0XOWLSOHFRPSDULVRQVWHVWLQJXVHGWKH%HQMDPLQL+RFKEHUJSURFHGXUHZLWKVHSDUDWHWHVWVIRUILYH 

WHDFKHUFKDUDFWHULVWLFVDQGIRXUVWXGHQWFKDUDFWHULVWLFV 

D7HVWV RI WUHDWPHQW DQG FRQWURO GLIIHUHQFHV ZHUH FRQGXFWHG XVLQJ D WZROHYHO KLHUDUFKLFDO PRGHO ZLWK 

FODVVURRPWUHDWPHQWVWDWXVDVDIL[HGHIIHFWDQGVFKRRODVDUDQGRPHIIHFWIRUWHDFKHUVDQGFODVVURRPV 

DQGVFKRROVDVUDQGRPHIIHFWVIRUVWXGHQWV7KH SYDOXHRIWKHGLIIHUHQFHVKRZQLQWKHWDEOHLVWKH 

SYDOXHRIWKHHVWLPDWHGWUHDWPHQWFRHIILFLHQW 

(IIHFWV:HUH1RW6WDWLVWLFDOO\'LIIHUHQWIURP=HUR 

 

(IIHFWVZHUHHVWLPDWHGXVLQJDWKUHHOHYHOKLHUDUFKLFDOOLQHDUPRGHO7KHPDLQRXWFRPH 

DW WKH ILUVW OHYHO LV WKH VSULQJ WHVW VFRUH ZKLFK LV UHODWHG WR VWXGHQW FKDUDFWHULVWLFV DJH 

JHQGHUDQGWKHIDOOVFRUH7KHVHFRQGOHYHOLVDPRGHORIDFODVVURRP·VDYHUDJHWHVWVFRUHDV 

DIXQFWLRQRIFODVVURRPFKDUDFWHULVWLFVPRVWLPSRUWDQWO\DWUHDWPHQWLQGLFDWRURIZKHWKHUD 

FODVVURRP ZDV UDQGRPO\ DVVLJQHG WR XVH D SURGXFW 7KH WKLUG OHYHO LV D PRGHO RI WKH 

VFKRRO·V DYHUDJH WHVW VFRUH DV D IXQFWLRQ RI VFKRRO FKDUDFWHULVWLFV VXFK DV SURSRUWLRQ RI 

VWXGHQWV UHFHLYLQJ IUHH RU UHGXFHGSULFH OXQFK UDFH DQG HWKQLF FRPSRVLWLRQ DQG WKH 

SURSRUWLRQRIVWXGHQWVUHFHLYLQJVSHFLDOHGXFDWLRQVHUYLFHV7KHVHVFKRROFKDUDFWHULVWLFVDOVR 

DUH VWXGHQW FKDUDFWHULVWLFV EXW QHDUO\ FRPSOHWH GDWD IURP WKH &RPPRQ &RUH RI 'DWD ZHUH 

DYDLODEOHIRUWKHVHLWHPVZKHUHDVWKHVWXG\·VHIIRUWVWRFROOHFWWKHVDPHLWHPVIURPVFKRRO 

UHFRUGVIRULQGLYLGXDOVWXGHQWVUHVXOWHGLQJDSVDQGPLVVLQJGDWD 

 


29 

7DEOH ,, VKRZV VFRUH GLIIHUHQFHV IRU WKH RYHUDOO 6$7 UHDGLQJ WHVW DQG LWV WKUHH 

VXEWHVWVDQGIRUWKHRYHUDOO7HVWRI:RUG5HDGLQJ(IILFLHQF\DQGLWVWZRVXEWHVWV 1RQHRI 

WKHGLIIHUHQFHVLVVWDWLVWLFDOO\GLIIHUHQWIURP]HUR(IIHFWVL]HVDUHLQWKHUDQJHRIWR 

 

Table II.6. Spring Reading Test Score Differences in Treatment and Control Classrooms, 

First Grade. 

 

7UHDWPHQW 

&ODVVURRP 

$YHUDJH 

6FRUH 

&RQWURO 

&ODVVURRP 

$YHUDJH 

6FRUH 

'LIIHUHQFH 

(IIHFW 

6L]H 

SYDOXH 

6WDQIRUG $FKLHYHPHQW7HVW 1LQWK 

(GLWLRQ1&( 

2YHUDOOVFRUH 

6XEWHVWVFRUHV 

6RXQGVDQGOHWWHUV 

:RUGUHDGLQJ 

6HQWHQFHUHDGLQJ 

7HVWRI:RUG5HDGLQJ(IILFLHQF\ 

6WDQGDUG6FRUH 

2YHUDOOVFRUH 


3KRQHPLFGHFRGLQJHIILFLHQF\ 

6LJKWZRUGHIILFLHQF\ 

1RWH 

 

6HH$SSHQGL[%IRUGHWDLOVRIWKHHVWLPDWLRQPRGHO9DULDEOHVLQWKHPRGHOLQFOXGHVWXGHQWDJHJHQGHU 

DQGWKHSUHWHVWVFRUHVWHDFKHUJHQGHUH[SHULHQFHDQGZKHWKHUKHRUVKHKDGDPDVWHU·VGHJUHHVFKRRO 

UDFHDQGHWKQLFLW\SHUFHQWRIVWXGHQWVLQVSHFLDOHGXFDWLRQSHUFHQWHOLJLEOHIRUIUHHOXQFKDQGVWXGHQW 

FODVVURRPDQGVFKRROUDQGRPHIIHFWV 

7KHWUHDWPHQWFODVVURRPDYHUDJHVFRUHUHSRUWHGLQWKHWDEOHLVWKHFRQWUROFODVVURRPDYHUDJHVFRUHSOXV 

WKHWUHDWPHQWHIIHFW,WGLIIHUVIURPWKHXQDGMXVWHGWUHDWPHQWFODVVURRPVFRUH 

7KH VWXG\ H[DPLQHG ZKHWKHU SURGXFWV UHGXFHG WKH SURSRUWLRQ RI VWXGHQWV ZKR ZHUH 

ORZVFRUHUVRQWKH6$7E\FUHDWLQJDQLQGLFDWRURIZKHWKHUDVWXGHQWIHOOLQWKHORZHUWKLUG 

RIVFRUHVDQGHVWLPDWLQJDWKUHHOHYHOPRGHOZLWKWKDWLQGLFDWRUDVWKHRXWFRPH:KHWKHUWKH 

VWXGHQWZDVEHORZWKH UG SHUFHQWLOHRQWKHSUHWHVWZDVXVHGDVDFRYDULDWHDORQJZLWKWKH 

14 7KHPDLQPRGHOHVWLPDWHGDVLQJOHHIIHFWIRUDOOILYHSURGXFWVE\LQFOXGLQJDQLQGLFDWRUWKDWDVWXGHQW 

ZDVLQDWUHDWPHQWFODVVURRPUHJDUGOHVVRIWKHSURGXFWXVHGLQWKHFODVVURRP7KLVDSSURDFKHVVHQWLDOO\ 

DYHUDJHV LQGLYLGXDO SURGXFW HIIHFWV ZLWK ZHLJKWV WKDW DUH SURSRUWLRQDO WR WKH QXPEHU RI FODVVURRPV WKDW 

SURGXFWVKDYHLQWKHVWXG\3URGXFWVZLWKPRUHFODVVURRPVFRQWULEXWHPRUHWRWKHHVWLPDWHGHIIHFW 

15 (IIHFWVL]HVDUHFDOFXODWHGE\GLYLGLQJWKHVFRUHGLIIHUHQFHVKRZQLQWKHWDEOHE\WKHVWDQGDUGGHYLDWLRQ 

RI WKH GLVWULEXWLRQ RI VSULQJ WHVW VFRUHV IRU WKH IXOO FRQWURO JURXS 6HH $SSHQGL[ 7DEOH $D IRU VWDQGDUG 

GHYLDWLRQV. 


30 

VDPHVHWRIYDULDEOHVXVHGIRUWKHVFRUHPRGHODERYH7KHUHVXOWVLQGLFDWHGWKDWSURGXFWVGLG 

QRWKDYHDVWDWLVWLFDOO\VLJQLILFDQWHIIHFWRQZKHWKHUVWXGHQWVZHUHORZVFRUHUV7DEOH,, 

 

7DEOH,,(IIHFWRQ3HUFHQWRI6WXGHQWVLQ/RZHVW7KLUGRI5HDGLQJ7HVW6FRUH 

 

 

7UHDWPHQW 

&ODVVURRP 

3HUFHQWDJH 

&RQWURO 

&ODVVURRP 

3HUFHQWDJH 

'LIIHUHQFH 

(IIHFW 

6L]H 

SYDOXH 

3HUFHQWRIVWXGHQWVEHORZ UG 

SHUFHQWLOHRIVSULQJUHDGLQJWHVW 

1RWH 

 

2WKHU YDULDEOHV LQ WKH PRGHO LQFOXGH VWXGHQW DJH JHQGHU DQG WKH SUHWHVW VFRUHV WHDFKHU JHQGHU 

H[SHULHQFHDQGZKHWKHUKHRUVKHKDGDPDVWHU·VGHJUHHVFKRROUDFHDQGHWKQLFLW\SHUFHQWRIVWXGHQWV 

LQVSHFLDOHGXFDWLRQSHUFHQWHOLJLEOHIRUIUHHOXQFKDQGVWXGHQWFODVVURRPDQGVFKRROUDQGRPHIIHFWV 

7KHWUHDWPHQWFODVVURRPSHUFHQWDJHUHSRUWHGLQWKHWDEOHLVWKHFRQWUROFODVVURRPSHUFHQWDJHSOXVWKH 

WUHDWPHQWHIIHFW,WGLIIHUVIURPWKHXQDGMXVWHGWUHDWPHQWSHUFHQWDJH7KHHIIHFWVL]HLVFDOFXODWHGXVLQJ 

WKH&R[,QGH[WKHORJRGGVUDWLRGLYLGHGE\ 

)LJXUHV ,, DQG ,, GHSLFW WKH YDULDWLRQ RI VFKRRO HIIHFW VL]HV IRU GLVWULFWV DQG 

SURGXFWV )RUH[DPSOHLQGLVWULFWHIIHFWVL]HVUDQJHGIURPDOPRVWWRQHDUO\ 

DFURVVWKHVL[VFKRROVLQWKHGLVWULFW$QDQDO\VLVRIYDULDQFHLQGLFDWHVWKDWSHUFHQWRIWKH 

YDULDELOLW\RIWKHHIIHFWVL]HLVZLWKLQGLVWULFWVDQGSHUFHQWLVEHWZHHQGLVWULFWV 

&ODVVURRPDQG6FKRRO0RGHUDWRUV 

 

&ODVVURRP DQG VFKRRO FKDUDFWHULVWLFV PD\ KHOS H[SODLQ WKH YDULDELOLW\ RI HIIHFWV 

REVHUYHGLQ)LJXUH,,7KHPRGHUDWLQJHIIHFWRIWKHVHFKDUDFWHULVWLFVZDVLQYHVWLJDWHGE\ 

LQWHUDFWLQJ WKH WUHDWPHQW LQGLFDWRU ZLWK FODVVURRP FKDUDFWHULVWLFV DW WKH VHFRQG OHYHO DQG 

DGGLQJDQHTXDWLRQWRWKHPRGHO·VWKLUGOHYHOWKDWVSHFLILHGWKHWUHDWPHQWHIIHFWDVDIXQFWLRQ 

RIVFKRROFKDUDFWHULVWLFV7KHDPRXQWRIWLPHWHDFKHUVUHSRUWHGXVLQJVWXG\SURGXFWVVKRZQ 

LQ7DEOH,,DOVRZDVLQFOXGHGLQWKHPRGHODVZDVWKHDPRXQWRIWLPHWHDFKHUVUHSRUWHG 

XVLQJRWKHUSURGXFWV2WKHULPSOHPHQWDWLRQIDFWRUVLQFOXGHGLQWKHPRGHOZHUHZKHWKHU 

DWHDFKHUKDGDGHTXDWHWLPHWRSUHSDUHIRUSURGXFWXVHZKHWKHUWKHWHDFKHULQGLFDWHG 

7ZROHYHOPRGHOVDOVRZHUHHVWLPDWHGIRUVWXGHQWVLQHDFKTXDUWLOHEDVHGRQWKHIDOOVFRUHWRDVVHVV 

SURGXFWHIIHFWVDFURVVWKHDFKLHYHPHQWGLVWULEXWLRQ(VWLPDWHGHIIHFWDQGSYDOXHVIRUWKHIRXUTXDUWLOHVZHUH 

DQG 

17 6FKRROHIIHFWVZHUHHVWLPDWHG XVLQJDUHJUHVVLRQPRGHOLQZKLFKWHVWVFRUHVDUHUHJUHVVHGRQVWXGHQW 

DQGWHDFKHUFKDUDFWHULVWLFVDQGWKHWUHDWPHQWLQGLFDWRULVLQWHUDFWHGZLWKDQLQGLFDWRUIRUHDFKVFKRRO6WDQGDUG 

HUURUV ZHUH DGMXVWHG IRU FODVVURRP FOXVWHULQJ (IIHFW VL]HV IRU VFKRROV DUH FDOFXODWHG E\ GLYLGLQJ WKH VFRUH 

GLIIHUHQFH IRU HDFK VFKRRO E\ WKH VWDQGDUG GHYLDWLRQ RI WKH GLVWULEXWLRQ RI FRQWURO JURXS WHVW VFRUHV $Q 

DOWHUQDWHHIIHFWVL]HZDVFDOFXODWHGE\GLYLGLQJWKHVFRUHGLIIHUHQFHIRUHDFKVFKRROE\WKHVWDQGDUGGHYLDWLRQRI 

WKHGLVWULEXWLRQRIFRQWUROJURXSWHVWVFRUHVIRUVWXGHQWVLQWKDWVFKRRO7KHDOWHUQDWHHIIHFWVL]HVVKRZWKH 

VDPHSDWWHUQEHWZHHQVFKRROVEXWDUHPRUHYDULDEOH 


31 

,,(IIHFWVRI)LUVW*UDGH5HDGLQJ6RIWZDUH3URGXFWV 

1RWH 6WDWLVWLFDOVLJQLILFDQFHRIDYHUDJHHIIHFWVL]HVFDQQRWEHLQIHUUHGIURPWKHILJXUHEHFDXVHVWXGHQW 

DQGWHDFKHUVDPSOHVL]HVGLIIHUEHWZHHQVFKRROV 

)LJXUH,, 

6FKRRO/HYHO(IIHFW6L]HVE\'LVWULFW 

)LUVW*UDGH6$75HDGLQJ6FRUH 

1 

2 

2 

2 

2 

3 

3 

4 

5 

5 

5 

6 

6 

6 

7 

7 

8 

8 

8 

8 

9 

9 

9 

9 

9 

9 

10 

10 

10 

11 

11 

12 

13 

13 

13 

14 

14 

14 

14 

14 

14 

 

 

 

 

 

 

 

 

 

(IIHFW6L]H 


)LJXUH,, 

6FKRRO/HYHO(IIHFW6L]HVE\3URGXFW 

)LUVW*UDGH6$75HDGLQJ6FRUH 

A 

A 

A 

A 

A 

A 

A 

A 

A 

B 

B 

B 

B 

C 

C 

C 

C 

C 

C 

D 

D 

D 

D 

E 

E 

E 

E 

E 

E 

E 

E 

E 

 

 

 

 

 

 

 

 

 

(IIHFW6L]H 

/HWWHUVLQGLFDWHSURGXFWVDQGHDFKSRLQWUHSUHVHQWVDVFKRRO

32 

WKDW VWXGHQWV KDG SUREOHPV DFFHVVLQJ WKH SURGXFWV DQG ZKHWKHU WKH WHDFKHU LQGLFDWHG 

WKDWWKHVFKRROKDVDFRPSXWHUVSHFLDOLVW7KHWKUHHPHDVXUHVZHUHEDVHGRQWHDFKHUUHSRUWV 

 

7DEOH,,VKRZVHVWLPDWHVRIWKHUHODWLRQVKLSVRIFODVVURRPDQGVFKRROFKDUDFWHULVWLFV 

ZLWKSURGXFWHIIHFWVIRUWKHRYHUDOO6$7VFRUHDQGWKUHHVXEWHVWVFRUHV7DEOH,,VKRZV 

HVWLPDWHVIRUWKH7HVWRI:RUG5HDGLQJ(IILFLHQF\7KHWDEOHVSUHVHQWRQO\WKHPRGHUDWRU 

HVWLPDWHVDQGQRWHVWLPDWHVIRUDOOYDULDEOHVLQWKHPRGHO3RVLWLYHFRHIILFLHQWVLQGLFDWHWKDWD 

FKDUDFWHULVWLFLVDVVRFLDWHGZLWKODUJHUWHVWVFRUHGLIIHUHQFHVEHWZHHQWUHDWPHQWDQGFRQWURO 

FODVVURRPV 

 

6WDWLVWLFDOWHVWVLQGLFDWHWKDWWKHIXOOVHWRIFODVVURRPDQGVFKRROFKDUDFWHULVWLFVZDVQRW 

FRUUHODWHG ZLWK SURGXFW HIIHFWV IRU WKH RYHUDOO 6$7 VFRUH 5HVXOWV RI VHSDUDWH WHVWV RI 

FODVVURRPDQGVFKRROFKDUDFWHULVWLFVDVGLVWLQFWVXEVHWVDUHDOVRVKRZQDQGLQGLFDWHVLPLODU 

UHVXOWV$IWHUDGMXVWLQJIRUPXOWLSOHFRPSDULVRQVRQO\WKHVWXGHQWWHDFKHUUDWLRLVVWDWLVWLFDOO\ 

VLJQLILFDQW7LPHXVLQJVWXG\SURGXFWVZDVQRWUHODWHGWRHIIHFWV 

)RU 6$7 VXEWHVWV VWDWLVWLFDO WHVWV LQGLFDWH WKDW VFKRRO DQG FODVVURRP FKDUDFWHULVWLFV 

ZHUHFRUUHODWHGZLWKHIIHFWVIRUWKHVRXQGVDQGOHWWHUVDQGZRUGUHDGLQJVXEWHVWV)RUWKH 

ZRUG UHDGLQJ VXEWHVW WKH VWXGHQWWHDFKHU UDWLR DQG WKH SHUFHQW RI VWXGHQWV LQ VSHFLDO 

HGXFDWLRQZHUHLQGLYLGXDOO\VLJQLILFDQWDIWHUDGMXVWLQJIRUPXOWLSOHFRPSDULVRQV)RUWKH7HVW 

RI :RUG 5HDGLQJ (IILFLHQF\ QR FODVVURRP RU VFKRRO FKDUDFWHULVWLFV ZHUH FRUUHODWHG ZLWK 

HIIHFWV 

 

%HFDXVHWKHUHVHDUFKGHVLJQGLGQRWUDQGRPO\DVVLJQSURGXFWVWRVFKRROVZLWKGLIIHUHQW 

FKDUDFWHULVWLFVIDFWRUVWKDWOHGVFKRROVWRFKRRVHSDUWLFXODUSURGXFWVDQGWRKDYHSDUWLFXODU 

H[SHULHQFHVZLWKWKHSURGXFWVFRXOGH[SODLQWKHREVHUYHGFRUUHODWLRQV)RUH[DPSOHHIIHFWV 

ZHUH ODUJHU ZKHQ FODVVHV KDG IHZHU VWXGHQWV VPDOOHU VWXGHQWWHDFKHU UDWLRV EXW VFKRROV 

ZLWKVPDOOHUFODVVHVPD\KDYHRWKHUFKDUDFWHULVWLFVVXFKDVWKHLUORFDWLRQKRXVHKROGLQFRPH 

RU DFFHVV WR WHFKQRORJ\ LQ KRPHV³FKDUDFWHULVWLFV QRW PHDVXUHG LQ WKH VWXG\ WKDW PD\ EH 

UHODWHGWRSURGXFWHIIHFWLYHQHVV7KHLQDELOLW\WRUXOHRXWWKHVHDOWHUQDWLYHH[SODQDWLRQVIRU 

WKHREVHUYHGFRUUHODWLRQVLVDUHDVRQWREHFDXWLRXVLQLQWHUSUHWLQJWKHP 

& &RQFOXVLRQV 

7KLVVWXG\H[SHULPHQWDOO\WHVWHGWKHHIIHFWVRIVHOHFWHGUHDGLQJWHFKQRORJ\SURGXFWVLQ 

ILUVWJUDGHFODVVURRPVWKDWYROXQWHHUHGWRSDUWLFLSDWH6FKRROVSDUWLFLSDWLQJLQWKHVWXG\ZHUH 

PRUHOLNHO\WKDQDYHUDJHWREHLQXUEDQDUHDVDQGKDGKLJKHUWKDQDYHUDJHOHYHOVRISRYHUW\ 

DQGVWXGHQWVZKRZHUH%ODFNRU+LVSDQLFH\ILQGLQJVDUHWKHIROORZLQJ 

7HDFKHUV:HUH7UDLQHGRQWKH3URGXFWVDQG8VHG7KHP1HDUO\DOOWUHDWPHQW 

WHDFKHUVSHUFHQWUHFHLYHGWUDLQLQJIURPWKHYHQGRURQKRZWRXVHWKHSURGXFW 

DQGDOORIWKHPLPSOHPHQWHGWKHSURGXFWWRVRPHGHJUHH3URGXFWVZHUHXVHGIRU 

DERXWSHUFHQWRIWRWDOUHDGLQJLQVWUXFWLRQWLPH 

(IIHFWV RQ 7HVW 6FRUHV :HUH 1RW 6WDWLVWLFDOO\ 'LIIHUHQW IURP =HUR 2YHUDOO 

UHDGLQJ VFRUHV IRU VWXGHQWV LQ WUHDWPHQW DQG FRQWURO FODVVURRPV ZHUH DQG 

UHVSHFWLYHO\ LQ QRUPDOFXUYHHTXLYDOHQW XQLWV 7KH GLIIHUHQFH ZDV QRW 

VWDWLVWLFDOO\GLIIHUHQWIURP]HUR 


33 

0RVW 6FKRRO DQG &ODVVURRP &KDUDFWHULVWLFV :HUH 8QFRUUHODWHG :LWK 

(IIHFWV &ODVVURRP DQG VFKRRO FKDUDFWHULVWLFV ZHUH QRW FRUUHODWHG ZLWK SURGXFW 

HIIHFWV IRU WKH RYHUDOO 6$7 VFRUH 7KH RQH H[FHSWLRQ ZDV WKH VWXGHQWWHDFKHU 

UDWLR)RUWKHVRXQGVDQGOHWWHUVDQGZRUGUHDGLQJVXEWHVWVFODVVURRPDQGVFKRRO 

FKDUDFWHULVWLFVZHUHFRUUHODWHGZLWKSURGXFWHIIHFWV7KHVWXGHQWWHDFKHUUDWLRDQG 

WKH SHUFHQW RI VSHFLDO HGXFDWLRQ VWXGHQWV ZHUH LQGLYLGXDOO\ VLJQLILFDQW IDFWRUV 

7LPHRIVWXG\SURGXFWXVDJHGLGQRWKDYHDVWDWLVWLFDOO\VLJQLILFDQWFRUUHODWLRQZLWK 

HIIHFWV IRU WKH RYHUDOO VFRUH RU VXEWHVW VFRUHV 1R VFKRRO RU FODVVURRP 

FKDUDFWHULVWLFV ZHUH FRUUHODWHG ZLWK HIIHFWV IRU WKH 7HVW RI :RUG 5HDGLQJ 

(IILFLHQF\ 


34 _________________________________________________________________ 

7DEOH,,,QWHUDFWLRQV%HWZHHQ0RGHUDWLQJ9DULDEOHVDQG(IIHFWV6$75HDGLQJ7HVW)LUVW*UDGH 

Ã 

7RWDOÃ6FRUHÃ1&(Ã 

VWDQGDUGÃ 

HUURUÃ SYDOXHÃ Ã FRHIILFLHQWÃ 

6RXQGVÃDQGÃ/HWWHUVÃ6XEWHVWÃ6FRUHÃ 

1&(Ã 

VWDQGDUGÃ 


:RUGÃ5HDGLQJÃ6XEWHVWÃ6FRUHÃ 

1&(Ã 

VWDQGDUGÃ 


6HQWHQFHÃ5HDGLQJÃ6XEWHVWÃ 

6FRUHÃ1&( 

VWDQGDUGÃ 

HUURUÃ SYDOXHÃ Ã 

FRHIILFLHQWÃ 

&ODVVURRP,QWHUDFWLRQ9DULDEOHV 

Ã

35 

7DEOH,,,QWHUDFWLRQV%HWZHHQ0RGHUDWLQJ9DULDEOHVDQG(IIHFWV7HVWRI:RUG5HDGLQJ(IILFLHQF\)LUVW*UDGH 

Ã 

 

7RWDOÃ6FRUHÃ 

6WDQGDUGÃ6FRUHÃ 

3KRQHPLFÃ'HFRGLQJÃ(IILFLHQF\Ã 


6LJKWÃ:RUGÃ(IILFLHQF\Ã 


 

FRHIILFLHQWÃ 

VWDQGDUGÃ 


VWDQGDUGÃ 


VWDQGDUGÃ 

HUURUÃ SYDOXHÃ Ã 

&ODVVURRP,QWHUDFWLRQ9DULDEOHV 

Ã

&KDSWHU,,, 

 

(IIHFWVRI)RXUWK*UDGH5HDGLQJ 

6RIWZDUH3URGXFWV 

7KLVFKDSWHUSUHVHQWVILQGLQJVRQWKHLPSOHPHQWDWLRQRIIRXUWKJUDGHUHDGLQJVRIWZDUH 

SURGXFWV DQG WKHLU HIIHFWV RQ VWXGHQW WHVW VFRUHV DQG H[DPLQHV WKH UHODWLRQVKLSV 

EHWZHHQWKHHIIHFWVDQGVFKRRODQGFODVVURRPFKDUDFWHULVWLFV7KHVWUXFWXUHRIWKLV 

FKDSWHU IROORZV WKDW RI WKH SUHYLRXV RQH 7KH WHFKQRORJ\ SURGXFWV IRU WKH IRXUWK JUDGH 

VXEVWXG\ IRFXV PRUH RQ UHDGLQJ FRPSUHKHQVLRQ WKDQ RQ OHDUQLQJ WR GHFRGH WH[W EXW WKH 

VWXG\·VGHVLJQGDWDFROOHFWLRQDSSURDFKDQGDQDO\VLVDSSURDFKZHUHWKHVDPH0RWLYDWLRQ 

IRU YDULRXV DQDO\VHV DQG PHWKRGRORJLFDO GLVFXVVLRQV DUH QRW UHSHDWHG DQG WKH UHDGHU LV 

UHIHUUHGWRWKHSUHYLRXVFKDSWHUIRUWKHVHGLVFXVVLRQV 

7KHIRXUWKJUDGHVWXG\LQFOXGHGIRXUUHDGLQJSURGXFWVWKDWZHUHLPSOHPHQWHGLQQLQH 

GLVWULFWV DQG VFKRROV 7KH VDPSOH LQFOXGHG WHDFKHUV DQG VWXGHQWV 7KH IRXU 

SURGXFWV ZHUH /HDSIURJ SXEOLVKHG E\ /HDSWUDFN 5HDG SXEOLVKHG E\ 6FKRODVWLF 

$FDGHP\ RI 5HDGLQJ SXEOLVKHG E\ $XWRVNLOO DQG QRZOHGJHER[ SXEOLVKHG E\ 3HDUVRQ 

'LJLWDO/HDUQLQJ 


7KH LPSOHPHQWDWLRQ DQDO\VLV IRFXVHG RQ WKH VDPH VL[ DUHDV DV WKH ILUVW JUDGH VWXG\ 

IHDWXUHV RI WKH SURGXFWV LQ WKH VWXG\ WHDFKHU WUDLQLQJ DQG VXSSRUW WR XVH SURGXFWV WKH 

GXUDWLRQ H[WHQW DQG ORFDWLRQ RI SURGXFW XVH WHFKQLFDO GLIILFXOWLHV LQ XVLQJ WKHP UROH RI 

SURGXFWVLQWKHFXUULFXOXPDQGWKHHIIHFWVWKDWSURGXFWXVHKDGRQFODVVURRPDFWLYLWLHV7KH 

DQDO\VLVZDVEDVHGRQGDWDJDWKHUHGIURPWKUHHREVHUYDWLRQVRIFODVVURRPVDQGLQWHUYLHZV 

ZLWKWHDFKHUVDVZHOODVIURPUHFRUGVFROOHFWHGIURPWKHSURGXFWVWKHPVHOYHV 


 

7KUHHRIWKHJUDGHVWXG\SURGXFWVSURYLGHGSUDFWLFHDQGDVVHVVPHQWJHDUHGWRVSHFLILF 

UHDGLQJ VNLOOV 6NLOOV FRYHUHG E\ WKHVH WKUHH SURGXFWV LQFOXGH DVSHFWV RI UHDGLQJ 

FRPSUHKHQVLRQ IRU H[DPSOH LGHQWLI\LQJ PDLQ LGHDV DQG DQDO\]LQJ VHWWLQJV SORWV DQG 

FKDUDFWHUV RI VWRULHV YRFDEXODU\ DQG OLWHUDU\ DQDO\VLV 7KH IRXUWK SURGXFW ZDV D VHUYHU 

EDVHGFROOHFWLRQRIKXQGUHGVRIUHVRXUFHVWH[WSDVVDJHVYLGHRFOLSVLPDJHVLQWHUQHWVLWHV

38 

VRIWZDUHPRGXOHVDQGVRRQIURPZKLFKWHDFKHUVFRXOGFKRRVHUHVRXUFHVFXVWRPL]HGWR 

WKHLUORFDOFXUULFXOXP7KHVWXG\HVWLPDWHGWKHDYHUDJHOLFHQVLQJIHHVIRUWKHSURGXFWVWREH 

DERXWDVWXGHQWIRUWKHVFKRRO\HDUZLWKDUDQJHRIWR 

7KHWKUHHSURGXFWVZHUHUDWHGRQWKH ILYHIHDWXUHVGHVFULEHGLQ WKHSUHYLRXVFKDSWHU 

WXWRULDO RSSRUWXQLWLHV SUDFWLFH RSSRUWXQLWLHV LQGLYLGXDOL]DWLRQ IHHGEDFN WR WHDFKHUV DQG 

IHHGEDFN WR VWXGHQWV 7KH QDWXUH RI WKH IRXUWK SURGXFW PDGH LW LQFRPSDWLEOH ZLWK WKLV 

SURGXFWDVVHVVPHQWSURFHVV 

7DEOH,,,VXPPDUL]HVLQVWUXFWLRQDOIHDWXUHVIRUWKHWKUHHIRXUWKJUDGHSURGXFWVWKDW 

ZHUH DVVHVVHG 7KH WKUHH SURGXFWV UHFHLYHG VLPLODU UDWLQJV IRU PRVW DVSHFWV RI WKHLU 

LQVWUXFWLRQDOIHDWXUHV7KH\DOOSURYLGHLQGLYLGXDOL]HGLQVWUXFWLRQE\VHWWLQJVWXGHQWOHDUQLQJ 

SDWKV DFFRUGLQJ WR VWXGHQW VNLOO OHYHOV 2QH SURGXFW DOVR DOORZV WHDFKHUV WR VSHFLI\ ZKLFK 

WXWRULDO XQLWV VWXGHQWV ZRXOG UHFHLYH $OO WKUHH SURGXFWV SURYLGH DPSOH RSSRUWXQLWLHV IRU 

SUDFWLFLQJUHDGLQJVNLOOVDQGSURYLGHLPPHGLDWHIHHGEDFNWRVWXGHQWVZKHQLQSUDFWLFHPRGH 

7ZR SURGXFWV JLYH IHHGEDFN WR VWXGHQWV RQ PDVWHU\ ZKHQ XVHG LQ DVVHVVPHQW PRGH $OO 

WKUHHSURGXFWVJLYHIHHGEDFNWRWHDFKHUVDERXWVWXGHQWSHUIRUPDQFH 


 

3URGXFWYHQGRUVWUDLQHGWHDFKHUVWRXVHSURGXFWVGXULQJVXPPHUDQGHDUO\IDOORI 

7UDLQLQJVW\SLFDOO\ZHUHLQWKHKRVWGLVWULFWDQGVRPHWLPHVLQWKHKRVWVFKRROV7KHLQLWLDO 

WUDLQLQJDYHUDJHGDOPRVWKRXUVYDU\LQJIURPKRXUVWRKRXUVGHSHQGLQJRQWKH 

SURGXFW7RSLFVLQFOXGHGFODVVURRPPDQDJHPHQWDQGDOLJQPHQWZLWKVWDQGDUGVDQGZLWKWKH 

ORFDO FXUULFXOXP WKH WUDLQLQJV DOVR JDYH WHDFKHUV WKH RSSRUWXQLW\ WR SUDFWLFH XVLQJ WKH 

SURGXFWV 1HDUO\ DOO WHDFKHUV SHUFHQW DWWHQGHG WKH LQLWLDO WUDLQLQJ DFFRUGLQJ WR 

DWWHQGDQFHORJV,QDGGLWLRQWHDFKHUVUHFHLYHGRWKHUIRUPVRIVXSSRUWDIWHULQLWLDOWUDLQLQJ 

2QDTXHVWLRQQDLUHFRPSOHWHGDWWKHHQGRILQLWLDOWUDLQLQJSHUFHQWRIWHDFKHUVVDLGWKH\ 

ZHUHFRQILGHQWWKH\FRXOGXVHWKHSURGXFW$WWKHWLPHRIWKHILUVWFODVVURRPREVHUYDWLRQ 

KRZHYHUZKHQPRVWWHDFKHUVKDGEHJXQWRXVHSURGXFWVSHUFHQWWROGLQWHUYLHZHUVWKDW 

WKHLQLWLDOWUDLQLQJKDGDGHTXDWHO\SUHSDUHGWKHPWRXVHWKHSURGXFW2QJRLQJVXSSRUWZDV 

GHOLYHUHG WKURXJK YDULRXV PRGHV 3URGXFW UHSUHVHQWDWLYHV YLVLWHG WHDFKHUV SHUFHQW RI 

WHDFKHUVUHSRUWHGEHLQJYLVLWHGE\DUHSUHVHQWDWLYHWHDFKHUVUHFHLYHGVXSSRUWWKURXJKHPDLO 

RU WHOHSKRQH KHOS GHVNV SHUFHQW RI WHDFKHUV DQG DGGLWLRQDO WUDLQLQJ ZDV SURYLGHG DW 

VFKRROVSHUFHQWRIWHDFKHUV 

7KHVWXG\WHDPZRUNHGZLWKGLVWULFWVWRLGHQWLI\KDUGZDUHDQGVRIWZDUHQHHGVVXFKDV 

FRPSXWHUVKHDGSKRQHVPHPRU\DQGRSHUDWLQJV\VWHPXSJUDGHV8OWLPDWHO\WKHQXPEHURI 

RSHUDWLRQDOFRPSXWHUVVXSSRUWHGDOPRVWDRQHWRRQHUDWLRRIVWXGHQWVWRFRPSXWHUV6WXG\ 

REVHUYHUV QRWHG WKDW WUHDWPHQW WHDFKHUV DYHUDJHG DOPRVW FRPSXWHUV LQ WKHLU URRPV 

VHUYLQJDQDYHUDJHRIDERXWIRXUWKJUDGHUV 

18 2QHRIWKHSURGXFWVLQWKHIRXUWKJUDGHVWXG\ZKLFKZDVWKHODUJHVWLQWHUPVRIWKHQXPEHURIWHDFKHUV 

LPSOHPHQWLQJLWSURYLGHGSRUWDEOHXQLWVIRUHDFKVWXGHQW7KHVHXQLWVZHUHQRWFRPSXWHUVLQWKHXVXDOVHQVH 

EXWDUHFRXQWHGDVVXFKIRURXUSXUSRVHVKHUHEHFDXVHWKH\HQDEOHGVWXGHQWVWRXVHWKHVRIWZDUH 

,,,(IIHFWVRI)RXUWK*UDGH5HDGLQJ6RIWZDUH3URGXFWV

39 

7DEOH,,,,QVWUXFWLRQDO)HDWXUHVRI)RXUWK*UDGH5HDGLQJ3URGXFWV 

 

 



3URGXFW 

7XWRULDO 

2SSRUWXQLWLHV 

3UDFWLFH 

2SSRUWXQLWLHV 7 3 $ 7 3 $ 7 3 $ 

6WXGHQW 

0DVWHU\ 

/HDUQLQJ 

3DWKV 

&ODVVURRP 


$$ 6RPH 0DQ\ 9 9 9 9 9 9 9 9 9 9 9 9 9 

%% 6RPH 0DQ\ 9 9 9 9 9 9 9 9 9 9 9 

&& 0DQ\ 0DQ\ 9 9 9 9 9 9 9 9 9 9 9 9 9 

 


 


 


VRXUFHRIHUURU0DVWHU\IHHGEDFN/HDUQHULQIRUPHGRIWKHQXPEHUFRUUHFWDQGZKHWKHUDVNLOORUFRQFHSWKDVEHHQDFTXLUHG 


40 

3URGXFW8VH 

 

7UHDWPHQW WHDFKHUV XVHG WHFKQRORJ\ SURGXFWV PRUH WKDQ FRQWURO WHDFKHUV 7HDFKHUV 

UHSRUWHGXVLQJVWXG\SURGXFWVDERXWWRKRXUVDZHHN$OOWUHDWPHQWWHDFKHUVXVHGWKHLU 

DVVLJQHGVWXG\SURGXFWDQGUHSRUWHGDERXWPLQXWHVRIZHHNO\XVHRUDERXWKRXUVRI 

DQQXDO XVH VHH 7DEOH ,,, $ERXW SHUFHQW RI WUHDWPHQW WHDFKHUV DOVR XVHG RWKHU 

SURGXFWVJHQHUDOO\DWORZHUOHYHOVDERXWPLQXWHVRIZHHNO\XVHDQGKRXUVRIDQQXDO 

XVH WKDQ WKHLU XVH RI VWXG\ SURGXFWV 1RQH RI WKH FRQWURO JURXS WHDFKHUV XVHG D VWXG\ 

SURGXFWEXWDERXWKDOIUHSRUWHGWKDWWKH\XVHGDQRWKHUSURGXFWWKHLUXVDJHRISURGXFWVZDV 

ORZHU FRPSDUHG WR WUHDWPHQW WHDFKHUV DERXW PLQXWHV RI ZHHNO\ XVH DQG KRXUV RI 

DQQXDO XVH 7KH PRVW FRPPRQO\ XVHG RWKHU UHDGLQJ SURGXFWV ZHUH UHDGLQJ DVVHVVPHQW 

SURGXFWVDQGDSURGXFWWKDWRIIHUHGVXSSOHPHQWDOUHDGLQJLQVWUXFWLRQDORQJZLWKDWRROIRU 

FUHDWLQJUHDGLQJDVVHVVPHQWV 

7DEOH,,, 7HDFKHU5HSRUWHG8VHRI6WXG\3URGXFWVDQG2WKHU5HDGLQJ6RIWZDUH3URGXFWV 

 

)RXUWK*UDGH 

6WXG\3URGXFWV 2WKHU5HDGLQJ3URGXFWV 

 

7UHDWPHQW 

*URXS 

&RQWURO 

*URXS 

 

 

7UHDWPHQW 

*URXS 

&RQWURO 

*URXS 

S 

YDOXH D 

3HUFHQW RI WHDFKHUV XVLQJ 

DSURGXFW 

 

 

0LQXWHVRIZHHNO\XVH QD 

+RXUVRIDQQXDOXVH QD 


6RXUFH&ODVVURRPREVHUYDWLRQVDQGWHDFKHULQWHUYLHZV 

D 7HVWV RI GLIIHUHQFHV ZHUH GRQH XVLQJ WZROHYHO KLHUDUFKLFDO PRGHOV FODVVURRP DQG VFKRROV ZLWK 

WUHDWPHQWDVVLJQPHQWDWOHYHORQHDQGEHWZHHQVFKRROYDULDQFHDWOHYHOWZR 



DQGVFKRRO)LJXUH,,,7KHGLIIHUHQFHDYHUDJHGDERXWKRXUVZLWKVRPHVFKRROVKDYLQJ 

GLIIHUHQFHVRIKRXUVRUOHVVDQGRWKHUVKDYLQJGLIIHUHQFHVRIKRXUV2QHVFKRROKDGD 

GLIIHUHQFH WKDW ZDV VOLJKWO\ QHJDWLYH ZKLFK RFFXUV ZKHQ FRQWURO WHDFKHUV XVHG RWKHU 

SURGXFWVPRUHWKDQWUHDWPHQWWHDFKHUVXVHGWKHVWXG\SURGXFWLQDGGLWLRQWRRWKHUSURGXFWV 

8VDJH GLIIHUHQFHV DUH DOVR HYLGHQW EHWZHHQ GLVWULFWV )RU H[DPSOH WKH GLIIHUHQFH EHWZHHQ 

WUHDWPHQW DQG FRQWURO WHDFKHU SURGXFW XVH ZDV UHODWLYHO\ ODUJH LQ GLVWULFW FRPSDUHG WR 

GLVWULFW 

 

7KUHHRIWKHIRXUSURGXFWVLQFOXGHGGDWDEDVHVWKDWSURYLGHGVRPHGDWDRQXVDJHDQG 

WZRSURGXFWVWUDFNHGXVDJHFORVHO\2QGD\VVWXGHQWVXVHGVRIWZDUHWKHLUXVDJHZDVWR 

PLQXWHV IRU WKH WZR SURGXFWV WKDW WUDFNHG XVDJH DW WKLV OHYHO RI GHWDLO VHH 7DEOH ,,, 

$QQXDOXVHYDULHGIURPWRKRXUV)RUDW\SLFDOGD\VFKRRO\HDUDYHUDJHGDLO\XVDJH 

ZDVDERXWPLQXWHVIRURQHSURGXFWDQGPLQXWHVIRUWKHRWKHUSURGXFWWKDWKDGDGHTXDWH 

 


41 

)LJXUH,,, 

'LIIHUHQFHLQ$QQXDO7HDFKHU5HSRUWHG+RXUVRI5HDGLQJ7HFKQRORJ\3URGXFW8VH 

%HWZHHQ7UHDWPHQWDQG&RQWURO&ODVVURRPV 

)RXUWK*UDGH 

 

+RXUV 

 

 

 

1 

1 

1 

1 

2 

2 

3 

3 

4 

5 

5 

5 

5 

5 

5 

6 

6 

6 

6 

7 

7 

8 

8 

8 

8 

9 

10 

10 

10 

10 

10 

10 

 

8 

 



6RXUFH7HDFKHU,QWHUYLHZV 

 

7DEOH,,,'DLO\DQG$QQXDO8VDJH)URP3URGXFW5HFRUGV 

3URGXFW$ 3URGXFW% 3URGXFW& 3URGXFW' 

7RWDOGD\VXVHGGXULQJVFKRRO\HDU QD QD 

0LQXWHVRIGDLO\XVHZKHQXVHG QD QD 

 

+RXUVRIDQQXDOXVH QD 

6RXUFH 3URGXFWGDWDRQXVDJH2QHSURGXFWGLGQRW\LHOGXVDEOHGDWD2QHSURGXFWGLGQRWFROOHFW 

WRWDOGD\VXVHGRUPLQXWHVRIGDLO\XVH 

 

QD QRWDYDLODEOHRUXVDEOH 

GDWDRQXVH$VVXPLQJWKDWUHDGLQJLVWDXJKWLQDPLQXWHEORFNWKHWZRSURGXFWVZHUH 

XVHG OHVV WKDQ SHUFHQW RI UHDGLQJ LQVWUXFWLRQ WLPH 7KLV HVWLPDWH UHIHUV RQO\ WR WLPH 

VWXGHQWVVSHQWRQFRPSXWHUVDQGQRWWRRWKHUWLPHUHODWHGWRSURGXFWVWKDWVWXGHQWVPD\ 

KDYHVSHQW 

 

$V QRWHG LQ WKH SUHYLRXV FKDSWHU WKH VWXG\ LWVHOI PD\ KDYH LQFUHDVHG XVDJH EHFDXVH LW SXUFKDVHG 

KDUGZDUHDQGVRIWZDUHXSJUDGHVGLUHFWO\ZKLFKDOORZHGLWQRWWRJRWKURXJKGLVWULFWSURFXUHPHQWSURFHVVHV 


42 

5ROHRI3URGXFWVLQWKH&XUULFXOXPDQG7LPHDQG3ODFHRI8VH 

 

7KUHHSURGXFWVZHUHXVHGDVVXSSOHPHQWVWRWKHUHDGLQJFXUULFXOXPDQGDIRXUWKZDVD 

FRPSOHWH UHDGLQJ FXUULFXOXP WKDW LQFOXGHG DFWLYLWLHV QRW LQYROYLQJ FRPSXWHUV 6HYHQW\ 

SHUFHQW RI WUHDWPHQW WHDFKHUV LQGLFDWHG WKDW WKH\ XVHG WKH SURGXFW DV D VXSSOHPHQW DQG 

SHUFHQW VDLG WKH\ XVHG LW DV WKHLU FRUH UHDGLQJ FXUULFXOXP $OO WHDFKHUV XVLQJ WKH 

SURGXFWGHVLJQHGWREHDFRUHFXUULFXOXPUHSRUWHGXVLQJLWDVWKHLUFRUHFXUULFXOXP 

 

7HDFKHUV YDULHG LQ KRZ WKH\ VFKHGXOHG SURGXFW XVH 0RVW WHDFKHUV SHUFHQW XVHG 

SURGXFWVH[FOXVLYHO\GXULQJUHJXODUFODVVWLPH$ERXWDTXDUWHUXVHGSURGXFWVGXULQJRWKHU 

WLPHV VXFK DV EHIRUH VFKRRO OXQFKWLPH RU WLPH XVXDOO\ VHW DVLGH IRU VFLHQFH RU VRFLDO 

VFLHQFHDQGSHUFHQWXVHGLWGXULQJFODVVWLPHDQGDWRWKHUWLPHV3URGXFWVZHUHXVHGLQ 

UHJXODUFODVVURRPVSHUFHQWRIWHDFKHUVRULQFRPSXWHUODEVSHUFHQW&RQVLVWHQWZLWK 

YHQGRUUHFRPPHQGDWLRQVQHDUO\DOOWHDFKHUVSHUFHQWUHSRUWHGEHLQJSUHVHQWZKHQWKHLU 

VWXGHQWVXVHGSURGXFWVDQGQHDUO\DOOWHDFKHUVSHUFHQWUHSRUWHGUHYLHZLQJUHSRUWVWZR 

WRWKUHHWLPHVDPRQWKRUPRUHIUHTXHQWO\ 


 

6WXG\REVHUYHUVUHSRUWHGVHHLQJWHFKQLFDOSUREOHPVDIIHFWLQJVWXGHQWXVHRISURGXFWVLQ 

DERXWDWKLUGSHUFHQWRIWKHWLPHVHJPHQWVWKH\REVHUYHGHDFKREVHUYDWLRQFRQVLVWHGRI 

IRXUWRILYHWLPHVHJPHQWV0RVWWHFKQLFDOSUREOHPVZHUHEULHIDQGDIIHFWHGIHZVWXGHQWV 

WKH PRVW FRPPRQ EHLQJ SUREOHPV ORJJLQJ RQ WR SURGXFWV KDYLQJ FRPSXWHUV IUHH]H DQG 

QHHGUHERRWLQJDQGLVVXHVZLWKSHULSKHUDOVVXFKDVKHDGSKRQHV 

6DWLVIDFWLRQ:LWK3URGXFWV 

 


LIJLYHQWKHFKRLFH:KHQDVNHGZKDWWKH\ZRXOGFKDQJHLQDVHFRQG\HDURILPSOHPHQWDWLRQ 

SHUFHQW VDLG WKH\ ZRXOG QRW FKDQJH DQ\WKLQJ SHUFHQW VDLG WKH\ ZRXOG VWDUW XVLQJ 

SURGXFWVHDUOLHULQWKHVFKRRO\HDUDQGSHUFHQWVDLGWKDWWKH\ZRXOGZRUNRQFODVVURRP 

PDQDJHPHQWLVVXHVUHODWHGWRSURGXFWXVH 

(IIHFWVRQ&ODVVURRP$FWLYLWLHV 

 

&ODVVURRP REVHUYDWLRQ GDWD VKRZ GLIIHUHQFHV LQ FODVVURRP DFWLYLWLHV ZKHQ SURGXFWV 

ZHUH XVHG VHH 7DEOH ,,, 7UHDWPHQW WHDFKHUV ZHUH PXFK PRUH OLNHO\ WKDQ FRQWURO 

 

(continued) 

SDLG WHDFKHUV KRQRUDULD IRU DWWHQGLQJ WUDLQLQJ RQ XVLQJ SURGXFWV DQG UHOD\HG LQIRUPDWLRQ WR SURGXFW 

GHYHORSHUVDERXWLVVXHVZLWKXVLQJSURGXFWVWKDWWKHWHDPREVHUYHGGXULQJFODVVURRPYLVLWV 

 

7KH REVHUYDWLRQ SURWRFRO FDOOHG IRU REVHUYHUV WR REVHUYH UHDGLQJ SHULRGV GXULQJ ZKLFK WUHDWPHQW 

WHDFKHUVZHUHXVLQJSURGXFWV,IREVHUYHUVKDGREVHUYHGFODVVURRPVDWUDQGRPWLPHVWKHGLIIHUHQFHVVKRZQLQ 

WKHWDEOHPD\KDYHEHHQVPDOOHUEHFDXVHSURGXFWVZRXOGQRWEHLQXVHGXULQJVRPHRIWKHREVHUYDWLRQV 


43 

7DEOH,,,$FWLYLWLHVLQ7UHDWPHQWDQG&RQWURO&ODVVURRPV)RXUWK*UDGH3HUFHQWDJH 

RI2EVHUYDWLRQ,QWHUYDOV 

 

7UHDWPHQW 

&ODVVURRPV 

&RQWURO 

&ODVVURRPV 

SYDOXH D 


/HDGHU 

)DFLOLWDWRU 



2WKHU 


,QGLYLGXDOSUDFWLFH 

/HFWXUH 



2WKHU 


3HUFHQWRIWLPHLQWHUYDOVZLWKPRUHWKDQ 

 

 

SHUFHQWRIVWXGHQWVRQWDVN 

 

 

6DPSOH6L]H 


1XPEHURIREVHUYDWLRQV 

 

 

 

 

6RXUFH&ODVVURRPREVHUYDWLRQVDWPLQXWHVDQGIRUHDFKFODVV 

 

 

 

D 7HVWVRIGLIIHUHQFHVZHUHFRQGXFWHGXVLQJWZROHYHOKLHUDUFKLFDOPRGHOVZLWKWHDFKHU·VWUHDWPHQWVWDWXVDW 

OHYHORQHDQGDVFKRROUDQGRPHIIHFWDWOHYHOWZR7KHSYDOXHLVWKHVPDOOHVWOHYHORIVLJQLILFDQFHDWZKLFK 

WKHQXOOK\SRWKHVLVWKDWWKHGLIIHUHQFHEHWZHHQWUHDWPHQWFODVVVHVVLRQVDQGFRQWUROFODVVVHVVLRQVHTXDOV 

]HURFDQEHUHMHFWHG 

E2EVHUYHUVFRGHG´DOOWKDWDSSO\µ3HUFHQWDJHVFDQVXPWRPRUHWKDQSHUFHQW 

 

WHDFKHUVWRDFWDVIDFLOLWDWRUVDQGOHVVOLNHO\WKDQFRQWUROWHDFKHUVWREHOHDGHUV7UHDWPHQW 

FODVVURRP VWXGHQWV ZHUH PRUH OLNHO\ WKDQ FRQWURO FODVVURRP VWXGHQWV WR EH HQJDJHG LQ 

´LQGLYLGXDO SUDFWLFHµ S 3DUWLFLSDWLRQ LQ LQGLYLGXDO SUDFWLFH DOVR ZDV WKH PRVW 

IUHTXHQWO\REVHUYHGDFWLYLW\LQFRQWUROFODVVURRPVZLWKSDUWLFLSDWLQJLQTXHVWLRQDQGDQVZHU 

VHVVLRQV GLUHFWHG E\ WKH WHDFKHU DQG OLVWHQLQJ WR D OHFWXUH EHLQJ WKH QH[W PRVW FRPPRQ 

VWXGHQWDFWLYLWLHV 

 

&ODVVURRPREVHUYHUVQRWHGWKHSURSRUWLRQRIVWXGHQWVZKRZHUHRQWDVNHQJDJHGLQ 

WKH DVVLJQHG DFDGHPLF WDVN GXULQJ REVHUYDWLRQ VHJPHQWV ,Q WUHDWPHQW FODVVURRPV PRUH 

WKDQSHUFHQWRI VWXGHQWVZHUHRQWDVNLQSHUFHQWRIREVHUYHG VHJPHQWV,QFRQWURO 

FODVVURRPV PRUH WKDQ SHUFHQW RI VWXGHQWV ZHUH RQ WDVN LQ SHUFHQW RI REVHUYHG 

VHJPHQWV7KHGLIIHUHQFHZDVQRWVWDWLVWLFDOO\GLIIHUHQWIURP]HURS! 

 

:KHWKHU SURGXFW XVH ZDV VXSSOHPHQWLQJ RU UHSODFLQJ QRUPDO UHDGLQJ DFWLYLWLHV ZDV 

DVVHVVHG E\ DVNLQJ WHDFKHUV KRZ PXFK WLPH WKH\ VSHQW RQ UHDGLQJ LQVWUXFWLRQ 7UHDWPHQW 

WHDFKHUV UHSRUWHG VSHQGLQJ DERXW KRXU PRUH RQ UHDGLQJ LQVWUXFWLRQ KRXUV D ZHHN 

FRPSDUHG WR KRXUV IRU FRQWURO WHDFKHUV DQG WKH GLIIHUHQFH ZDV VWDWLVWLFDOO\ GLIIHUHQW 

IURP]HURS7KLVHYLGHQFHWKDWUHDGLQJLQVWUXFWLRQDOWLPHLQFUHDVHGZLWKSURGXFWXVH 

VKRXOGEHNHSWLQPLQGLQLQWHUSUHWLQJWKHILQGLQJV 


44 

% (IIHFWVRQ5HDGLQJ7HVW6FRUHV 

(IIHFWVRQWHVWVFRUHVZHUHHVWLPDWHGXVLQJDPRGHOWKDWDFFRXQWHGIRUWKHQHVWLQJRI 


VFRUHVJHQHUDOO\ZHUHQRWVWDWLVWLFDOO\GLIIHUHQWIURP]HUR)XUWKHUDQDO\VLVIRXQGWKDWPRVW 

WHDFKHU DQG VFKRRO FKDUDFWHULVWLFV ZHUH XQFRUUHODWHG ZLWK HIIHFWV EXW UHSRUWHG WLPH WKDW 

SURGXFWVZHUHXVHGZDVFRUUHODWHGZLWKHIIHFWV 

7UHDWPHQWDQG&RQWURO*URXS&KDUDFWHULVWLFVIRU7HDFKHUVDQG6WXGHQWV 

 

:KHWKHUUDQGRPDVVLJQPHQWDFKLHYHGLWVREMHFWLYHRIFUHDWLQJHTXLYDOHQWWUHDWPHQWDQG 

FRQWUROJURXSVZDVDVVHVVHGE\H[DPLQLQJFKDUDFWHULVWLFVRIWHDFKHUVDQGVWXGHQWVLQWKHWZR 

JURXSV7DEOH,,,VKRZVWHDFKHUDQGVWXGHQWFKDUDFWHULVWLFVDQGUHVXOWVRIVWDWLVWLFDOWHVWVRI 

HTXLYDOHQFH 1RQH RI WKH GLIIHUHQFHV RI WHDFKHU DQG VWXGHQW FKDUDFWHULVWLFV LV VWDWLVWLFDOO\ 

GLIIHUHQWIURP]HUR1RQHWKHOHVVWKHFKDUDFWHULVWLFVZHUHHQWHUHGDVFRYDULDWHVWRDGMXVWIRU 

WKHVHGLIIHUHQFHV 

(IIHFWV:HUH1RW6WDWLVWLFDOO\'LIIHUHQW)URP=HUR 

 

$VZLWKILUVWJUDGHSURGXFWVHIIHFWVZHUHHVWLPDWHGZLWKDWKUHHOHYHOKLHUDUFKLFDOOLQHDU 

PRGHO7KHILUVWOHYHOLQFOXGHGVWXGHQWFKDUDFWHULVWLFVDJHJHQGHUDQGSUHWHVWVFRUH7KH 

VHFRQGOHYHOLQFOXGHGFODVVURRPFKDUDFWHULVWLFVPRVWLPSRUWDQWO\WKHWUHDWPHQWLQGLFDWRURI 

 

7DEOH,,,&KDUDFWHULVWLFVRI7HDFKHUVDQG6WXGHQWVLQ7UHDWPHQWDQG&RQWURO&ODVVURRPV 

)RXUWK*UDGH 

 

7UHDWPHQW 

&ODVVURRPV 

&RQWURO 

&ODVVURRPV 

SYDOXH D 


45 

ZKHWKHU D FODVVURRP ZDV DVVLJQHG WR XVH D SURGXFW WKH WKLUG OHYHO LQFOXGHG VFKRRO 

FKDUDFWHULVWLFVVXFKDVSURSRUWLRQRIVWXGHQWVUHFHLYLQJIUHHRUUHGXFHGSULFHOXQFKUDFHDQG 

HWKQLFFRPSRVLWLRQDQGWKHSURSRUWLRQWKDWUHFHLYHGVSHFLDOHGXFDWLRQVHUYLFHV 

 

7DEOH ,,, VKRZV WKH DYHUDJH VFRUH GLIIHUHQFHV IRU WKH 6$7 UHDGLQJ WHVW DQG LWV 

WKUHHVXEWHVWV1RQHRIWKHGLIIHUHQFHVLVVWDWLVWLFDOO\GLIIHUHQWIURP]HURDQGHIIHFWVL]HVDUH 

VPDOO$GGLWLRQDODQDO\VHVDOVRIRXQGWKDWSURGXFWVGLGQRWDIIHFWZKHWKHUVWXGHQWVZHUHORZ 

VFRUHUV7DEOH,,, 

 

)LJXUHV ,,, DQG ,,, GHSLFW WKH YDULDWLRQ LQ VFKRRO HIIHFW VL]HV E\ GLVWULFW DQG E\ 

SURGXFW 0RVWRIWKHYDULDELOLW\RIWKHVFRUHGLIIHUHQFHLVEHWZHHQGLVWULFWVSHUFHQWRI 

WKH YDULDQFH RI VFKRRO HIIHFWV LV ZLWKLQ GLVWULFWV DQG SHUFHQW LV EHWZHHQ GLVWULFWV 

+RZHYHU WKH ILJXUH VKRZV WKDW GLIIHUHQFHV YDU\ EHWZHHQ VFKRROV HYHQ ZLWKLQ WKH VDPH 

GLVWULFW)RUH[DPSOHLQGLVWULFWHIIHFWVL]HVUDQJHGEHWZHHQDQG 

 

7DEOH,,,6SULQJ5HDGLQJ7HVW6FRUH'LIIHUHQFHVLQ7UHDWPHQWDQG&RQWURO&ODVVURRPV 

)RXUWK*UDGH 

 

7UHDWPHQW 

&ODVVURRP 

$YHUDJH 

6FRUH 

1&( 

&RQWURO 

&ODVVURRP 

$YHUDJH 

6FRUH 

1&( 

(IIHFW 

6L]H 

'LIIHUHQFH 

SYDOXH 

6WDQIRUG $FKLHYHPHQW 7HVW 

7HQWK(GLWLRQ 

2YHUDOOVFRUH 


9RFDEXODU\ 

:RUGVWXG\VNLOOV 

&RPSUHKHQVLRQ 

1RWH 

 

6HH$SSHQGL[%IRUGHWDLOVRIWKHHVWLPDWLRQPRGHO9DULDEOHVLQWKHPRGHOLQFOXGHVWXGHQWDJH 

JHQGHUDQGWKHSUHWHVWVFRUHVWHDFKHUJHQGHUH[SHULHQFHDQGZKHWKHUKHRUVKHKDGDPDVWHU·V 

GHJUHHVFKRROUDFHDQGHWKQLFLW\SHUFHQWRIVWXGHQWVLQVSHFLDOHGXFDWLRQSHUFHQWHOLJLEOHIRUIUHH 

OXQFKDQGSHUFHQWOLPLWHG(QJOLVKSURILFLHQWDQGVWXGHQWFODVVURRPDQGVFKRROUDQGRPHIIHFWV 

7KHWUHDWPHQWFODVVURRPDYHUDJHVFRUHUHSRUWHGLQWKHWDEOHLVWKHFRQWUROFODVVURRPDYHUDJHVFRUH 

SOXVWKHWUHDWPHQWHIIHFW,WGLIIHUVIURPWKHXQDGMXVWHGWUHDWPHQWFODVVURRPVFRUH 

(IIHFWVL]HVDUHEDVHGRQWKHVWDQGDUGGHYLDWLRQRIWKHFRQWUROJURXSIRUWKHVSULQJWHVW 

 

7ZROHYHOPRGHOVDOVRZHUHHVWLPDWHGIRUVWXGHQWVLQHDFKTXDUWLOHEDVHGRQWKHIDOOVFRUHWRDVVHVV 

SURGXFW HIIHFWV DFURVV WKH VFRUH GLVWULEXWLRQ (VWLPDWHG HIIHFWV LQ 1&( XQLWV DQG SYDOXHV IRU WKH IRXU 

TXDUWLOHVZHUHDQG1RQHDUHVWDWLVWLFDOO\GLIIHUHQWIURP]HUR 

7RHQVXUHSURGXFWVFDQQRWEHLGHQWLILHGOHWWHUVXVHGWRLGHQWLI\SURGXFWVKHUHGRQRWFRUUHVSRQGWR 

OHWWHUVXVHGHDUOLHULQWKHFKDSWHU 


46 

 

7DEOH,,,(IIHFWRQ3HUFHQWRI6WXGHQWVLQ/RZHVW7KLUGRI5HDGLQJ7HVW6FRUHV 

 

7UHDWPHQW 

&ODVVURRP 

3HUFHQWDJH 

&RQWURO 

&ODVVURRP 

3HUFHQWDJH 

'LIIHUHQFH 

(IIHFW 

6L]H 

SYDOXH 

3HUFHQWRIVWXGHQWVEHORZ UG SHUFHQWLOH 

RIVSULQJUHDGLQJWHVW 

1RWH 

 

 

 

2WKHU YDULDEOHV LQ WKH PRGHO LQFOXGH VWXGHQW DJH JHQGHU DQG WKH SUHWHVW VFRUHV WHDFKHU JHQGHU 

H[SHULHQFHDQGZKHWKHUKHRUVKHKDGDPDVWHU·VGHJUHHVFKRROUDFHDQGHWKQLFLW\SHUFHQWRIVWXGHQWV 

LQVSHFLDOHGXFDWLRQSHUFHQWHOLJLEOHIRUIUHHOXQFKDQGVWXGHQWFODVVURRPDQGVFKRROUDQGRPHIIHFWV 

7KHWUHDWPHQWFODVVURRPSHUFHQWDJHUHSRUWHGLQWKHWDEOHLVWKHFRQWUROFODVVURRPSHUFHQWDJHSOXVWKH 

WUHDWPHQWHIIHFW,WGLIIHUVIURPWKHXQDGMXVWHGWUHDWPHQWSHUFHQWDJH7KHHIIHFWVL]HLVFDOFXODWHGXVLQJ 

WKH&R[LQGH[WKHORJRGGVUDWLRGLYLGHGE\ 

 

 

 

 

 

 

 

 

 

)LJXUH,,, 

6FKRRO/HYHO(IIHFWVE\'LVWULFW 

)RXUWK*UDGH6$75HDGLQJ6FRUH 

 

 

(IIHFW6L]H 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

1XPEHUVUHSUHVHQWGLVWULFWVDQGHDFKSRLQWLVDVFKRRO 


47 

)LJXUH,,, 

6FKRRO/HYHO(IIHFWVE\3URGXFW 

)RXUWK*UDGH6$75HDGLQJ6FRUH 

 

(IIHFW6L]H 

 

 

& 

 

 

 

 

$ 

$ 

 

$ 

$ 

% 

% 

& 

& 

& 

& 

& 

' 

' 

' 

 

 

/HWWHUVUHSUHVHQWSURGXFWVDQGHDFKSRLQWLVDVFKRRO 

 

 

1RWH 

6WDWLVWLFDOVLJQLILFDQFHRIDYHUDJHHIIHFWVL]HVFDQQRWEHLQIHUUHGIURPWKHILJXUHEHFDXVHVWXGHQW 



:KHWKHU FODVVURRP DQG VFKRRO FKDUDFWHULVWLFV PRGHUDWH HIIHFWV ZDV LQYHVWLJDWHG E\ 

LQWHUDFWLQJ WKH WUHDWPHQW HIIHFW ZLWK FODVVURRP FKDUDFWHULVWLFV DW WKH VHFRQG OHYHO RI WKH 

PRGHO DQG E\ HVWLPDWLQJ D PRGHO RI WKH WUHDWPHQW HIIHFW DV D IXQFWLRQ RI VFKRRO 

FKDUDFWHULVWLFVLQWKHWKLUGOHYHO6FKRROFKDUDFWHULVWLFVLQFOXGHGUDFHDQGHWKQLFLW\DQGWKH 

SHUFHQWRIVWXGHQWVTXDOLILHGIRUIUHHOXQFKHV3URGXFWXVDJHERWKVWXG\SURGXFWVDQGRWKHU 

SURGXFWVDOVRZDVHQWHUHG 

 

7DEOH,,,VKRZVHVWLPDWHVRIPRGHUDWRUHIIHFWV ZLWKSRVLWLYHFRHIILFLHQWVLQGLFDWLQJ 

WKDWDFKDUDFWHULVWLFLVSRVLWLYHO\FRUUHODWHGZLWKHIIHFWVDQGDQHJDWLYHFRHIILFLHQWLQGLFDWLQJ 

WKHRSSRVLWH)RUWKHRYHUDOOUHDGLQJVFRUHVWDWLVWLFDOWHVWVLQGLFDWHWKDWFODVVURRPDQGVFKRRO 

FKDUDFWHULVWLFVDUHMRLQWO\UHODWHGWRHIIHFWVEXWRQO\FODVVURRPFKDUDFWHULVWLFVDUHUHODWHGWR 

HIIHFWVLQVHSDUDWHWHVWVVFKRROFKDUDFWHULVWLFVZHUHQRWVWDWLVWLFDOO\VLJQLILFDQWRQWKHLURZQ 

7KH DPRXQW RI VWXG\ SURGXFW XVDJH ZDV D VWDWLVWLFDOO\ VLJQLILFDQW FKDUDFWHULVWLF WKDW 

PRGHUDWHGHIIHFWV7KHHVWLPDWHVLQGLFDWHWKDWWKHSURGXFWHIIHFWVL]HZRXOGEHODUJHUE\ 

LISURGXFWXVDJHZHUHODUJHUE\DVWDQGDUGGHYLDWLRQDERXWKRXUVD\HDU)RUYRFDEXODU\ 

QR FKDUDFWHULVWLFV PRGHUDWHG HIIHFWV )RU ZRUG UHDGLQJ WKHDPRXQW RI VWXG\ SURGXFW XVH 

WHDFKHU H[SHULHQFH ZKHWKHU WHDFKHUV UHFHLYHG WHFKQRORJ\ SURIHVVLRQDO GHYHORSPHQW LQ WKH 

SUHYLRXV\HDUDQGWKHSHUFHQWRIVWXGHQWVZKRZHUH%ODFNPRGHUDWHGHIIHFWV7KHDPRXQW 

RI XVH ZDV SRVLWLYHO\ FRUUHODWHG ZLWK HIIHFWV DQG RWKHU FKDUDFWHULVWLFV ZHUH QHJDWLYHO\ 

FRUUHODWHGZLWKHIIHFWV 

 

7KHVH PRGHUDWRU UHODWLRQVKLSV QHHG WR EH LQWHUSUHWHG FDUHIXOO\ $V QRWHG LQ WKH 

SUHYLRXVFKDSWHUSURGXFWXVDJHPD\EHUHODWHGWRGHFLVLRQVE\WHDFKHUVDQGVFKRROVDIWHU 

GDWD FROOHFWLRQ EHJDQ DQG SRVVLEO\ DIWHU WHDFKHUV DQG VFKRROV KDG LQLWLDO LQGLFDWLRQV RI 

ZKHWKHUWKHSURGXFWDSSHDUHGWREHHIIHFWLYH 


48 

& &RQFOXVLRQV 

7KLV VWXG\ H[SHULPHQWDOO\ WHVWHG WKH HIIHFWV RI VHOHFW UHDGLQJ WHFKQRORJ\ SURGXFWV LQ 

IRXUWK JUDGH FODVVURRPV WKDW YROXQWHHUHG WR SDUWLFLSDWH $OWKRXJK QRW D QDWLRQDOO\ 

UHSUHVHQWDWLYHVDPSOHWKHVFKRROVSDUWLFLSDWLQJLQWKHVWXG\ZHUHPRUHOLNHO\WKDQDYHUDJHWR 

EH LQ XUEDQ DUHDV DQG KDG KLJKHUWKDQDYHUDJH OHYHOV RI SRYHUW\ DQG VWXGHQWV ZKR ZHUH 

$IULFDQ$PHULFDQRU+LVSDQLFH\ILQGLQJVDUHWKHIROORZLQJ 

 

7HDFKHUV :HUH 7UDLQHG DQG 8VHG 3URGXFWV 1HDUO\ DOO WUHDWPHQW WHDFKHUV 

SHUFHQW SDUWLFLSDWHG LQ WKH LQLWLDO WUDLQLQJ IURP WKH YHQGRU RQ XVLQJ WKH 

SURGXFWDQGDOOLPSOHPHQWHGWKHDVVLJQHGVRIWZDUHDWOHDVWWRVRPHH[WHQW8VDJH 

UHFRUGHGE\WKUHHRIWKHSURGXFWVZDVOHVVWKDQSHUFHQWRIUHDGLQJLQVWUXFWLRQ 

WLPH 

'LIIHUHQFHVLQ7HVW6FRUHV:HUH1RW6WDWLVWLFDOO\'LIIHUHQW)URP=HUR 

2YHUDOO UHDGLQJ VFRUHV IRU VWXGHQWV LQ WUHDWPHQW DQG FRQWURO FODVVURRPV ZHUH 

DQG UHVSHFWLYHO\ LQ QRUPDOFXUYHHTXLYDOHQW XQLWV 7KH GLIIHUHQFH ZDV 

QRWVWDWLVWLFDOO\GLIIHUHQWIURP]HUR 

6RPH &ODVVURRP DQG 6FKRRO &KDUDFWHULVWLFV :HUH &RUUHODWHG :LWK 3URGXFW 

(IIHFWV)RUWKHRYHUDOOVFRUHDVLJQLILFDQWFRUUHODWLRQZDVIRXQGEHWZHHQSURGXFW 

HIIHFWV DQG SURGXFW XVDJH )RU ZRUG UHDGLQJ VFRUHV VLJQLILFDQW FRUUHODWLRQV ZHUH 

IRXQGEHWZHHQSURGXFWHIIHFWVDQGVHYHUDOFKDUDFWHULVWLFVLQFOXGLQJSURGXFWXVDJH 

7KHSRVVLELOLW\WKDWRWKHUIDFWRUVDUHUHODWHGWRWKHVHFKDUDFWHULVWLFVZDUUDQWVFDXWLRQ 

LQLQWHUSUHWLQJWKHFRUUHODWLRQV 

 


7DEOH,,,,QWHUDFWLRQV%HWZHHQ0RGHUDWLQJ9DULDEOHVDQG(IIHFWV6$75HDGLQJ7HVW)RXUWK*UDGH 

7RWDO6FRUH1&( 9RFDEXODU\1&( :RUG6WXG\6NLOOV1&( &RPSUHKHQVLRQ1&(Ã 

FRHIILFLHQW 

VWDQGDUG 

HUURU SYDOXH FRHIILFLHQW 

VWDQGDUG 


VWDQGDUG 


VWDQGDUG 

HUURU SYDOXH 

&ODVVURRP,QWHUDFWLRQ9DULDEOHV 

&KDSWHU,9 

(IIHFWVRI6L[WK*UDGH0DWK6RIWZDUH 

3URGXFWV 

 

7KLV FKDSWHU SUHVHQWV LPSOHPHQWDWLRQ ILQGLQJV IRU VL[WK JUDGH PDWK WHFKQRORJ\ 

SURGXFWV DQG HVWLPDWHV RI WKHLU HIIHFWV DQG WKH UHODWLRQVKLSV EHWZHHQ HIIHFWV DQG 

VFKRRO DQG FODVVURRP FKDUDFWHULVWLFV 7KH WHFKQRORJ\ SURGXFWV LQ WKH VL[WK JUDGH 

VXEVWXG\ IRFXVHG RQ PDWK DQG SUHDOJHEUD LQVWUXFWLRQ 7KH VWXG\·V GHVLJQ GDWD 

FROOHFWLRQDSSURDFKDQGDQDO\VLVDSSURDFKZHUHWKHVDPHDVIRUUHDGLQJSURGXFWV7KHVL[WK 

JUDGHVWXG\LQFOXGHGWKUHHSURGXFWVWKDWZHUHLPSOHPHQWHGLQGLVWULFWVDQGVFKRROV 

7KHVDPSOHLQFOXGHGWHDFKHUVDQGVWXGHQWV7KHWKUHHSURGXFWVZHUH/DUVRQ3UH 

$OJHEUD SXEOLVKHG E\ +RXJKWRQ0LIIOLQ $FKLHYH 1RZ SXEOLVKHG E\ 3ODWR DQG L/HDUQ 

0DWKSXEOLVKHGE\L/HDUQ 


$V QRWHG LQ SUHYLRXV FKDSWHUV WKH PDLQ TXHVWLRQV LQ WKH LPSOHPHQWDWLRQ DQDO\VLV 

UHODWHGWRSURGXFWIHDWXUHVXVHLQFODVVURRPVDQGHIIHFWVRQWHDFKHUDQGVWXGHQWDFWLYLWLHVLQ 

FODVVURRPV&ODVVURRPXVHKDGPXOWLSOHDVSHFWVWKDWZHUHLQYHVWLJDWHGWHDFKHUWUDLQLQJDQG 

VXSSRUW LQ XVLQJ SURGXFWV WKH GXUDWLRQ H[WHQW DQG ORFDWLRQ RI SURGXFW XVH WHFKQLFDO 

GLIILFXOWLHVLQXVLQJSURGXFWVDQGUROHRISURGXFWVLQWKHFXUULFXOXP 


 

7KHWKUHHSURGXFWVVHOHFWHGIRUWKHVWXG\DUHVLPLODUWRRWKHUSURGXFWVWKDWVFKRROVXVH 

IRUPDWKLQVWUXFWLRQLQVL[WKJUDGHWKRXJKWKH\GRQRWUHSUHVHQWDVWDWLVWLFDOVDPSOHRIDOO 

DYDLODEOH WHFKQRORJ\ LQ VL[WK JUDGH PDWK LQVWUXFWLRQ $OO WKUHH SURGXFWV LQ WKH VL[WK JUDGH 

VWXG\SURYLGHWXWRULDOSUDFWLFHDQGDVVHVVPHQWRSSRUWXQLWLHVLQPDWKHPDWLFV6NLOOVFRYHUHG 

LQFOXGHRSHUDWLRQVZLWKIUDFWLRQVGHFLPDOVDQGSHUFHQWVSODQHDQGFRRUGLQDWHJHRPHWU\ 

UDWLRVUDWHVDQGSURSRUWLRQVRSHUDWLRQVZLWKZKROHQXPEHUVDQGLQWHJHUVSUREDELOLW\DQG 

GDWDDQDO\VLVDQGPHDVXUHPHQW(DFKSURGXFWSURYLGHVVWXGHQWVZLWKRSSRUWXQLWLHVWRDSSO\ 

VNLOOVWKURXJKVROYLQJSUDFWLFHSUREOHPVKRZHYHUWKH\YDU\LQWKHOHYHORIWXWRULDODVVLVWDQFH 

9HQGRUVUHFRPPHQGHGWKDWSURGXFWVEHXVHGEHWZHHQDQGPLQXWHVDZHHN7KH 

VWXG\HVWLPDWHGWKHDYHUDJHOLFHQVLQJIHHVIRUWKHSURGXFWVWREHDERXWDVWXGHQWIRUWKH 

VFKRRO\HDUZLWKDUDQJHRIWR

52 

0DQ\ LQVWUXFWLRQDO IHDWXUHV RI WKH WKUHH SURGXFWV DUH VLPLODU VHH 7DEOH ,9 7ZR 

SURGXFWVFRQWDLQPDQ\WXWRULDOPRGXOHVWKHRWKHUSURYLGHVRQO\DIHZWXWRULDOPRGXOHV$OO 

WKUHH SURYLGH DPSOH RSSRUWXQLWLHV WR SUDFWLFH VNLOOV DQG JLYH VWXGHQWV LPPHGLDWH DQG 

GLDJQRVWLF IHHGEDFN ZKHQ LQ SUDFWLFH PRGH 7KH\ DOO SURYLGH IRU LQGLYLGXDOL]DWLRQ RI 

LQVWUXFWLRQDXWRPDWLFDOO\VHWWLQJLQGLYLGXDOVWXGHQWOHDUQLQJSDWKVGHSHQGLQJRQDVWXGHQW·V 

VNLOO OHYHO 7ZR SURGXFWV DOORZ WHDFKHUV WR VSHFLI\ PDQXDOO\ ZKLFK WXWRULDO XQLWV VWXGHQWV 

VKRXOGUHFHLYHDQGOHWVWXGHQWVLQGLFDWHVNLOOVWKH\ZRXOGOLNHWRSUDFWLFH$OOWKUHHSURYLGH 

WHDFKHUV ZLWK IHHGEDFN RQ DYHUDJH LQGLYLGXDO VWXGHQW DQG FODVV SHUIRUPDQFH DQG RQH 

SURYLGHV IHHGEDFN DW WKH OHYHO RI LQGLYLGXDO TXHVWLRQV 1RQH RI WKH SURGXFWV SURYLGHV 

IHHGEDFNWRVWXGHQWVLQDVVHVVPHQWPRGH 


 

9HQGRU WUDLQLQJ VHVVLRQV JHQHUDOO\ WRRN SODFH LQ KRVW GLVWULFWV DQG VRPHWLPHV KRVW 

VFKRROVGXULQJVXPPHURUHDUO\IDOORI7KHLQLWLDOWUDLQLQJODVWHGDERXWKRXUVDQG 

YDULHG E\ SURGXFW IURP KRXUV WR DERXW KRXUV 7UDLQLQJ WRSLFV LQFOXGHG FODVVURRP 

PDQDJHPHQWDQGDOLJQPHQWZLWKVWDQGDUGVDQGWKHORFDOFXUULFXOXPDQGWUDLQLQJVHVVLRQV 

LQFOXGHG RSSRUWXQLWLHV WR SUDFWLFH ZLWK WKH WHFKQRORJ\ 1HDUO\ DOO WHDFKHUV SHUFHQW 

DWWHQGHGWKHLQLWLDOWUDLQLQJDFFRUGLQJWRDWWHQGDQFHORJV2QDTXHVWLRQQDLUHFRPSOHWHGDW 

WKHHQGRILQLWLDOWUDLQLQJSHUFHQWRIWHDFKHUVVDLGWKH\ZHUHFRQILGHQWWKH\FRXOGXVHWKH 

SURGXFW$WWKHWLPHRIWKHILUVWFODVVURRPREVHUYDWLRQZKHQPRVWWHDFKHUVKDGEHJXQWR 

XVH SURGXFWV WKH SURSRUWLRQ RI WHDFKHUV ZKR WKRXJKW WKH LQLWLDO WUDLQLQJ KDG DGHTXDWHO\ 

SUHSDUHG WKHP WR XVH WKH SURGXFW KDG IDOOHQ IURP SHUFHQW WR SHUFHQW 9HQGRUV 

GHOLYHUHG RQJRLQJ VXSSRUW LQ VHYHUDO PRGHV 3URGXFW UHSUHVHQWDWLYHV YLVLWHG WHDFKHUV 

SHUFHQWRIWHDFKHUVUHSRUWHGUHFHLYLQJWKLVNLQGRIKHOSYHQGRUVDOVRSURYLGHGVXSSRUW 

WKURXJK HPDLO RU WHOHSKRQH KHOS GHVNV SHUFHQW DQG DGGLWLRQDO WUDLQLQJ DW VFKRROV 

SHUFHQW 

 

7KHVWXG\WHDPZRUNHGZLWKGLVWULFWVWRLGHQWLI\KDUGZDUHDQGVRIWZDUHQHHGVVXFKDV 

FRPSXWHUVKHDGSKRQHVPHPRU\DQGRSHUDWLQJV\VWHPXSJUDGHVLWDOVRSXUFKDVHGDVHWRI 

PRELOH ODSWRS FDUWV IRU RQH GLVWULFW ZKHUH DFFHVV WR VFKRRO FRPSXWHU ODEV ZDV WRR 

FRQVWUDLQHGWRVXSSRUWDGHTXDWHVWXGHQWXVH6WXG\REVHUYHUVQRWHGWKDWWUHDWPHQWWHDFKHUV 

DYHUDJHGDOPRVWFRPSXWHUVLQWKHLUURRPVWRVHUYHDQDYHUDJHFODVVVL]HRIDERXWVL[WK 

JUDGHUVLQFOXGLQJWKHPRELOHODEVSXUFKDVHGE\WKHVWXG\ 


 

1HDUO\DOOWHDFKHUVLPSOHPHQWHGSURGXFWVWRVRPHGHJUHHDQGUHSRUWHGXVLQJSURGXFWV 

IRU DQ DYHUDJH RI ZHHNV DQG DOPRVW KRXUV DZHHN 7DEOH ,9 VKRZVWKH KRXUV WKDW 

VWXGHQWV XVHG VWXG\ SURGXFWV DFFRUGLQJ WR WUHDWPHQW WHDFKHUV 7HDFKHUV DOVR XVHG RWKHU 

SURGXFWV LQ DGGLWLRQ WR VWXG\ SURGXFWV SHUFHQW RI FRQWURO WHDFKHUV DQG SHUFHQW RI 

WUHDWPHQWWHDFKHUVXVHGFRPSXWHUEDVHGPDWKSURGXFWVRWKHUWKDQWKRVHLQWKHVWXG\8VHRI 

RWKHUSURGXFWVZDVOHVVWKDQDQKRXUD\HDULQWUHDWPHQWFODVVHVDQGOHVVWKDQKRXUVD\HDU 

LQFRQWUROFODVVHVVHH7DEOH,91RQHRIWKHFRQWUROWHDFKHUVXVHGDVWXG\SURGXFW 

 

 

,9(IIHFWVRI6L[WK*UDGH0DWK6RIWZDUH3URGXFWV

53 

Ã 

Ã 

Ã 

7DEOH,9,QVWUXFWLRQDO)HDWXUHVRI6L[WK*UDGH0DWKHPDWLFV3URGXFWV 

 

 



3URGXFW 

7XWRULDO 

2SSRUWXQLWLHV 

3UDFWLFH 

2SSRUWXQLWLHV 7 3 $ 7 3 $ 7 3 $ 

6WXGHQW 

0DVWHU\ 

/HDUQLQJ 

3DWKV 

&ODVVURRP 


$ )HZ 0DQ\ 9 9 9 9 9 9 9 9 9 9 9 9 

% 0DQ\ 0DQ\ 9 9 9 9 9 9 9 9 9 9 9 9 9 9 

& 0DQ\ 0DQ\ 9 9 9 9 9 9 9 

 


 


 


VRXUFHRIHUURU0DVWHU\IHHGEDFN/HDUQHULQIRUPHGRIWKHQXPEHUFRUUHFWDQGZKHWKHUDVNLOORUFRQFHSWKDVEHHQDFTXLUHG´PDVWHUHGµ 


54 

7DEOH,97HDFKHU5HSRUWHG8VHRI6WXG\3URGXFWVDQG2WKHU0DWKHPDWLFV3URGXFWV 

 

6L[WK*UDGH 

 

6WXG\3URGXFWV 2WKHU0DWKHPDWLFV3URGXFWV 

 

7UHDWPHQW 

*URXS 

&RQWURO 

*URXS 

S 

YDOXH D 

 

7UHDWPHQW 

*URXS 

&RQWURO 

*URXS 

S 

YDOXH D 

3HUFHQWRIWHDFKHUVXVLQJ 

DSURGXFW QD 

 

 

0LQXWHVRIZHHNO\XVH QD QD 

+RXUVRIDQQXDOXVH QD QD 


6RXUFHV&ODVVURRPREVHUYDWLRQVDQGWHDFKHULQWHUYLHZV 

D 7HVWVRIGLIIHUHQFHZHUHFRQGXFWHGXVLQJDWZROHYHOKLHUDUFKLFDOPRGHOFODVVURRPVDQGVFKRROVZLWKWKH 

WUHDWPHQWHIIHFWDWOHYHORQHDQGEHWZHHQVFKRROYDULDQFHDWOHYHOWZR 


 

 

7DEOH,9'DLO\DQG$QQXDO8VDJH)URP3URGXFW5HFRUGV 

 

 

 

3URGXFW$ 3URGXFW% 3URGXFW& 

7RWDOGD\VXVHGGXULQJVFKRRO\HDU QD 

0LQXWHVRIGDLO\XVHZKHQXVHG QD 

+RXUVRIDQQXDOXVH QD 

6RXUFH 3URGXFWUHFRUGV2QHSURGXFWGLGQRWPDLQWDLQGDWDRQVWXGHQWXVDJH 

QD QRWDYDLODEOHRUXVDEOH 

 


DQGVFKRRO)LJXUH,9DQGDYHUDJHGDERXWKRXUVZLWKDVWDQGDUGGHYLDWLRQEHWZHHQ 

VFKRROVRIDERXWKRXUV1RVFKRROVKDGDQHJDWLYHGLIIHUHQFHDQGVRPHKDGKLJKOHYHOV 

RI GLIIHUHQFHV LQ XVDJH PRUH WKDQ KRXUV D \HDU 8VDJH GLIIHUHQFHV DOVR DUH HYLGHQW 

EHWZHHQ GLVWULFWV )RU H[DPSOH WKH GLIIHUHQFH EHWZHHQ WUHDWPHQW DQG FRQWURO WHDFKHU 

WHFKQRORJ\XVDJHZDVUHODWLYHO\ODUJHLQGLVWULFWFRPSDUHGWRGLVWULFW 

 

7ZR SURGXFWV PDLQWDLQHG GHWDLOHG UHFRUGV RQ VWXGHQW XVDJH RQ D ZHHNO\ DQG DQQXDO 

EDVLV7KHWKLUGSURGXFWGLGQRWPDLQWDLQUHFRUGVRQVWXGHQWXVH'DWDIRURQHSURGXFW 

VKRZHGGD\VRIXVHZLWKDQDYHUDJHRIPLQXWHVSHUXVHIRUDQDYHUDJHRIKRXUVRI 

VWXGHQWXVHIRUWKHVFKRRO\HDU7KHRWKHUVKRZHGGD\VRIXVHPLQXWHVDGD\DQG 

KRXUVIRUWKHVFKRRO\HDU7KHSURGXFWZLWKORZHUXVDJHKDGDPXFKODUJHUVKDUHRIWKH 

VWXGHQWVDPSOHKRZHYHU³PRUHWKDQWLPHVODUJHUWKDQWKHRWKHUSURGXFW³DQGWKHUHIRUH 

 


55 

)LJXUH,9 

'LIIHUHQFHLQ$QQXDO7HDFKHU5HSRUWHG+RXUVRI0DWK7HFKQRORJ\3URGXFW8VH%HWZHHQ 

7UHDWPHQWDQG&RQWURO&ODVVURRPV 

6L[WK*UDGH 

 

 

10 

+RXUV 

 

 

 

9 

9 

 

 

 

 

1 

1 

1 

2 

3 

4 

4 5 

4 

6 

6 7 

6 7 


8 

8 

8 

8 


 


FRQWULEXWHGPRUHWRRYHUDOOXVDJHHVWLPDWHGWREHDERXWKRXUVD\HDU $VVXPLQJPDWK 

LQVWUXFWLRQDOSHULRGVZHUHPLQXWHVLQDGD\VFKRRO\HDURQDYHUDJHSURGXFWVZHUH 

XVHGIRUDERXWSHUFHQWRIPDWKLQVWUXFWLRQDOWLPH 


 

7ZRSURGXFWVZHUHGHVLJQHGDVVXSSOHPHQWVWRWKHFRUHPDWKHPDWLFVFXUULFXOXPDQG 

RQHZDVGHVLJQHGWRIXQFWLRQHLWKHUDVWKHFRUHFXUULFXOXPRUDVDVRXUFHRIVXSSOHPHQWDU\ 

LQVWUXFWLRQ:KHQWUHDWPHQWWHDFKHUVZHUHDVNHGKRZWKH\XVHGSURGXFWVLQWKHLUWHDFKLQJ 

SHUFHQWVDLGWKH\XVHGWKHSURGXFWDVDVXSSOHPHQWDQGSHUFHQWVDLGWKH\XVHGLWDV 

WKHLUFRUHFXUULFXOXP 

 

7KHWZRW\SHVRIXVDJHGDWD³VFKHGXOHGXVHDFFRUGLQJWRWHDFKHUVDQGDFWXDOXVHDFFRUGLQJWRSURGXFW 

UHFRUGV³UHODWHWRGLIIHUHQWFRQFHSWVRIXVDJHEXWZHUHKLJKO\FRUUHODWHGU IRUZHHNO\XVHDQGU 

IRUDQQXDOXVH 

$VQRWHGLQSUHYLRXVFKDSWHUVWKHVWXG\PD\KDYHLQFUHDVHGXVDJHIURPW\SLFDOOHYHOVRIILUVWWLPHXVHUV 

EHFDXVHLWSXUFKDVHGKDUGZDUHDQGVRIWZDUHXSJUDGHVZLWKRXWJRLQJWKURXJKGLVWULFWSURFXUHPHQWSURFHVVHV 

SDLG WHDFKHUV KRQRUDULD IRU DWWHQGLQJ WUDLQLQJ RQ XVLQJ SURGXFWV DQG UHOD\HG LQIRUPDWLRQ WR SURGXFW 

GHYHORSHUVDERXWLVVXHVZLWKXVLQJSURGXFWVWKDWWKHWHDPREVHUYHGGXULQJFODVVURRPYLVLWV 


56 

0RVWWHDFKHUVSHUFHQWVFKHGXOHGWKHSURGXFWWREHXVHGGXULQJWKHLUUHJXODUFODVV 

WLPHVORW2IWKHUHPDLQGHUSHUFHQWVDLGVWXGHQWVXVHGWKHVRIWZDUHGXULQJRWKHUWLPHV 

VXFKDVEHIRUHVFKRRORUGXULQJOXQFKDQGSHUFHQWVDLGWKHLUVWXGHQWVXVHGWKHSURGXFW 

GXULQJFODVVWLPHDQGDWRWKHUWLPHV 

 

3URGXFWVZHUHXVHGLQWKHUHJXODUFODVVURRPVDQGLQFRPSXWHUODEVZLWKDERXWHTXDO 

IUHTXHQF\ SHUFHQW LQ FODVVURRPV DQG SHUFHQW LQ ODEV &RQVLVWHQW ZLWK YHQGRU 

UHFRPPHQGDWLRQV QHDUO\ DOO WHDFKHUV SHUFHQW UHSRUWHG EHLQJ SUHVHQW ZKHQ WKHLU 

VWXGHQWVXVHGSURGXFWV$WRWDORISHUFHQWUHSRUWHGUHYLHZLQJDVVHVVPHQWUHSRUWVWZRWR 

WKUHHWLPHVDPRQWKRUPRUHDQGSHUFHQWUHSRUWHGUHYLHZLQJDVVHVVPHQWUHSRUWVRQFHD 

ZHHNRUPRUH 


 

6WXG\REVHUYHUVUHSRUWHGWHFKQLFDOSUREOHPVWKDWDIIHFWHGDWOHDVWRQHVWXGHQWLQDERXW 

D TXDUWHU SHUFHQW RI WKH WLPH VHJPHQWV WKH\REVHUYHG HDFK REVHUYDWLRQ FRQVLVWHG RI 

IRXU WR ILYH WLPH VHJPHQWV 0RVW WHFKQLFDO SUREOHPV VXFK DV SUREOHPV ORJJLQJ RQ WR 

SURGXFWVRUKDYLQJFRPSXWHUVIUHH]HDQGQHHGUHERRWLQJZHUHEULHIDQGDIIHFWHGRQO\DIHZ 

VWXGHQWV 

6DWLVIDFWLRQZLWK3URGXFWV 


LI WKH\ KDG WKH RSSRUWXQLW\ :KHQ DVNHG ZKDW WKH\ ZRXOG FKDQJH LQ WKH VHFRQG \HDU 

SHUFHQWVDLGWKH\ZRXOGQRWFKDQJHDQ\WKLQJDQGSHUFHQWVDLGWKDWWKH\ZRXOGVSHQG 

PRUHWLPHEHFRPLQJIDPLOLDUZLWKWKHVRIWZDUHQRRWKHUUHVSRQVHFDWHJRU\LQFOXGHGPRUH 

WKDQSHUFHQWRIWHDFKHUV 


 

7DEOH ,9 VKRZV WKDW WUHDWPHQW WHDFKHUV ZHUH REVHUYHG EHLQJ IDFLOLWDWRUV GXULQJ D 

ODUJHU SURSRUWLRQ RI WLPH VHJPHQWV WKDQ FRQWURO WHDFKHUV³ SHUFHQW FRPSDUHG WR 

SHUFHQWS 6WXGHQWVLQWUHDWPHQWFODVVURRPVZHUHDOVRPRUHOLNHO\WREHHQJDJHG 

LQLQGLYLGXDOZRUNWKDQVWXGHQWVLQFRQWUROFODVVURRPV³SHUFHQWFRPSDUHGWRSHUFHQW 

S/LVWHQLQJWRDOHFWXUHZDVWKHPRVWIUHTXHQWO\REVHUYHGVWXGHQWDFWLYLW\LQFRQWURO 

FODVVURRPV 

7KHGLIIHUHQFHVZHUHHVWLPDWHGXVLQJDWZROHYHOKLHUDUFKLFDOOLQHDUPRGHOZLWKWHDFKHUVLQWKHILUVWOHYHO 

DQGVFKRROVLQWKHVHFRQGOHYHO 


57 

7DEOH,9$FWLYLWLHVLQ7UHDWPHQWDQG&RQWURO&ODVVURRPV6L[WK*UDGH3HUFHQWDJHRI 

2EVHUYDWLRQV 

 

 

7UHDWPHQW &RQWURO 

&ODVVURRPV &ODVVURRPV SYDOXH D 


/HDGHU 

)DFLOLWDWRU 



2WKHU 


,QGLYLGXDOZRUN 

/HFWXUH 



2WKHU 


3HUFHQWRILQWHUYDOVZLWKPRUHWKDQ 

SHUFHQWRIVWXGHQWVRQWDVN 

6DPSOH6L]H 


1XPEHURIREVHUYDWLRQLQWHUYDOV 

 

 

 

 

6RXUFH&ODVVURRPREVHUYDWLRQLQWHUYDOVDWPLQXWHVDQGIRUHDFKFODVV 

 

 

 

D 7HVWVRIGLIIHUHQFHVZHUHFRQGXFWHGXVLQJWZROHYHOKLHUDUFKLFDOPRGHOVZLWKWHDFKHU·VWUHDWPHQWVWDWXVDW 

OHYHORQHDQGDVFKRROUDQGRPHIIHFWDWOHYHOWZR7KHSYDOXHLVWKHVPDOOHVWOHYHORIVLJQLILFDQFHDWZKLFK 

WKHQXOOK\SRWKHVLVWKDWWKHGLIIHUHQFHEHWZHHQWUHDWPHQWFODVVVHVVLRQVDQGFRQWUROFODVVVHVVLRQVHTXDOV 

]HURFDQEHUHMHFWHG 

E2EVHUYHUVFRGHG´DOOWKDWDSSO\µ3HUFHQWDJHVFDQDGGWRPRUHWKDQ 

 

% (IIHFWVRQ0DWK7HVW6FRUHV 



VFRUHV JHQHUDOO\ ZHUH QRW VWDWLVWLFDOO\ GLIIHUHQW IURP ]HUR DQG PRVW WHDFKHU DQG VFKRRO 

FKDUDFWHULVWLFVZHUHXQFRUUHODWHGZLWKHIIHFWV 

7UHDWPHQWDQG&RQWURO*URXS&KDUDFWHULVWLFVRI7HDFKHUVDQG6WXGHQWV 

 

7HDFKHUVDQGVWXGHQWVJHQHUDOO\ZHUHVLPLODULQWUHDWPHQWDQGFRQWUROFODVVURRPVZLWK 

WZRH[FHSWLRQV7DEOH,9$IWHUDGMXVWLQJIRUPXOWLSOHFRPSDULVRQVQRWHDFKHURUVWXGHQW 

FKDUDFWHULVWLFVZHUHVWDWLVWLFDOO\GLIIHUHQW 

 

 


58 

 

7DEOH,9&KDUDFWHULVWLFVRI7HDFKHUVDQG6WXGHQWVLQ7UHDWPHQWDQG&RQWURO&ODVVURRPV 

6L[WK*UDGH 

 

7UHDWPHQW 

&ODVVURRPV 

&RQWURO 

&ODVVURRPV 

SYDOXH D 


59 

 

7DEOH,9 6SULQJ0DWK7HVW6FRUH'LIIHUHQFHVLQ7UHDWPHQWDQG&RQWURO&ODVVURRPV 

6L[WK*UDGH 

 

7UHDWPHQW 

&ODVVURRP 

$YHUDJH 

6FRUH 

1&( 

&RQWURO 

&ODVVURRP 

$YHUDJH 

6FRUH 

1&( 

(IIHFW 

6L]H 

'LIIHUHQFH 

SYDOXH 

6WDQIRUG $FKLHYHPHQW 7HVW 

7HQWK(GLWLRQ 

2YHUDOOVFRUH 


3URFHGXUHV 

3UREOHPVROYLQJ 

6RXUFH 

 

 

$XWKRUFDOFXODWLRQVVHH$SSHQGL[%IRUGHWDLOVRIWKHHVWLPDWLRQPRGHO9DULDEOHVLQWKHPRGHO 

LQFOXGHVWXGHQWDJHJHQGHUDQGWKHSUHWHVWVFRUHVWHDFKHUJHQGHUH[SHULHQFHDQGZKHWKHUKHRU 

VKHKDGDPDVWHU·VGHJUHHVFKRROUDFHDQGHWKQLFLW\SHUFHQWRIVWXGHQWVLQVSHFLDOHGXFDWLRQDQG 

SHUFHQWHOLJLEOHIRUIUHHOXQFKDQGVWXGHQWFODVVURRPDQGVFKRROUDQGRPHIIHFWV 



(IIHFWVL]HVDUHEDVHGRQWKHVWDQGDUGGHYLDWLRQRIWKHFRQWUROJURXSIRUWKHVSULQJWHVW 

7DEOH,9(IIHFWRQ3HUFHQWRI6WXGHQWVLQ/RZHVW7KLUGRI0DWK7HVW6FRUHV 

 

7UHDWPHQW 

&ODVVURRP 

3HUFHQWDJH 

&RQWURO 

&ODVVURRP 

3HUFHQWDJH 

'LIIHUHQFH 

(IIHFW 

6L]H 

SYDOXH 

 

3HUFHQWRIVWXGHQWVEHORZ UG 

SHUFHQWLOHRIVSULQJPDWKWHVW 

1RWH 2WKHU YDULDEOHV LQ WKH PRGHO LQFOXGH VWXGHQW DJH JHQGHU DQG WKH SUHWHVW VFRUHV WHDFKHU 

JHQGHUH[SHULHQFHDQGZKHWKHUKHRUVKHKDGDPDVWHU·VGHJUHHVFKRROUDFHDQGHWKQLFLW\ 

SHUFHQW RI VWXGHQWV LQ VSHFLDO HGXFDWLRQ SHUFHQW HOLJLEOH IRU IUHH OXQFK DQG VWXGHQW 

FODVVURRPDQGVFKRROUDQGRPHIIHFWV 

7KHWUHDWPHQWFODVVURRPSHUFHQWDJHUHSRUWHGLQWKHWDEOHLVWKHFRQWUROFODVVURRPSHUFHQWDJH 

SOXVWKHWUHDWPHQWHIIHFW,WGLIIHUVIURPWKHXQDGMXVWHGWUHDWPHQWSHUFHQWDJH7KHHIIHFWVL]H 

LVFDOFXODWHGXVLQJWKH&R[LQGH[WKHORJRGGVUDWLRGLYLGHGE\ 

 


 

7DEOH ,9 VKRZV HVWLPDWHV RI WKH UHODWLRQVKLS EHWZHHQ FODVVURRP DQG VFKRRO 

FKDUDFWHULVWLFVDQGSURGXFWHIIHFWVZLWKSRVLWLYHFRHIILFLHQWVLQGLFDWLQJWKDWDFKDUDFWHULVWLFLV 

SRVLWLYHO\ FRUUHODWHG ZLWK HIIHFWV DQG D QHJDWLYH FRHIILFLHQW LQGLFDWLQJ WKH RSSRVLWH $V D 

JURXS FODVVURRP DQG VFKRRO FKDUDFWHULVWLFV ZHUH QRW VWDWLVWLFDOO\ VLJQLILFDQWO\ UHODWHG WR 

HIIHFWLYHQHVV DQG QHLWKHU VFKRRO QRU FODVVURRP FKDUDFWHULVWLFV ZHUH UHODWHG WR HIIHFWV LQ 

VHSDUDWH WHVWV 7KH DPRXQW RI WLPH VWXG\ SURGXFWV ZHUH XVHG ZDV QRW FRUUHODWHG ZLWK 

SURGXFWHIIHFWV 


60 

,9(IIHFWVRI6L[WK*UDGH0DWK6RIWZDUH3URGXFWV 



)LJXUH,9 


6L[WK*UDGH6$70DWK6FRUH 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 


(IIHFW6L]H 

)LJXUH,9 


6L[WK*UDGH6$70DWK6FRUH 

A 

A 

A 

A 

A 

A 

A 

A 

A 

A 

A 

B 

B 

B 

B 

B 

B 

B 

B 

B 

C 

C 

C 

 

 

 

 

 

 

 

 

 


(IIHFW6L]H

7DEOH,9,QWHUDFWLRQV%HWZHHQ0RGHUDWLQJ9DULDEOHVDQG(IIHFWV6$70DWK7HVW6L[WK*UDGH 

7RWDO6FRUH1&( 3URFHGXUHV1&( 3UREOHP6ROYLQJ1&( 

FRHIILFLHQW VWDQGDUGHUURU SYDOXH FRHIILFLHQW VWDQGDUGHUURU SYDOXH FRHIILFLHQW VWDQGDUGHUURU SYDOXH 


& &RQFOXVLRQV 

7KLV VWXG\ H[SHULPHQWDOO\ WHVWHG WKH HIIHFWV RI WKUHH PDWK VRIWZDUH SURGXFWV LQ VL[WK 

JUDGHFODVVURRPVWKDWYROXQWHHUHGWRSDUWLFLSDWH7KHVFKRROVSDUWLFLSDWLQJLQWKHVWXG\ZHUH 

PRUHOLNHO\WREHLQXUEDQDUHDVDQGKDGKLJKHUWKDQDYHUDJHOHYHOVRISRYHUW\DQGODUJHU 

SHUFHQWDJHVRIPLQRULW\VWXGHQWVWKDQ86SXEOLFVFKRROVDVDZKROHH\ILQGLQJVLQFOXGH 

7HDFKHUV :HUH 7UDLQHG DQG 8VHG 3URGXFWV 1HDUO\ DOO WUHDWPHQW WHDFKHUV 

SHUFHQW UHFHLYHG WUDLQLQJ IURP WKH YHQGRU LQ XVLQJ WKH SURGXFW DQG DOO 

LPSOHPHQWHGWKHDVVLJQHGSURGXFWWRVRPHH[WHQW2YHUDOOXVDJHZDVHVWLPDWHG 

DWDERXWSHUFHQWRIPDWKLQVWUXFWLRQDOWLPH 

(IIHFWVRQ7HVW6FRUHV:HUH1RW6WDWLVWLFDOO\'LIIHUHQW)URP=HUR2YHUDOO 

PDWK VFRUHV IRU VWXGHQWV LQ WUHDWPHQW DQG FRQWURO FODVVURRPV ZHUH DQG 

UHVSHFWLYHO\ LQ QRUPDOFXUYHHTXLYDOHQW XQLWV 7KH GLIIHUHQFH ZDV QRW 

VWDWLVWLFDOO\GLIIHUHQWIURP]HUR 

6FKRRO DQG &ODVVURRP &KDUDFWHULVWLFV :HUH 1RW 5HODWHG WR 3URGXFW 

(IIHFWV 7LPH RI SURGXFW XVH DQG RWKHU VFKRRO DQG FODVVURRP FKDUDFWHULVWLFV 

ZHUHXQFRUUHODWHGZLWKSURGXFWHIIHFWV 


&KDSWHU9 

(IIHFWVRI$OJHEUD6RIWZDUH3URGXFWV 

 

7KLV FKDSWHU GHVFULEHV WKH LPSOHPHQWDWLRQ RI DOJHEUD WHFKQRORJ\ SURGXFWV DQG 

SUHVHQWVHVWLPDWHVRIWKHLUHIIHFWVDQGRIUHODWLRQVKLSVEHWZHHQHIIHFWVDQGFRQGLWLRQV 

DQGSUDFWLFHVLQSDUWLFLSDWLQJFODVVURRPVDQGVFKRROV0DQ\IHDWXUHVRIWKHVWXG\·V 

GHVLJQGDWDFROOHFWLRQDSSURDFKDQGDQDO\VLVDSSURDFKZHUHWKHVDPHDVIRUWKHUHDGLQJDQG 

VL[WK JUDGH PDWK SURGXFWV VXEVWXGLHV +RZHYHU WKH DOJHEUD VWXG\ XVHG WKH HQGRIFRXUVH 

DOJHEUDH[DPGHVLJQHGE\(GXFDWLRQDO7HVWLQJ6HUYLFH(76DVLWVIDOODQGVSULQJPHDVXUHRI 

DFKLHYHPHQW 7KH HQGRIFRXUVH H[DP KDV WKH EHQHILW RI GLUHFWO\ IRFXVLQJ RQ WKH VXEMHFW 

PDWWHUDQGKDVEHHQXVHGLQVHYHUDORWKHUVWXGLHVRIDOJHEUDWHFKQRORJ\SURGXFWV 

7KH DOJHEUD VWXG\ LQFOXGHG WKUHH VRIWZDUH SURGXFWV WKDW ZHUH LPSOHPHQWHG LQ 

VFKRROV ZLWKLQ GLVWULFWV 7KH VDPSOH LQFOXGHG WHDFKHUV DQG VWXGHQWV 7KH 

WKUHH SURGXFWV ZHUH &RJQLWLYH 7XWRU $OJHEUD SXEOLVKHG E\ &DUQHJLH /HDUQLQJ 3ODWR 

$OJHEUDSXEOLVKHGE\3ODWRDQG/DUVRQ$OJHEUDSXEOLVKHGE\+RXJKWRQ0LIIOLQ 


7KHLPSOHPHQWDWLRQDQDO\VLVIRFXVHGRQVL[DUHDVIHDWXUHVRIWKHSURGXFWVLQWKHVWXG\ 

WHDFKHUWUDLQLQJDQGVXSSRUWRQXVLQJSURGXFWVWKHGXUDWLRQH[WHQWDQGORFDWLRQRISURGXFW 

XVHWHFKQLFDOGLIILFXOWLHVLQXVLQJWKHSURGXFWVWKHLUUROHLQWKHFXUULFXOXPDQGWKHHIIHFWV 

WKDWSURGXFWXVHKDGRQFODVVURRPDFWLYLWLHV 


7KH SURGXFWV LQ WKH DOJHEUD VXEVWXG\ DOO SURYLGH WXWRULDO SUDFWLFH DQG DVVHVVPHQW 

RSSRUWXQLWLHVLQDOJHEUD7RSLFVLQFOXGHFRPPRQRQHVLQDOJHEUDIXQFWLRQVOLQHDUHTXDWLRQV 

DQGLQHTXDOLWLHVTXDGUDWLFHTXDWLRQVOLQHDUH[SUHVVLRQVSRO\QRPLDOVV\VWHPVRIHTXDWLRQV 

DQG LQHTXDOLWLHV DQG GDWD DQDO\VLV 3URGXFWV SURYLGH VWXGHQWV ZLWK RSSRUWXQLWLHV IRU 

H[DPSOH WR ZULWH VROYH DQG JUDSK HTXDWLRQV DQG LQHTXDOLWLHV VROYH V\VWHPV RI HTXDWLRQV 

DQGLQHTXDOLWLHVIDFWRUSRO\QRPLDOVDQGDQDO\]HDQGPDNHSUHGLFWLRQVIURPGDWD7KHVWXG\ 

HVWLPDWHGWKHDYHUDJHOLFHQVLQJIHHVIRUWKHSURGXFWVWREHDERXWDVWXGHQWIRUWKHVFKRRO 

\HDUZLWKDUDQJHRIWR

64 

7KH SURGXFWV ZHUH UDWHG DV VLPLODU RQ PDQ\ DVSHFWV RI WKHLU LQVWUXFWLRQDO GHVLJQ 

7DEOH9 7KH\ DOO LQGLYLGXDOL]H LQVWUXFWLRQ DXWRPDWLFDOO\ VHWWLQJ LQGLYLGXDO VWXGHQW 

OHDUQLQJ SDWKV GHSHQGLQJ RQ D VWXGHQW·V SDUWLFXODU VNLOO OHYHO DQG DOVR OHWWLQJ WHDFKHUV RU 

VWXGHQWVPDQXDOO\VHOHFWVNLOOVWRSUDFWLFH7ZRSURGXFWVLQFOXGHPDQ\WXWRULDOPRGXOHVWKH 

RWKHU KDV IHZHU WXWRULDOV DQG SURYLGHV DGGLWLRQDO WXWRULDO RSSRUWXQLWLHV LQ SULQW PDWHULDOV 

LQWHQGHGWREHXVHGZLWKWKHFRPSXWHUEDVHGFRPSRQHQW$OOWKUHHSURGXFWVSURYLGHDPSOH 

RSSRUWXQLWLHVIRUSUDFWLFLQJDOJHEUDVNLOOVDQGJLYHLPPHGLDWHGLDJQRVWLFIHHGEDFNZKHQXVHG 

LQ ´SUDFWLFHµ PRGH $OVR WKH\ DOO JLYH WHDFKHUV IHHGEDFN RQ LQGLYLGXDO VWXGHQW DQG FODVV 

SHUIRUPDQFH IRU JURXSV RI LWHPV DQG RQH JLYHV WHDFKHUV UHFRPPHQGDWLRQV IRU 

LQGLYLGXDOL]LQJVWXGHQWV·OHDUQLQJSDWKVEDVHGRQVWXGHQWVFRUHVRQDVVHVVPHQWV 


 

7UHDWPHQWWHDFKHUVZHUHWUDLQHGLQWKHLUKRVWGLVWULFWVRUVFKRROVGXULQJVXPPHURUHDUO\ 

IDOORI7KHLQLWLDOWUDLQLQJSURYLGHGE\WKHWKUHHDOJHEUDSURGXFWYHQGRUVODVWHGDERXW 

KRXUV YDU\LQJ IURP WR KRXUV 7RSLFV LQFOXGHG FODVVURRP PDQDJHPHQW DQG 

DOLJQPHQWZLWKVWDQGDUGVDQGWKHORFDOFXUULFXOXP7HDFKHUVZHUHDOVRDEOHWRSUDFWLFHXVLQJ 

WKH SURGXFW 1HDUO\ DOO WHDFKHUV SHUFHQW DWWHQGHG WKH LQLWLDO WUDLQLQJ DFFRUGLQJ WR 

DWWHQGDQFHORJV2QDTXHVWLRQQDLUHFRPSOHWHGDWWKHHQGRILQLWLDOWUDLQLQJSHUFHQWRI 

WHDFKHUVVDLGWKH\ZHUHFRQILGHQWWKH\ZHUHSUHSDUHGWRXVHWKHSURGXFWZLWKWKHLUVWXGHQWV 

%\WKHWLPHRIWKHILUVWFODVVURRPREVHUYDWLRQWKHSURSRUWLRQRIWHDFKHUVZKREHOLHYHGWKH 

LQLWLDO WUDLQLQJ KDG DGHTXDWHO\ SUHSDUHG WKHP WR XVH WKH SURGXFW KDG GURSSHG IURP 

SHUFHQW WR SHUFHQW 2QJRLQJ VXSSRUW ZDV SURYLGHG E\ YHQGRUV LQ YDULRXV PRGHV 

6RPHKDGFRPSDQ\UHSUHVHQWDWLYHVYLVLWWHDFKHUVSHUFHQWRIWHDFKHUVUHSRUWHGUHFHLYLQJ 

WKLVNLQGRIVXSSRUWVXSSRUWHGHPDLORUWHOHSKRQHKHOSGHVNVSHUFHQWRIWHDFKHUVVDLG 

WKH\ZHUHDZDUHRIRUXVHGWKLVNLQGRIVXSSRUWDQGSURYLGHGDGGLWLRQDOWUDLQLQJDWVFKRROV 

ZKLFKSHUFHQWRIWHDFKHUVUHSRUWHGUHFHLYLQJ 

 

7KHVWXG\WHDPSXUFKDVHGVRPHKDUGZDUHDQGVRIWZDUHXSJUDGHVLQKRVWVFKRROVEXWWR 

D OHVVHU H[WHQW WKDQ LQ RWKHU JUDGH OHYHOV 6WXG\ REVHUYHUV QRWHG WKDW WUHDWPHQW WHDFKHUV 

DYHUDJHGDERXWFRPSXWHUVLQWKHURRPVZKHWKHULQODEVRUUHJXODUFODVVURRPVZKHUH 

SURGXFWVZHUHEHLQJXVHG 


 

$OO WUHDWPHQW WHDFKHUV LPSOHPHQWHG WKH SURGXFWV WR VRPH GHJUHH VHH 7DEOH 9 

7UHDWPHQWWHDFKHUVUHSRUWHGWKDWWKH\XVHGVWXG\SURGXFWVIRUDERXWZHHNVGXULQJWKH 

VFKRRO\HDUIRUDOPRVWPLQXWHVDZHHNWRWDOLQJKRXUVIRUWKLVSHULRG2QO\SHUFHQW 

RI WUHDWPHQW WHDFKHUV DQG SHUFHQW RI FRQWURO WHDFKHUV UHSRUWHG XVLQJ PDWK SURGXFWV 

EHVLGHVWKRVHLQWKHVWXG\2QDYHUDJHXVHRIRWKHUPDWKVRIWZDUHSURGXFWVZDVDERXW 

KRXUVD\HDUIRUFRQWUROWHDFKHUVDQGKRXUVIRUWUHDWPHQWWHDFKHUV7DEOH97KHPRVW 

FRPPRQO\XVHGSURGXFWVZHUHRQOLQHVWXG\PDWHULDOVWRVXSSOHPHQWDFRPPHUFLDOWH[WERRN 

DQGDZHEVLWHGHYHORSHGE\DVWDWHGHSDUWPHQWRIHGXFDWLRQWKDWSURYLGHGVWXG\SUREOHPV 

IRUVWXGHQWVWRSUHSDUHIRUWKHVWDWHWHVWV1RQHRIWKHFRQWUROWHDFKHUVXVHGDVWXG\SURGXFW 

9(IIHFWVRI$OJHEUD6RIWZDUH3URGXFWV

65 

7DEOH9,QVWUXFWLRQDO)HDWXUHVRI$OJHEUD3URGXFWV 

 

 



3URGXFW 

7XWRULDO 

2SSRUWXQLWLHV 

3UDFWLFH 

2SSRUWXQLWLHV 7 3 $ 7 3 $ 7 3 $ 

6WXGHQW 

0DVWHU\ 

/HDUQLQJ 

3DWKV 

&ODVVURRP 


$ )HZ 0DQ\ 9 9 9 9 9 9 9 9 9 9 9 

% 0DQ\ 0DQ\ 9 9 9 9 9 9 9 9 9 9 9 9 9 

& 0DQ\ 0DQ\ 9 9 9 9 9 9 9 9 9 9 9 9 9 

 



 


VRXUFHRIHUURU0DVWHU\IHHGEDFN/HDUQHULQIRUPHGRIWKHQXPEHUFRUUHFWDQGZKHWKHUDVNLOORUFRQFHSWKDVEHHQDFTXLUHG 


7DEOH97HDFKHU5HSRUWHG8VHRI6WXG\3URGXFWVDQG2WKHU0DWK6RIWZDUH 

 

$OJHEUD6WXG\3URGXFWV 2WKHU0DWKHPDWLFV3URGXFWV 

 

7UHDWPHQW 

*URXS 

&RQWURO 

*URXS 

 

 

7UHDWPHQW 

*URXS 

&RQWURO 

*URXS 

SYDOXH D 

3HUFHQWRIWHDFKHUV 

XVLQJDSURGXFW 

0LQXWHVRIZHHNO\ 

XVH 



6RXUFHV&ODVVURRPREVHUYDWLRQVDQGWHDFKHULQWHUYLHZV 

D 7HVWV RI PHDQ GLIIHUHQFH ZHUH GRQH ZLWKLQ WZROHYHO KLHUDUFKLFDO PRGHOV ZLWK WKH HIIHFW RI WUHDWPHQW 

DVVLJQPHQWDWOHYHORQHDQGEHWZHHQVFKRROYDULDQFHDWOHYHOWZR 

6WDWLVWLFDOO\GLIIHUHQWDWWKHOHYHO 

 

 

 

7DEOH9'DLO\DQG$QQXDO8VDJH 

3URGXFW$ 3URGXFW% 3URGXFW& 2YHUDOO 

7RWDOGD\VXVHGGXULQJVFKRRO\HDU 

0LQXWHVRIGDLO\XVHZKHQXVHG 

 


6RXUFH 

3URGXFW UHFRUGV 2YHUDOO HVWLPDWHV DUH EDVHG RQ SURGXFW HVWLPDWHV ZHLJKWHG E\ VWXGHQW 

VDPSOHVL]HV 

 


DQGVFKRRO)LJXUH97KHGLIIHUHQFHDYHUDJHGDERXWKRXUVZLWKDVWDQGDUGGHYLDWLRQ 

EHWZHHQVFKRROVRIDERXWKRXUV1RVFKRROVKDGDQHJDWLYHGLIIHUHQFHDQGVRPHKDG 

KLJKOHYHOVRIXVDJHPRUHWKDQKRXUVD\HDU8VDJHGLIIHUHQFHVDUHDOVRHYLGHQWEHWZHHQ 

GLVWULFWV )RU H[DPSOH WKH GLIIHUHQFH EHWZHHQ WUHDWPHQW DQG FRQWURO WHDFKHU WHFKQRORJ\ 

XVDJHZDVUHODWLYHO\ODUJHLQGLVWULFWFRPSDUHGWRGLVWULFW 

 

$FFRUGLQJWRSURGXFWUHFRUGVDFWXDOVWXGHQWXVDJHUDQJHGIURPWRDOPRVWKRXUV 

VHH 7DEOH 9 2YHUDOO XVDJH DYHUDJHG KRXUV IRU WKH VFKRRO \HDU ZKLFK LV DERXW 

 

 

$YHUDJHUHSRUWHGSURGXFWXVDJHDFFRUGLQJWRWHDFKHUVKRXUVD\HDUZDVODUJHUWKDQDYHUDJHXVDJH 

IURP SURGXFW UHFRUGV KRXUV DQG WHDFKHUUHSRUWHG XVDJH DQG XVDJH DFFRUGLQJ WR SURGXFW UHFRUGV ZHUH 

PRGHUDWHO\FRUUHODWHGU IRUDQQXDOXVH7KHGHJUHHRIFRUUHODWLRQVXJJHVWVWKDWWHDFKHUUHSRUWHGXVDJH 

LVRQO\DURXJKLQGLFDWRURIDFWXDOXVDJH 


)LJXUH9 

'LIIHUHQFHLQ$QQXDO7HDFKHU5HSRUWHG+RXUVRI0DWK7HFKQRORJ\3URGXFW8VH 

%HWZHHQ7UHDWPHQWDQG&RQWURO&ODVVURRPV 

$OJHEUD 

 

 

+RXUV 

 

 

1 

2 

10 

 

 

 

 

1 

1 

3 

4 

4 

5 

6 

6 

6 

7 

7 

8 

9 

9 

10 




SHUFHQW RI PDWK LQVWUXFWLRQDO WLPH DVVXPLQJ D PLQXWH FODVV SHULRG DQG D GD\ 

VFKRRO\HDU 


7ZR SURGXFWV ZHUH LQWHQGHG WR VXSSOHPHQW WKH FRUH FXUULFXOXP DQG WKH WKLUG ZDV 

LQWHQGHGWREHWKHFRUHDOJHEUDFXUULFXOXP:KHQWUHDWPHQWWHDFKHUVZHUHDVNHGDERXWWKH 

UROHRISURGXFWVLQWKHLUDOJHEUDFXUULFXOXPSHUFHQWLQGLFDWHGWKH\XVHGWKHSURGXFWDVD 

VXSSOHPHQWDQGSHUFHQWVDLGWKH\XVHGWKHSURGXFWDVWKHLUFRUHFXUULFXOXP)RUWHDFKHUV 

XVLQJWKHSURGXFWWKDWZDVLQWHQGHGWREHDFRUHFXUULFXOXPSHUFHQWVDLGWKH\XVHGLW 

DVVXFK 

 

2YHUDOOXVDJHLVZHLJKWHGE\VWXGHQWVDPSOHVL]HIRUHDFKSURGXFW7KHXVDJHHVWLPDWHLQFOXGHVRQO\ 

WLPHXVLQJFRPSXWHUVDQGGRHVQRWLQFOXGHWKHQRQFRPSXWHUEDVHGFODVVDFWLYLWLHVWKDWZHUHDPDMRUSDUWRIWKH 

LPSOHPHQWDWLRQPRGHOIRURQHRIWKHSURGXFWV 


7HDFKHUV YDULHG LQ KRZ WKH\ VFKHGXOHG SURGXFW XVH 0RVW WHDFKHUV SHUFHQW XVHG 

SURGXFWVRQO\GXULQJUHJXODUFODVVWLPHDQGWKHRWKHUSHUFHQWXVHGLWERWKGXULQJFODVV 

WLPHDQGDWRWKHUWLPHV3URGXFWVZHUHXVHGLQFRPSXWHUODEVE\SHUFHQWRIWHDFKHUVDQG 

SHUFHQW RI WHDFKHUV XVHG SURGXFWV LQ UHJXODU FODVVURRPV &RQVLVWHQW ZLWK YHQGRU 

UHFRPPHQGDWLRQV QHDUO\ DOO WUHDWPHQW WHDFKHUV SHUFHQW UHSRUWHG EHLQJ SUHVHQW ZKHQ 

WKHLUVWXGHQWVXVHGSURGXFWVDQGSHUFHQWUHSRUWHGUHYLHZLQJVWXGHQWUHSRUWVWZRWRWKUHH 

WLPHVDPRQWKRUPRUHIUHTXHQWO\ 


6WXG\ REVHUYHUV UHSRUWHG WHFKQLFDO SUREOHPV WKDW DIIHFWHG DW OHDVW RQH VWXGHQW LQ 

SHUFHQWRIWKHWLPHVHJPHQWVWKH\REVHUYHG(DFKREVHUYDWLRQLQFOXGHGIRXUWRILYHWLPH 

VHJPHQWV 0RVW WHFKQLFDO SUREOHPV³VXFK DV SUREOHPV ORJJLQJ RQ WR SURGXFWV RU KDYLQJ 

FRPSXWHUVIUHH]HDQGQHHGUHERRWLQJ³ZHUHEULHIDQGDIIHFWHGRQO\DIHZVWXGHQWV 

6DWLVIDFWLRQ:LWK3URGXFWV 

1HDUO\DOOWUHDWPHQWWHDFKHUVSHUFHQWVDLGWKH\ZRXOGXVHWKHSURGXFWLQWKHQH[W 

VFKRRO\HDULIJLYHQWKHFKRLFH:KHQDVNHGZKDWWKH\ZRXOGFKDQJHLQDVHFRQG\HDURI 

LPSOHPHQWDWLRQSHUFHQWVDLGWKH\ZRXOGDWWHQGPRUHFORVHO\WRDOLJQPHQWRIWKHVRIWZDUH 

ZLWKWKHFRUHFXUULFXOXPDQGDFFRXQWDELOLW\V\VWHPSHUFHQWVDLGWKH\ZRXOGVWDUWXVLQJ 

WKHSURGXFWVRRQHURUXVHLWPRUHRIWHQ 


 

'XULQJ REVHUYDWLRQ LQWHUYDOV WKH WLPH SHULRGV GXULQJ ZKLFK REVHUYHUV QRWHG WHDFKHU 

UROHV WUHDWPHQW WHDFKHUV ZHUH REVHUYHG DFWLQJ DV IDFLOLWDWRUV LQ D ODUJHU SURSRUWLRQ RI 

LQWHUYDOVWKDQFRQWUROWHDFKHUVSHUFHQWFRPSDUHGWRSHUFHQWS7DEOH9 

6WXGHQWVZHUHDOVRPRUHOLNHO\WREHHQJDJHGLQLQGLYLGXDOSUDFWLFHSHUFHQWFRPSDUHGWR 

SHUFHQWS,QFRQWUROFODVVURRPVVWXGHQWVZHUHPRUHOLNHO\WREHOLVWHQLQJWRD 

WHDFKHU·V OHFWXUH SDUWLFLSDWLQJ LQ TXHVWLRQDQGDQVZHU VHVVLRQV DQG UHYLHZLQJ WKHLU ZRUN 

ZLWK WHDFKHUV 6WXGHQWV ZHUH PRUH OLNHO\ WR EH RQ WDVN ZKHQ XVLQJ SURGXFWV SHUFHQW 

FRPSDUHGWRSHUFHQWS 

% (IIHFWVRQ$OJHEUD7HVW6FRUHV 



VFRUHV JHQHUDOO\ ZHUH QRW VWDWLVWLFDOO\ GLIIHUHQW IURP ]HUR DQG PRVW WHDFKHU DQG VFKRRO 

FKDUDFWHULVWLFVZHUHXQFRUUHODWHGZLWKHIIHFWV 

 

 

7KHGLIIHUHQFHVZHUHHVWLPDWHGXVLQJDWZROHYHOKLHUDUFKLFDOOLQHDUPRGHOZLWKWHDFKHUVLQWKHILUVWOHYHO 

DQGVFKRROVLQWKHVHFRQGOHYHO 


7DEOH9$FWLYLWLHVLQ7UHDWPHQWDQG&RQWURO&ODVVURRPV 

 

7UHDWPHQW 

&ODVVURRPV 

&RQWURO 

&ODVVURRPV 

SYDOXH D 


/HDGHU 

)DFLOLWDWRU 



2WKHU 


,QGLYLGXDOSUDFWLFH 

/HFWXUH 



2WKHU 


0RUHWKDQSHUFHQWRIVWXGHQWVRQWDVN 

 

6DPSOH6L]H 


1XPEHURIREVHUYDWLRQLQWHUYDOV 

 

 

 

 

 

6RXUFH&ODVVURRPREVHUYDWLRQLQWHUYDOVDWPLQXWHVDQGIRUHDFKFODVV 

D 7HVWVRIPHDQGLIIHUHQFHFRQGXFWHGZLWKLQIRXUOHYHOKLHUDUFKLFDOPRGHOVZLWKWKHHIIHFWRIWUHDWPHQW 

DVVLJQPHQWPRGHOHGDWOHYHORQHDQGEHWZHHQVFKRROYDULDQFHPRGHOHGDWOHYHOWZR 

E2EVHUYHUVFRGHG´DOOWKDWDSSO\µ 

 

7UHDWPHQWDQG&RQWURO*URXS&KDUDFWHULVWLFVRI7HDFKHUVDQG6WXGHQWV 

 

7HDFKHUDQGVWXGHQWFKDUDFWHULVWLFVZHUHVLPLODU7DEOH9IRUWUHDWPHQWDQGFRQWURO 

FRQGLWLRQV 7KH DYHUDJH VFRUH RQ WKH (76 DOJHEUD H[DP ZDV SHUFHQW FRUUHFW IRU 

VWXGHQWVLQWUHDWPHQWFODVVURRPVDQGSHUFHQWFRUUHFWLQFRQWUROFODVVURRPV5DQGRP 

JXHVVLQJ ZRXOG \LHOG D VFRUH RI SHUFHQW RQ DYHUDJH TXHVWLRQV KDG IRXU UHVSRQVH 

FDWHJRULHV+RZHYHUVWXGHQWVZHUHLQWKHHDUO\VWDJHVRIDOJHEUDLQVWUXFWLRQDQGZHUHWDNLQJ 

DILQDOH[DPLQDOJHEUD 

 

7KH(76DOJHEUDH[DPFRQVLVWVRIWZRTXHVWLRQWHVWVFRPELQHGLQDTXHVWLRQWHVW)RUSXUSRVHV 

RIWKHVWXG$76VHSDUDWHGWKHWHVWLQWRLWVWZRFRPSRQHQWVDQGWKHVWXG\WHDPUDQGRPO\DVVLJQHGVFKRROVWR 

WDNHRQHRIWKHFRPSRQHQWVDVWKHIDOOWHVWDQGWKHRWKHUDVWKHVSULQJWHVWKDOIWKHVFKRROVWRRNWKHWHVWLQWKH 

SDWWHUQ $% DQG WKH RWKHU KDOI WRRN WKH WHVW LQ WKH SDWWHUQ %$ 6WDWLVWLFDO WHVWV VKRZ VRPH GLIIHUHQFHV LQ 

DYHUDJHVFRUHVRQWKHWZRFRPSRQHQWV+RZHYHUWKHVHGLIIHUHQFHVEHWZHHQWKHWZRKDOYHVRIWKHWHVWGRQRW 

DIIHFWPHDVXUHGHIIHFWVEHFDXVHWKHVDPHGLIIHUHQFHLVSUHVHQWIRUERWKWUHDWPHQWDQGFRQWUROFODVVURRPV 


(IIHFWV:HUH1RW6WDWLVWLFDOO\'LIIHUHQW)URP=HUR 

 

7DEOH9VKRZVDYHUDJHVFRUHGLIIHUHQFHVRQWKH(76DOJHEUDH[DPVFRUHDQGLWVWKUHH 

VXEWHVWVFRUHVFRQFHSWVSURFHVVHVDQGVNLOOVIURPWKHKLHUDUFKLFDOOLQHDUPRGHO1RQHRI 

WKHGLIIHUHQFHVLVVWDWLVWLFDOO\GLIIHUHQWIURP]HUR 

)LJXUHV9DQG9GHSLFWWKHYDULDWLRQRIVFKRROHIIHFWVL]HVE\GLVWULFWDQGE\ 

SURGXFW :LWKLQGLVWULFWVHIIHFWVL]HVUDQJHGZLGHO$RUH[DPSOHLQGLVWULFWHIIHFWVL]HV 

LQWKHIRXUVFKRROVUDQJHGIURPDERXWWR 

 

7DEOH9&KDUDFWHULVWLFVRI7HDFKHUVDQG6WXGHQWVLQ7UHDWPHQWDQG&RQWURO&ODVVURRPV 

 

7UHDWPHQW 

&ODVVURRPV 

&RQWURO 

&ODVVURRPV 

SYDOXH D 


7DEOH 9 (76 $OJHEUD )LQDO ([DP 6FRUH 'LIIHUHQFHV LQ 7UHDWPHQW DQG &RQWURO 

&ODVVURRPV 

7UHDWPHQW 

&ODVVURRP 

$YHUDJH 

6FRUH D 

&RQWURO 

&ODVVURRP 

$YHUDJH 

6FRUH D 

'LIIHUHQFH 

(IIHFW 

6L]H 

SYDOXH 

(76(QGRI&RXUVH$OJHEUD 

([DP 

2YHUDOOVFRUH 


&RQFHSWV 

3URFHVVHV 

6NLOOV 

6RXUFH 

$XWKRUFDOFXODWLRQVVHH$SSHQGL[%IRUGHWDLOVRIWKHHVWLPDWLRQPRGHO9DULDEOHVLQWKHPRGHO 

LQFOXGHVWXGHQWDJHJHQGHUDQGSUHWHVWVFRUHWHDFKHUJHQGHUH[SHULHQFHDQGZKHWKHUKHRUVKH 

KDG D PDVWHU·V GHJUHH VFKRRO UDFH DQG HWKQLFLW\ SHUFHQW RI VWXGHQWV LQ VSHFLDO HGXFDWLRQ DQG 


 



D7KH(76WHVWVFRUHLVWKHSHUFHQWRITXHVWLRQVDQVZHUHGFRUUHFWO\ 

1RWH 

(IIHFWVL]HVDUHFDOFXODWHGXVLQJWKHFRQWUROJURXSVWDQGDUGGHYLDWLRQVRQWKHVSULQJWHVW 

7KHVSULQJILQDOH[DPVFRUHVIRUVWXGHQWVLQWKHWUHDWPHQWDQGFRQWUROJURXSVEHIRUH 

PRGHOEDVHGDGMXVWPHQWDYHUDJHGSHUFHQWIRUWUHDWPHQWFODVVURRPVDQGSHUFHQWIRU 

FRQWUROFODVVURRPV)DOOVFRUHVDYHUDJHGDERXWSHUFHQWIRUERWKJURXSVLQGLFDWLQJWKDW 

DIWHUDVFKRRO\HDURIDOJHEUDLQVWUXFWLRQWKHDYHUDJHVWXGHQWLQWKHVWXG\ZDVDEOHWRDQVZHU 

DQDGGLWLRQDORQHRUWZRTXHVWLRQVFRUUHFWO\HDFKTXHVWLRQZDVZRUWKIRXUSRLQWV,Q 

LQIRUPDWLRQIURP(76LQGLFDWHVWKDWWHVWWDNHUVDYHUDJHGSHUFHQWFRUUHFWKRZHYHU7HVW 

WDNHUV LQ WKH VWXG\ ZHUH ZLWKLQ D UHDVRQDEOH UDQJH RI WKH DYHUDJH DIWHU DFFRXQWLQJ IRU 

SRYHUW\ OHYHOV DQG XUEDQLFLW\ RI VFKRROV LQ WKH VWXG\ (YDOXDWLRQV LQ GLVWULFWV ZLWK 

FKDUDFWHULVWLFV VLPLODU WR GLVWULFWV LQ WKLV VWXG\ KDYH IRXQG FRPSDUDEOH VSULQJ (76 H[DP 

VFRUHV 6KQH\GHUPDQ 0RUJDQ DQG 5LWWHU :KHWKHU JDLQV ZHUH VPDOO LQ WKHVH 

VWXGLHVLVQRWNQRZQEHFDXVHWKHVHVWXGLHVGLGQRWDGPLQLVWHUWKHWHVWLQWKHIDOODQGVSULQJ 

+RZHYHU WKH VLPLODULW\ RI WKH DYHUDJH VSULQJ VFRUH LQ SUHYLRXV VWXGLHV ZLWK VFRUHV KHUH 

VXJJHVWVWKDWVFRUHVLQWKLVVWXG\DUHQRWDQDEHUUDWLRQ 

 

$QRWKHUZD\WRH[DPLQHZKHWKHUWKH(76WHVWIXQFWLRQHGSURSHUO\LVWRORRNDWVFRUH 

GLIIHUHQFHVRQGLVWULFWDVVHVVPHQWV,QWZRGLVWULFWVZKHUHWKHVWXG\ZDVDEOHWRJDWKHU 

GLVWULFWWHVWVFRUHGDWDIURPVFKRROUHFRUGVDQDQDO\VLVRIWKHGLVWULFWVFRUHV\LHOGHGVLPLODU 

GLUHFWLRQVRIVFRUHGLIIHUHQFHVDQGHIIHFWVL]HVZHUHVLPLODUVHH$SSHQGL[7DEOH%7KH 

VLPLODULWLHVSURYLGHVXSSRUWIRUWKH(76DOJHEUDWHVWDVDUHDVRQDEOHLQGLFDWLRQRIDOJHEUD 

SURGXFWHIIHFWLYHQHVV 


9(IIHFWVRI$OJHEUD6RIWZDUH3URGXFWV 

 



)LJXUH9 


$OJHEUD(76)LQDO([DP 

1 

1 

1 

2 

3 

3 

4 

4 

5 

6 

6 

6 

6 

7 

7 8 

9 

9 

10 

10 

10 

10 

 

 

 

 

 

 

 


(IIHFW6L]H 

)LJXUH9 


$OJHEUD(76)LQDO([DP 

$ 

$ 

$ 

$ 

$ 

$ 

$ 

$ 

% 

% 

% 

% 

% 

% 

% 

% 

% 

% 

% 

& 

& 

& 

 

 

 

 

 

 

 

 

 


(IIHFW6L]H


 

:KHWKHU VFRUH GLIIHUHQFHV ZHUH UHODWHG WR VFKRRO DQG FODVVURRP FKDUDFWHULVWLFV ZDV 

LQYHVWLJDWHG XVLQJ WKH VDPH DSSURDFK DV LQ SUHYLRXV FKDSWHUV 7KH VPDOOHU QXPEHU RI 

VFKRROV SDUWLFLSDWLQJ LQ WKH DOJHEUD VWXG\ FRPSDUHG WR WKH RWKHU WKUHH VWXGLHV OLPLWHG WKH 

QXPEHURIYDULDEOHVWKDWFRXOGEHLQFOXGHGLQWKHPRGHO&KDUDFWHULVWLFVLQFOXGHGZHUHWKRVH 

WKDWZHUHUHODWHGWRHIIHFWLYHQHVVLQWKHUHDGLQJVWXGLHVWHDFKHUH[SHULHQFHZKHWKHUWHDFKHUV 

KDG DGHTXDWH SUHSDUDWLRQ WLPH WLPH RI SURGXFW XVDJH DQG ZKHWKHU VWXG\ SURGXFWV ZHUH 

XVHGLQFODVVURRPV7ZRVFKRROFKDUDFWHULVWLFV³WKHSURSRUWLRQRIVWXGHQWVHOLJLEOHIRUIUHH 

OXQFKDQGWKHVWXGHQWWHDFKHUUDWLR³ZHUHDOVRLQFOXGHG 

 

7KHUHVXOWVDSSHDULQ7DEOH9DQGWKHVWDWLVWLFDOWHVWVDWWKHERWWRPRIWKHWDEOH 

LQGLFDWH WKDW FODVVURRP DQG VFKRRO FKDUDFWHULVWLFV ZHUH XQFRUUHODWHG ZLWK SURGXFW HIIHFWV 

6WXG\SURGXFWXVDJHKDGDQHJDWLYHFRUUHODWLRQZLWKSURGXFWHIIHFWVEXWZDVQRWVWDWLVWLFDOO\ 

VLJQLILFDQWDIWHUDGMXVWLQJIRUPXOWLSOHFRPSDULVRQV 

& &RQFOXVLRQV 

7KLV VWXG\ H[SHULPHQWDOO\ WHVWHG WKH HIIHFWV RI VHOHFW PDWK WHFKQRORJ\ SURGXFWV LQ 

DOJHEUDFODVVURRPVWKDWYROXQWHHUHGWRSDUWLFLSDWHH\ILQGLQJVLQFOXGHWKHIROORZLQJ 

 

7HDFKHUV:HUH7UDLQHGDQG8VHG3URGXFWV1HDUO\DOOWUHDWPHQWWHDFKHUV 

SHUFHQW UHFHLYHG WUDLQLQJ IURP WKH YHQGRU RQ XVLQJ WKH SURGXFW DQG DOO 

LPSOHPHQWHGWKHSURGXFWWRVRPHGHJUHH 

 

(IIHFWVRQ7HVW6FRUHV:HUH1RW6WDWLVWLFDOO\'LIIHUHQW)URP=HUR2YHUDOO 

PDWKVFRUHVIRUVWXGHQWVLQWUHDWPHQWDQGFRQWUROFODVVURRPVZHUHSHUFHQW 

FRUUHFWDQGSHUFHQWFRUUHFWUHVSHFWLYHO\7KHGLIIHUHQFHZDVQRWVWDWLVWLFDOO\ 

GLIIHUHQWIURP]HUR 

 

&ODVVURRP DQG 6FKRRO &KDUDFWHULVWLFV :HUH 8QFRUUHODWHG :LWK 3URGXFW 

(IIHFWV7KHDOJHEUDVWXG\LQFOXGHGIHZHUVFKRROVZKLFKOLPLWHGWKHDELOLW\WR 

HVWLPDWH PRGHUDWRU HIIHFWV 1RQH RI WKH FODVVURRP DQG VFKRRO FKDUDFWHULVWLFV 

LQFOXGHGLQWKHPRGHOZDVVWDWLVWLFDOO\VLJQLILFDQW 

 


7DEOH9,QWHUDFWLRQV%HWZHHQ0RGHUDWLQJ9DULDEOHVDQG(IIHFWV(76$OJHEUD7HVW 

&RHIILFLHQW 6WDQGDUG(UURU SYDOXH 


5HIHUHQFHV 

 

$GHOPDQ10%'RQQHOO\7'RYH-7LIIDQ\0RUDOHV$:D\QHDQG$=XFNHU 

3URIHVVLRQDO 'HYHORSPHQW DQG 7HDFKHUV· 8VHV RI 7HFKQRORJ\ 6XEWDVN(YDOXDWLRQRIH\ 

)DFWRUV ,PSDFWLQJ WKH (IIHFWLYH 8VH RI 7HFKQRORJ\ LQ 6FKRROV 5HSRUW WR WKH 86 

'HSDUWPHQWRI(GXFDWLRQ65,3URMHFW3$UOLQJWRQ9$65,,QWHUQDWLRQDO 

 

$JRGLQL50'\QDUVNL%0HDQV50XUSK\DQG/5RVHQEHUJ´5HYLVHG'HVLJQIRUWKH 

(YDOXDWLRQ RI WKH (IIHFWLYHQHVV RI (GXFDWLRQDO 7HFKQRORJ\ ,QWHUYHQWLRQVµ 5HSRUW 

SUHSDUHGIRU,QVWLWXWHRI(GXFDWLRQ6FLHQFHV86'HSDUWPHQWRI(GXFDWLRQ3ULQFHWRQ 

1-0DWKHPDWLFD3ROLF\5HVHDUFK,QF6HSWHPEHU 

 

$JRGLQL 5 0 '\QDUVNL 0 +RQH\ DQG ' /HYLQ ´7KH (IIHFWLYHQHVV RI (GXFDWLRQDO 

7HFKQRORJ\,VVXHVDQG5HFRPPHQGDWLRQVIRUWKH1DWLRQDO6WXG\µ5HSRUWSUHSDUHGIRU 

,QVWLWXWH RI (GXFDWLRQ 6FLHQFHV 86 'HSDUWPHQW RI (GXFDWLRQ 3ULQFHWRQ 1- 

0DWKHPDWLFD3ROLF\5HVHDUFK,QF0D\ 

 

$QGHUVRQ 5( DQG $ 5RQQNYLVW 7KH 3UHVHQFH RI &RPSXWHUV LQ $PHULFDQ 6FKRROV 5HSRUW 

7HDFKLQJ /HDUQLQJ DQG &RPSXWLQJ 1DWLRQDO 6XUYH\ ,UYLQH &$ &HQWHU IRU 

5HVHDUFKRQ,QIRUPDWLRQ7HFKQRORJ\DQG2UJDQL]DWLRQV 

 

%DQJHUW'URZQV 5 & XOLN - XOLN DQG 0 0RUJDQ ´7KH ,QVWUXFWLRQDO (IIHFW RI 

)HHGEDFN LQ 7HVW/LNH (YHQWVµ 5HYLHZ RI (GXFDWLRQDO 5HVHDUFKYROQRVXPPHU 

SS² 

 

%HFNHU+-´&RPSXWHU%DVHG,QWHJUDWHG/HDUQLQJ6\VWHPVLQWKH(OHPHQWDU\DQG0LGGOH 

*UDGHV$&ULWLFDO5HYLHZDQG6\QWKHVLVRI(YDOXDWLRQ5HSRUWVµ-RXUQDORI(GXFDWLRQDO 

&RPSXWLQJ5HVHDUFKYROQRSS 

 

%HFNHU+--5DYLW]DQG

76 

%ODFN3DQG':LOLDP´$VVHVVPHQWDQG&ODVVURRP/HDUQLQJµ$VVHVVPHQWLQ(GXFDWLRQYRO 

QRSS 

 

%ORN + 5 2RVWGDP 0( 2WWHU DQG 0 2YHUPDDW ´&RPSXWHU$VVLVWHG ,QVWUXFWLRQ LQ 

6XSSRUWRI%HJLQQLQJ5HDGLQJ,QVWUXFWLRQ$5HYLHZµ5HYLHZRI(GXFDWLRQDO5HVHDUFKYRO 

SS 

 

%OXPHQIHOG 3 % )LVKPDQ - UDMFLN 5: 0DU[ DQG ( 6RORZD\ ´&UHDWLQJ 8VDEOH 

,QQRYDWLRQV LQ 6\VWHPLF 5HIRUP 6FDOLQJ 8S 7HFKQRORJ\(PEHGGHG 3URMHFW%DVHG 

6FLHQFHLQ8UEDQ6FKRROVµ(GXFDWLRQDO3V\FKRORJLVWYROQRSS 

 

%UDQVIRUG-'$/%URZQDQG55&RFNLQJ´+RZ3HRSOH/HDUQ%UDLQ0LQGDQG([SHULHQFH 

:DVKLQJWRQ'&1DWLRQDO$FDGHP\3UHVV 

 

%XURV ,QVWLWXWH RI 0HQWDO 0HDVXUHPHQWV 7HVW 5HYLHZV 2QOLQH /LQFROQ 1( 8QLYHUVLW\ RI 

1HEUDVND/LQFROQ 

 

%XWOHU5´7DVN,QYROYLQJDQG(JR,QYROYLQJ3URSHUWLHVRI(YDOXDWLRQ(IIHFWVRI'LIIHUHQW 

&RQGLWLRQV RQ 0RWLYDWLRQDO 3HUFHSWLRQV ,QWHUHVW DQG 3HUIRUPDQFHµ -RXUQDO RI 

(GXFDWLRQDO3V\FKRORJ\YROQRSS 

 

&RKHQ'DQG'/%DOO,QVWUXFWLRQ&DSDFLW\DQG,PSURYHPHQW&35(5HVHDUFK5HSRUW1R 

553KLODGHOSKLD3$8QLYHUVLW\RI3HQQV\OYDQLD&RQVRUWLXPIRU3ROLF\5HVHDUFK 

LQ(GXFDWLRQ 

 

&URRNV 7- ´7KH ,PSDFW RI &ODVVURRP (YDOXDWLRQ 3UDFWLFHV RQ 6WXGHQWVµ 5HYLHZ RI 

(GXFDWLRQDO5HVHDUFKYROQRZLQWHUSS 

 

&XEDQ / 2YHUVROG DQG 8QGHUXVHG &RPSXWHUV LQ WKH &ODVVURRP &DPEULGJH 0$ +DUYDUG 

8QLYHUVLW\3UHVV 

 

&XEDQ / 6R 0XFK +LJK7HFK 0RQH\ ,QYHVWHG 6R /LWWOH 8VH DQG &KDQJH LQ 3UDFWLFH +RZ &RPH" 

5HSRUW WR WKH &&662 6WDWH (GXFDWLRQDO 7HFKQRORJ\ /HDGHUVKLS &RQIHUHQFH ² 

3UHSDULQJ7HDFKHUVWR0HHWWKH&KDOOHQJHRI1HZ6WDQGDUGVZLWK1HZ7HFKQRORJLHV 

:DVKLQJWRQ'&&RXQFLORI&KLHI6WDWH6FKRRO2IILFHUV 

 

&XOS 0 0 +RQH\ DQG ( 0DQGLQDFK $ 5HWURVSHFWLYH RQ 7ZHQW\ ZZZQDWLRQDOHGWHFKSODQRUJ 

SDUWLFLSDWH\HDUVSGI@ 

 

(GXFDWLRQDO 7HVWLQJ 6HUYLFH (QGRI&RXUVH $OJHEUD $VVHVVPHQW $GPLQLVWUDWRU·V 0DQXDO 

3ULQFHWRQ1-(76 

 

(UWPHU 3$ ´$GGUHVVLQJ )LUVW DQG 6HFRQG2UGHU %DUULHUV WR &KDQJH 6WUDWHJLHV IRU 

7HFKQRORJ\ ,QWHJUDWLRQµ (GXFDWLRQDO 7HFKQRORJ\ 5HVHDUFK DQG 'HYHORSPHQW YRO QR 

SS 

 

*RRG7/DQG-%URSK\/RRNLQJLQ&ODVVURRPV%RVWRQ0$$OO\QDQG%DFRQ 

 

5HIHUHQFHV

+DQVHQ((///ORVDDQG-6OD\WRQ(YDOXDWLRQRIWKH:DWHUIRUG(DUO\5HDGLQJ3URJUDPDVD 

6XSSOHPHQWDU\ 3URJUDP LQ WKH /RV $QJHOHV 8QLILHG 6FKRRO 'LVWULFW 3ODQQLQJ 

$VVHVVPHQW DQG 5HVHDUFK 'LYLVLRQ 3XEOLFDWLRQ 1R /RV $QJHOHV /RV $QJHOHV 

8QLILHG6FKRRO'LVWULFW3URJUDP(YDOXDWLRQDQG5HVHDUFK%UDQFK 

 

+HQULTXH] $ DQG 0 5LFRQVFHQWH 5KRGH ,VODQG 7HDFKHUV DQG 7HFKQRORJ\ ,QLWLDWLYH 3URJUDP 

(YDOXDWLRQ )LQDO 5HSRUW 1HZ ZZZHGFRUJ&&7 

SXEOLFDWLRQVBUHSRUWBVXPPDU\DVS"QXP3XE,G @ 

 

-R\QHU $ ´$ )RRWKROG IRU +DQGKHOGVµ $PHULFDQ 6FKRRO %RDUG -RXUQDO 6SHFLDO 5HSRUW 

6HSWHPEHU $FFHVVHG 2FWREHU DW >ZZZDVEMFRPVSHFLDOUHSRUWV 

6SHFLDO5HSRUWV6KWPO@ 

 

HUU67´7HFKQRORJ\DQGWKH)XWXUHRI6FKRROLQJµ,QWK

78 

0H]HUQLFK 00 :0 -HQNLQV 3 -RKQVWRQ & 6FKUHLQHU 6/ 0LOOHU DQG 3 7DOODO 

´7HPSRUDO 3URFHVVLQJ 'HILFLWV RI /DQJXDJH/HDUQLQJ ,PSDLUHG $PHOLRUDWHG E\ 

7UDLQLQJµ6FLHQFHYROQRSS 

 

0LOOHU61/LQQ37DOODO00HU]HQLFKDQG:-HQNLQV´6SHHFKDQG/DQJXDJH7KHUDS\ 

5HHGXFDWLRQ 2UWKRSKRQLTXHµ )HGHUDWLRQ 1DWLRQDOH GHV 2UWKRSKRQLVWHV 6SHFLDO ,VVXHV /D 

&RQVFLHQFH3KRQRORJLTXHYRO0DUFKSS 

 

0LOOV6&DQG7-5DJDQ´$7RROIRU$QDO\]LQJ,PSOHPHQWDWLRQ)LGHOLW\RIDQ,QWHJUDWHG 

/HDUQLQJ6\VWHP,/6µ(GXFDWLRQDO7HFKQRORJ\5HVHDUFK 'HYHORSPHQWYROSS 

 

 

0RUJDQ3DQG65LWWHU´$Q([SHULPHQWDO6WXG\RIWKH(IIHFWVRI&RJQLWLYH7XWRU$OJHEUD 

,RQ6WXGHQWQRZOHGJHDQG$WWLWXGHµ3LWWVEXUJK3$&DUQHJLH/HDUQLQJ,QF0D\ 

 

 

0XUSK\5:3HQXHO%0HDQV&RUEDNDQG$:KDOH\('(6$5HYLHZRI5HFHQW 

(YLGHQFH RQ WKH (IIHFWLYHQHVV RI 'LVFUHWH (GXFDWLRQDO 6RIWZDUH 0HQOR3DUN&$65, 

,QWHUQDWLRQDO 

 

1XQQHU\-$605RVVDQG$0F'RQDOG´$5DQGRPL]HG([SHULPHQWDO(YDOXDWLRQRI 

WKH ,PSDFW RI $FFHOHUDWHG 5HDGHU5HDGLQJ 5HQDLVVDQFH ,PSOHPHQWDWLRQ RQ 5HDGLQJ 

$FKLHYHPHQW LQ *UDGHV WR µ -RXUQDO RI (GXFDWLRQ IRU 6WXGHQWV 3ODFHG DW5LVN YRO 

QRSS 

 

3HDUVRQ3'5()HUGLJ5/%ORPH\HU-UDQG-0RUDQ7KH(IIHFWVRI7HFKQRORJ\RQ5HDGLQJ 

3HUIRUPDQFH LQ WKH 0LGGOH6FKRRO *UDGHV $ 0HWDDQDO\VLV ZLWK 5HFRPPHQGDWLRQV IRU 3ROLF\ 

1DSHUYLOOH,//HDUQLQJ3RLQW$VVRFLDWHV 

 

3UHVLGHQW·V &RPPLWWHH RI $GYLVRUV RQ 6FLHQFH DQG 7HFKQRORJ\ >3&$67@ 3DQHO RQ 

(GXFDWLRQDO 7HFKQRORJ\ 5HSRUW WR WKH 3UHVLGHQW RQ WKH 8VH RI 7HFKQRORJ\ WR 

6WUHQJWKHQ(GXFDWLRQLQWKH8QLWHG6WDWHV0DUFK$FFHVVHG0DUFK 

DW>ZZZRVWSJRY3&$67NHGKWPO@ 

 

5RXVH&(DQG$%UXHJHU´3XWWLQJ&RPSXWHUL]HG,QVWUXFWLRQWRWKH7HVW$ 

5DQGRPL]HG (YDOXDWLRQ RI D 6FLHQWLILFDOO\%DVHG· 5HDGLQJ 3URJUDPµ (FRQRPLFV RI 

(GXFDWLRQ5HYLHZYROQRSS 

 

6DQGKROW]-+&5LQJVWDIIDQG''Z\HU7HDFKLQJ:LWK7HFKQRORJ\&UHDWLQJ6WXGHQW&HQWHUHG 

&ODVVURRPV1HZ

6FKRILHOG-:DQG'9HUEDQ´&RPSXWHU8VDJHLQ7HDFKLQJ0DWKHPDWLFV,VVXHV:KLFK 

1HHG$QVZHUVµ,Q(IIHFWLYH0DWKHPDWLFV7HDFKLQJYRO,HGLWHGE\'$*URXZVDQG7- 

&RRQH\+LOOVGDOH1-(UOEDXPSS 

 

6KHLQJROGDQG0+DGOH\$FFRPSOLVKHG7HDFKHUV,QWHJUDWLQJ&RPSXWHUVLQWR&ODVVURRP3UDFWLFH 

1HZ

$SSHQGL[$ 

'DWD&ROOHFWLRQ$SSURDFKDQG5HVSRQVH 

5DWHV 

 

7KLV DSSHQGL[ GHVFULEHV WKH VWXG\·V DSSURDFK IRU GDWD FROOHFWLRQ DQG FODVVURRP 

REVHUYDWLRQV,WDOVRSURYLGHVPRUHGHWDLODERXWUHVSRQVHUDWHVDQGLVVXHVZLWKVRPH 

RIWKHGDWD 

 

7KH VWXG\·V GDWD FROOHFWLRQ EHJDQ ZKHQ WHDFKHUV ZHUH UDQGRPO\ DVVLJQHG ZKLFK 

JHQHUDWHG WKH LQLWLDO OLVWLQJ RI WHDFKHUV DQG XOWLPDWHO\ WKH OLVWLQJ RI VWXGHQWV WR WHVW DQG 

FODVVURRPVWRREVHUYH1RWDOOVWXGHQWVLQWHDFKHUFODVVURRPVZHUHWHVWHG7KHWZRFULWHULD 

IRUWHVWLQJVWXGHQWVLQWKHIDOOZHUHWKDWSDUHQWDOFRQVHQWZDVUHFHLYHGDQGWKDWVWXGHQWVGLG 

QRWKDYHEDUULHUVWRWHVWLQJGLVDELOLW\RUODQJXDJHLVVXHV7KHVSULQJWHVWLQFOXGHGVWXGHQWV 

ZKRKDGEHHQWHVWHGLQWKHIDOODVZHOODVVWXGHQWVZKRKDGHQWHUHGVWXG\FODVVURRPVDIWHU 

WKHIDOOWHVWZDVDGPLQLVWHUHG7KHVWXG\DWWHPSWHGWRFROOHFWUHFRUGVIRUDOOVWXGHQWVLQWKH 

VSULQJWHVWLQJVDPSOH 

$ 7HDFKHU6DPSOH 

7KHVWXG\UHFUXLWHGVFKRROVLQVFKRROGLVWULFWV2QHGLVWULFWGURSSHGRXWEHIRUH 

WKH VWDUW RI WKH VFKRRO \HDU DIWHU WHDFKHU UDQGRP DVVLJQPHQW KDG EHHQ FRQGXFWHG DQG 

DQRWKHUGLVWULFWGURSSHGRXWDIWHUWKHIDOOWHVWKDGEHHQFRQGXFWHGEHFDXVHWKHWHFKQRORJ\ 

SURGXFWGLGQRWZRUNFRUUHFWO\ 

)LJXUH$VKRZVWKHIORZRIWHDFKHUVLQWRWKHVWXG\2IWKHWHDFKHUFRQVHQWIRUPV 

UHFHLYHGILYHWHDFKHUVZHUHH[FOXGHGEHIRUHUDQGRPDVVLJQPHQWEHFDXVHWKHLUVFKRROVKDG 

QRWUHFUXLWHGDQDGHTXDWHQXPEHURIWHDFKHUVDPLQLPXPRIWZRWHDFKHUVLQHDFKJUDGHZDV 

QHHGHGIRUUDQGRPDVVLJQPHQW7KHUHPDLQLQJWHDFKHUVZHUHUDQGRPO\DVVLJQHG2GGV 

RI DVVLJQPHQW WR XVH D SURGXFW YDULHG GHSHQGLQJ RQ KRZ PDQ\ WHDFKHUV LQ D VFKRRO 

FRQVHQWHG ,Q VFKRROV ZLWK DQ HYHQ QXPEHU RI WHDFKHUV WKH RGGV ZHUH ,Q VFKRROV 

ZLWKDQRGGQXPEHURIWHDFKHUVFRQVHQWLQJWKHRGGVIDYRUHGWKHWUHDWPHQWJURXSE\RQH 

WZRWRRQHLIWKUHHWHDFKHUVFRQVHQWHGWKUHHWRWZRLIILYHWHDFKHUVFRQVHQWHGDQGIRXUWR 

WKUHHLIVHYHQWHDFKHUVFRQVHQWHGIHZVFKRROVKDGPRUHWKDQVHYHQWHDFKHUVFRQVHQWLQJ

82 

$IWHULQLWLDOUDQGRPDVVLJQPHQWKDGEHHQFRQGXFWHGWHDFKHUVZHUHH[FOXGHGIURP 

WKH VWXG\ IRU YDULRXV UHDVRQV ZKLFK LV VKRZQ LQ )LJXUH $ 7KH PRVW FRPPRQ UHDVRQ 

DSSO\LQJWRWHDFKHUVZDVWKDWWHDFKHUVUHFHLYHGQHZWHDFKLQJDVVLJQPHQWVRUOHIWWKHLU 

VFKRROV IRU RWKHU SRVLWLRQV $QRWKHU WHDFKHUV ZHUH H[FOXGHG EHFDXVH WKHLU GLVWULFWV 

GHFLGHG QRW WR SDUWLFLSDWH $WWULWLRQ DOVR VRPHWLPHV UHVXOWHG LQ IHZHU WKDQ WZR VDPSOHG 

WHDFKHUVLQDVFKRRODQGWKHVHVFKRROVZHUHGURSSHGWHDFKHUV)RXUWHDFKHUVGHFOLQHGWR 

SDUWLFLSDWHDIWHUUDQGRPDVVLJQPHQWZDVFRQGXFWHGWKUHHLQWKHWUHDWPHQWJURXSDQGRQHLQ 

WKH FRQWURO JURXS $V WKH ILJXUH VKRZV WUHDWPHQW DQG FRQWURO VWDWXV KDG UHODWLYHO\ OLWWOH 

HIIHFWRQWHDFKHUVEHLQJH[FOXGHGIURPWKHVWXG\7DEOH$VKRZVILQDOFRXQWVRIWHDFKHUV 

LQWKHVDPSOHE\JUDGHOHYHODQGDVVLJQPHQWVWDWXV 

)LJXUH$)ORZRI7HDFKHUV7KURXJK6WXG\ 

 

 

1XPEHURI7HDFKHUV5DQGRPL]HG 

 

Q 

 

$OORFDWHGWR7UHDWPHQW*URXS 

Q 

 

 

$OORFDWHGWR&RQWURO*URXS 

Q 

 

 

3DUWLFLSDWHGLQ6WXG\Q 

 

'LG1RW3DUWLFLSDWHLQ6WXG\Q 

 

1RWWHDFKLQJJUDGHRUVXEMHFWQ 

 

'LVWULFWGURSSHGQ 

6FKRROGURSSHGQ 

 

5HIXVHGQ 

0RYHGQ 

 

 

 

 

 

7DEOH $ 1XPEHU RI 7HDFKHUV 3DUWLFLSDWLQJ E\ *UDGH /HYHO DQG 5DQGRP 

$VVLJQPHQW6WDWXV6FKRRO

83 

% 7HDFKHU6XUYH\ 

,Q1RYHPEHUWHDFKHUTXHVWLRQQDLUHVZHUHPDLOHGWRVFKRROVDQGDVHFRQGPDLOLQJ 

ZDVVHQWLQ'HFHPEHUWRWHDFKHUVDWWKHLUKRPHDGGUHVVHV$GGLWLRQDOSURPSWVWRFRPSOHWH 

WKH TXHVWLRQQDLUH LQFOXGHG HPDLOV DQG WHOHSKRQHPHVVDJHV DGGLWLRQDO PDLOLQJV DV QHHGHG 

DQGWHOHSKRQHLQWHUYLHZVWKURXJK0DUFK8OWLPDWHO\SHUFHQWRIWHDFKHUVFRPSOHWHG 

D TXHVWLRQQDLUH &RPSOHWLRQ UDWHV UDQJHG IURP SHUFHQW RI IRXUWK JUDGH WHDFKHUV WR 

SHUFHQWRIILUVWJUDGHWHDFKHUV7DEOH$ 

7DEOH$7RWDO1XPEHURI7HDFKHUVLQWKH6WXG\DQGWKH1XPEHUDQG3HUFHQW 

&RPSOHWLQJWKH7HDFKHU6XUYH\6FKRRO

84 

 

7DEOH$1XPEHUDQG3HUFHQWRI(OLJLEOH6WXGHQWVE\7\SHRI&RQVHQW6FKRRO

85 

 

7DEOH$1XPEHUDQG3HUFHQWRI(OLJLEOH6WXGHQW6DPSOHE\$VVLJQPHQW*URXSDQG 

*UDGH6FKRRO

86 

7DEOH$1XPEHURI6WXGHQWVDQG3HUFHQW7HVWHGLQ)DOODQG6SULQJ6FKRRO

87 

 

 

 

7DEOH$1XPEHURI6WXGHQWV7HVWHG,Q%RWK)DOODQG6SULQJ 

 

1XPEHU 3HUFHQW 

 

$OO 

 

)LUVW*UDGH6$7 

 

)LUVW*UDGH72:5( 

 

)RXUWK*UDGH6$7 

 

6L[WK*UDGH6$7 

 

$OJHEUD(76 

 

 

 

,PSXWLQJ0LVVLQJ'DWD 

 

6RPHGDWDZHUHPLVVLQJEHFDXVHVWXGHQWVGLGQRWWDNHDOOWHVWVRUVXEWHVWVVWXGHQWVGLG 

QRW WDNH WKH 72:5( DIWHU WDNLQJ WKH 6(6$7 RU YLFH YHUVD RU VFKRRO GLVWULFWV GLG QRW 

SURYLGHUHFRUGV7KHODUJHVWQXPEHURIPLVVLQJWHVWVDQGVXEWHVWVRFFXUUHGLQILUVWJUDGH,Q 

VRPH GLVWULFWV WKH ILUVW JUDGH WHVW ZDV DGPLQLVWHUHG RQ WZR DGMRLQLQJ GD\V EHFDXVH RI LWV 

OHQJWKDQGVWXGHQWVEHLQJDEVHQWRQHLWKHUGD\DIIHFWHGZKHWKHUVRPHSDUWVRIWKHWHVWZHUH 

PLVVLQJ 

&RPSRQHQWV RI WKH WHVW VFRUHV DQG VWXGHQW DJH DQG JHQGHU ZHUH LPSXWHG XVLQJ WKH 

0DUNRY&KDLQ0RQWH&DUOR0&0&PHWKRGLQ6$67KHLPSXWDWLRQZDVGRQHILYHWLPHV 

VHSDUDWHO\ IRU VWXGHQWV LQ WUHDWPHQW DQG FRQWURO FODVVURRPV 7KH PHWKRG ZDV WHVWHG E\ 

PDNLQJVXEWHVWVFRUHVIRUUDQGRPVDPSOHVRIVWXGHQWV´PLVVLQJµDQGH[DPLQLQJFRUUHODWLRQV 

EHWZHHQLPSXWHGVFRUHVDQGDFWXDOVFRUHV7KHFRUUHODWLRQVZHUHKLJKLQWKHUDQJHRI 

SHUFHQWWRSHUFHQWIRUGLIIHUHQWVDPSOHVLQGLFDWLQJWKDWWKH0&0&PHWKRGZDVLPSXWLQJ 

VFRUHVWKDWZHUHFORVHWRWKHDFWXDOVFRUHV7KH+/0HVWLPDWLRQDQGRWKHUVWDWLVWLFDO 

SURFHGXUHV XVHG WKH ILYH LPSXWHG GDWD VHWV DQG FDOFXODWHG YDULDQFHV RI WKH HVWLPDWHV WKDW 

LQFRUSRUDWHGWKHDGGHGYDULDQFHIURPWKHLPSXWDWLRQ7KHLQFUHDVHLQYDULDQFHVDVVRFLDWHG 

ZLWKWKHLPSXWDWLRQUDQJHGIURPOHVVWKDQSHUFHQWIRUPDQ\LWHPVWRSHUFHQWIRUDJHRI 

ILUVWJUDGHVWXGHQWV7KHUHZHUHIHZHUPLVVLQJGDWDLWHPVLQIRXUWKDQGVL[WKJUDGHVDQGWKH 

FRUUHVSRQGLQJLQFUHDVHVLQYDULDQFHVIURPLPSXWDWLRQZHUHVPDOOHU1RPLVVLQJGDWDZHUH 

LPSXWHGIRUDOJHEUD 

6FKRRO5HFRUGV 

7KH VWXG\ FROOHFWHG VWXGHQW UHFRUGV GDWD IURP ILOHV SUHSDUHG E\ GLVWULFWV RU E\ 

DEVWUDFWLQJGDWDIURPSDSHUILOHV5HFRUGVGDWDFROOHFWLRQEHJDQLQODWHVSULQJ7KHGDWD 

LWHPV RQ WKH UHFRUGV IRUP LQFOXGHG DWWHQGDQFH OLPLWHG (QJOLVK SURILFLHQF\ VH[ DJH 

HOLJLELOLW\ IRU IUHH RU UHGXFHGSULFH OXQFK SURJUDP GLVDELOLWLHV VSHFLDO HGXFDWLRQ SODQV RU 

VHUYLFHVJUDGHSURPRWLRQDQGUHWHQWLRQJUDGHVDQGVWDQGDUGL]HGWHVWVFRUHVDGPLQLVWHUHG 

GXULQJ WKH DQG VFKRRO \HDUV 7KH VWXG\ REWDLQHG GDWD IURP VWXGHQW 

UHFRUGVIRUSHUFHQWRIVWXGHQWVZKRZHUHHOLJLEOHIRUWKHIDOORUVSULQJWHVWLQJQRWVKRZQ 

LQ WDEOHV 5HVSRQVH UDWHV UDQJHG IURP SHUFHQW IRU ILUVW JUDGHUV WR SHUFHQW IRU 

VL[WKJUDGHUV 

$SSHQGL[$'DWD&ROOHFWLRQ$SSURDFKDQG5HVSRQVH5DWHVÃ

88 

&ODVVURRP2EVHUYDWLRQV 

7KHVWXG\WHDPXVHGLPSOHPHQWDWLRQPRGHOVSUHYLRXVUHVHDUFKDQGRWKHULQVWUXPHQWV 

WRGHVLJQDFODVVURRPREVHUYDWLRQSURWRFRO7KHGUDIWZDVWHVWHGZLWKVHOHFWHGSURGXFWVLQ 

VSULQJDQGYLGHRWDSHGH[DPSOHVRISURGXFWXVHZHUHJDWKHUHGDQGODWHUXVHGGXULQJ 

WUDLQLQJRIREVHUYHUV 

 

7R HQVXUH WKH YDOLGLW\ DQG UHOLDELOLW\ RI WKH REVHUYDWLRQ SURWRFRO D FRGLQJJXLGH ZDV 

GHYHORSHG DORQJ ZLWK VXSSOHPHQWDU\ PDWHULDOV WR KHOS RULHQW UHVHDUFKHUV WR WKH SURGXFWV 

GXULQJWUDLQLQJ7KHJXLGHLQFOXGHGGHILQLWLRQVDQGH[DPSOHVRIHDFKFRGHDQGDOVRVSHFLILHG 

ZKHQREVHUYDWLRQVZHUHWREHPDGH7KHWUDLQLQJIRFXVHGRQSUHSDULQJREVHUYHUVWRFRGH 

UHVSRQVHVDFFXUDWHO\DQGUHOLDEO\'LUHFWLQVWUXFWLRQLQWKHXVHRIWKHSURWRFROVZDVSURYLGHG 

DQGDQFKRUHGZLWKYLGHRH[DPSOHV2EVHUYHUVZDWFKHGDQDQFKRUYLGHRRIDUHDOFODVVURRP 

XVLQJ VRIWZDUH DQG GLVFXVVHG KRZ WKH\ ZRXOG FRGH WKH LQWHUDFWLRQ GHSLFWHG LQ WKH YLGHR 

$GGLWLRQDOYLGHRWDSHVHJPHQWVIXQFWLRQHGDVUHOLDELOLW\WHVWVIRUREVHUYHUV2EVHUYHUVZLWK 

DJUHHPHQW VFRUHV RI OHVV WKDQ SHUFHQW ZLWK H[SHUW FRGHUV ZHUH H[FOXGHG IURP WKH 

REVHUYHUSRRO7KUHHWUDLQHHVZHUHH[FOXGHGRQWKLVEDVLV 

 

2EVHUYDWLRQRIFODVVURRPVRFFXUUHGDWWKUHHSRLQWVGXULQJWKHVFKRRO\HDUDQGIRFXVHG 

RQ D FODVV SHULRG GXULQJ ZKLFK SURGXFWV ZHUH EHLQJ XVHG WUHDWPHQW FODVVURRPV RU WKH 

HTXLYDOHQW FODVV SHULRG FRQWURO FODVVURRPV 7KH REVHUYDWLRQ SURWRFRO FDOOHG IRU 

REVHUYDWLRQDOGDWDWREHUHFRUGHGDWILYHSRLQWVGXULQJDPLQXWHSHULRG7KHSURWRFROKDG 

WKUHHVHFWLRQVVWXGHQWDFWLYLWLHVSURGXFWXVHDQGJHQHUDOREVHUYDWLRQV2EVHUYHUVUHFRUGHG 

WKH QXPEHU RI VWXGHQW DFWLYLWLHV WDNLQJ SODFH WKH W\SH RI DFWLYLW\ WKH WHDFKHU·V UROH WKH 

SHUFHQWRIVWXGHQWVZKRZHUHRIIWDVNDQGWKHQXPEHURIVWXGHQWVXVLQJWKHSURGXFW 

2EVHUYHUVFRGHGGDWDDERXWSURGXFWXVHIRUDPLQXWHSHULRGLQFOXGLQJWHDFKHUUROHVLQ 

PRWLYDWLQJDQGKHOSLQJVWXGHQWVZKRZHUHXVLQJSURGXFWVDQGZKHWKHUWHDFKHUVRUVWXGHQWV 

KDGWHFKQLFDOGLIILFXOWLHVZLWKKDUGZDUHRUVRIWZDUH7KHJHQHUDOREVHUYDWLRQVHFWLRQFRYHUHG 

WKH HQWLUH FODVV SHULRG DQG REVHUYHUV UHFRUGHG LQIRUPDWLRQ DERXW WKH DPRXQW RI WLPH 

VWXGHQWVXVHGWKHSURGXFWLILWZDVXVHGZKHUHWKHSURGXFWZDVXVHGDQGZKHWKHURWKHU 

SURGXFWVZHUHXVHG 

7R DVVHVV UHOLDELOLW\ RI WKH REVHUYDWLRQ SURWRFRO LQ WKH ILHOG LQ D VDPSOH RI GLVWULFWV 

ZKHUH WKHUH ZHUH WZR RU PRUH REVHUYHUV UHVHDUFKHUV FRQGXFWHG DW OHDVW RQH UHOLDELOLW\ 

REVHUYDWLRQ ZLWK WZR REVHUYHUV FRGLQJ WKH VDPH WLPH VHJPHQW LQ WKH VDPH FODVVURRP $ 

WRWDO RI UHOLDELOLW\ REVHUYDWLRQV ZHUH FRPSOHWHG DFURVV WKH WKUHH VLWH YLVLWV 7KH 

REVHUYDWLRQ FRGHV IURP WKH REVHUYHU SDLUV ZHUH WKHQ XVHG WRDVVHVV DJUHHPHQW UDWHV 7KH 

RYHUDOODJUHHPHQWUDWHSHUIHFWDJUHHPHQWDFURVVREVHUYDWLRQYDULDEOHVZDVSHUFHQW 

 

7KH WHDFKHU LQWHUYLHZ SURWRFROV ZHUH GHVLJQHG WR JDWKHU LQGHSWK GDWD RQ SURGXFW 

LPSOHPHQWDWLRQDQGFRQWH[WVRIXVH7KHFRUHHOHPHQWVLQFOXGHGWLPHVSHQWRQFXUULFXOXP 

DQGLQVWUXFWLRQDFFHVVDQGIUHTXHQF\RIXVHXVHDVWKHFRUHFXUULFXOXPRUDVDVXSSOHPHQW 

IUHTXHQF\ DQG GXUDWLRQ RI XVH JURXSLQJ VWUDWHJLHV IRU WKH SURGXFW PDQDJLQJ LQVWUXFWLRQ 

ZLWKWHFKQRORJ\FRXUVHZDUHWHDFKHUWUDLQLQJDQGVXSSRUWDQGVDWLVIDFWLRQZLWKWKHXVHRI 

WKH VRIWZDUH 6HSDUDWH SURWRFROV ZHUH GHYHORSHG IRU PDWK DQG UHDGLQJ IRU WUHDWPHQW DQG 

FRQWUROFRQGLWLRQVDQGIRUHDFKVFKRROYLVLWDQGWLPHRI\HDU7KHFRQWHQWRIWKHLQWHUYLHZV 

ZDVGHULYHGIURPWKHVWXG\·VFRQFHSWXDOIUDPHZRUNEDVHGRQSULRUUHVHDUFKLQWKHDUHDRI 

WHFKQRORJ\ LPSOHPHQWDWLRQ DQG IURP YHQGRU LPSOHPHQWDWLRQ PRGHOV 7KH FRQFHSWXDO 

$SSHQGL[$'DWD&ROOHFWLRQ$SSURDFKDQG5HVSRQVH5DWHV

89 

IUDPHZRUNXVHGWKHPRGHORILQVWUXFWLRQGHYHORSHGE\&RKHQDQG%DOOHODERUDWLQJ 

WKDWPRGHOZLWKLPSOHPHQWDWLRQLVVXHVIURPWKHHGXFDWLRQDOWHFKQRORJ\OLWHUDWXUHVXFKDV 

RQJRLQJ VXSSRUWV IRU WHDFKHU XVH RI WHFKQRORJ\ ORFDWLRQ DQG DPRXQW RI WHFKQRORJ\ XVH 

FODVVURRP PDQDJHPHQW DQG WHFKQRORJ\ GLIILFXOWLHV H[SHULHQFHG 7KH YHQGRU 

LPSOHPHQWDWLRQ PRGHOV ZHUH REWDLQHG WKURXJK UHYLHZ RI YHQGRU OLWHUDWXUH DQG IURP 

LQIRUPDWLRQ SURYLGHG LQ YHQGRU SUHVHQWDWLRQV WR WKH UHVHDUFK WHDP VXSSOHPHQWHG ZLWK 

IROORZXSTXHVWLRQVDVQHHGHGWRREWDLQDIXOOVHWRILPSOHPHQWDWLRQUHFRPPHQGDWLRQVIRU 

HYHU\SURGXFW 

,QWKHLQWHUYLHZSURWRFROHDFKTXHVWLRQLWHPZDVIROORZHGE\DOLVWRISRVVLEOHWHDFKHU 

UHVSRQVHV)RUVRPHLWHPVDQ´RWKHUµFDWHJRU\ZDVLQFOXGHGZLWKVSDFHWRUHFRUGUHVSRQVHV 

WKDWZHUHQRWRQHRIWKHUHVSRQVHRSWLRQV$IWHUHDFKUHVSRQVHLQWHUYLHZHUVZHUHLQVWUXFWHG 

WR FRGH WKH UHVSRQVH WKDW EHVW PDWFKHG WKH WHDFKHU·V UHVSRQVH ,Q WKH HYHQW WKDW DQ 

LQWHUYLHZHUZDVQRWFOHDUKRZDUHVSRQVHVKRXOGEHFRGHGLQWHUYLHZHUVZHUHLQVWUXFWHGWR 

DVNWKHWHDFKHUZKLFKRIWKHUHVSRQVHFDWHJRULHVEHVWILWWKHWHDFKHU·VH[SHULHQFH6HSDUDWH 

SURWRFROVZHUHGHYHORSHGIRUPDWKDQGUHDGLQJIRUWUHDWPHQWDQGFRQWUROFRQGLWLRQVDQG 

IRUHDFKVFKRROYLVLWDQGWLPHRI\HDU7KHGXUDWLRQRIWKHLQWHUYLHZZDVW\SLFDOO\PLQXWHV 

IRU WUHDWPHQW WHDFKHUV DQG PLQXWHV IRU FRQWURO WHDFKHUV GHSHQGLQJ RQ ZKHWKHU WKH 

FRQWURO WHDFKHU ZDV XVLQJ D VRIWZDUH SURGXFW 'UDIW LQWHUYLHZ SURWRFROV ZHUH SLORWHG LQ 

VSULQJZLWKIRXUGLIIHUHQWWHDFKHUVDQGREVHUYHUVZHUHWUDLQHGXVLQJWKHSURWRFROVLQ 

VXPPHU 

3URFHVVLQJRI2EVHUYDWLRQDQG,QWHUYLHZ'DWD 

 

0RQLWRULQJ DQG SURFHVVLQJ RI REVHUYDWLRQ GDWD ZHUH VXSSRUWHG E\ D ZHEEDVHG GDWD 

FROOHFWLRQPRQLWRULQJV\VWHPDQGDQHOHFWURQLFVFDQQLQJV\VWHPIRUGDWDHQWU\2EVHUYDWLRQ 

DQGLQWHUYLHZIRUPVKDGDSUHSULQWHGODEHOZLWKDQLGHQWLILFDWLRQEDUFRGHWKDWLGHQWLILHGWKH 

VLWHYLVLWRUW\SHRIIRUPVFKRROFODVVURRPDQGSODFHLQWKHGDWDFROOHFWLRQVHTXHQFHILUVW 

VHFRQG RU WKLUG YLVLW )RUPV ZHUH LQVSHFWHG IRU FRPSOHWHQHVV DQG FOHDQHG WR HQVXUH 

DFFXUDWHUHDGLQJE\WKHHOHFWURQLFVFDQQHU$IWHUIRUPVKDGSDVVHGWKHLQLWLDOTXDOLW\FRQWURO 

FKHFNWKH\ZHUHVFDQQHGLQWRWKHPRQLWRULQJV\VWHP'DWDHQWU\IRUWKHIRUPVDQGFRGHG 

UHVSRQVH LWHPV IRU WHDFKHU LQWHUYLHZV ZDV SHUIRUPHG XVLQJ DQ HOHFWURQLF VFDQQLQJ DQG 

DUFKLYLQJV\VWHP)RUPVWKDWKDGEHHQFOHDQHGDQGDSSURYHGIRUVFDQQLQJZHUHVFDQQHGLQWR 

WKHHOHFWURQLFVFDQQLQJV\VWHPDQGGDWDUHFRUGVZHUHIRUPDWWHGIRULPSRUWLQJWRDQDQDO\VLV 

ILOH7RYHULI\WKDWWKHHUURUUDWHRIWKHVFDQQLQJSURFHVVZDVOHVVWKDQSHUFHQWHDFKZHHN 

GXULQJ WKH GDWD FROOHFWLRQ ZLQGRZV SHUFHQW RIIRUPV ZHUH UDQGRPO\ VHOHFWHGDQG 

SHUFHQWYHULILHGE\FRPSDULQJHQWHUHGYDOXHVZLWKWKHRULJLQDOKDUGFRS\IRUPV 

2EVHUYDWLRQDQG,QWHUYLHZ&RQVWUXFWV 

 

2QHLWHPZDVFRQVWUXFWHGIURPWKHREVHUYDWLRQGDWDDQGWZRZHUHFRQVWUXFWHGIURP 

WHDFKHULQWHUYLHZGDWDIRUDQDO\VLVSXUSRVHV7KH´/RFDWLRQRI8VHµYDULDEOHZDVFRGHGDV 

IRUXVHLQDUHJXODUFODVVURRPDQGIRUXVHLQDODEOLEUDU\RURWKHUVLWH7KH´'LIILFXOWLHV 

ZLWK $FFHVV WR 3URGXFWµ YDULDEOH ZDV FUHDWHG WR PHDVXUH WKH H[WHQW WR ZKLFK WHDFKHUV 

H[SHULHQFHGGLIILFXOWLHVJDLQLQJDFFHVVWRWKHSURGXFWRUILQGLQJHQRXJKWLPHIRUVWXGHQWVWR 

XVH LW DV SODQQHG EHFDXVH RI WHFKQLFDO SUREOHPV ZLWK WKH VFKRRO QHWZRUN VWXGHQWV EHLQJ 

SXOOHGRXWRIFODVVWRUHFHLYHVSHFLDOVHUYLFHVVFKHGXOLQJFRQIOLFWVZLWKXVHRIFRPSXWHUODE 

$SSHQGL[$'DWD&ROOHFWLRQ$SSURDFKDQG5HVSRQVH5DWHVÃ

90 

RU RWKHU UHDVRQV 7HDFKHUV ZHUH DVNHG ZKHWKHU WKH\ H[SHULHQFHG GLIILFXOWLHV ´JHWWLQJ 

VWXGHQWVHQRXJKWLPHRUDFFHVVRQWKHDVVLJQHGSURGXFWµ5HVSRQVHVZHUHFRGHGDV´\HVµRU 

´QRµDQGWHDFKHUVZHUHDOVRDVNHGWRGHVFULEHWKHQDWXUHRIWKHGLIILFXOW\7KHVFDOHXVHG 

DYHUDJHG UHVSRQVHV IURP WKH ILUVW WZR YLVLWV UHVXOWLQJ LQ D VFDOH ZLWK D UDQJH IURP QR 

GLIILFXOWLHVH[SHULHQFHGSULRUWRHLWKHUYLVLWWRGLIILFXOWLHVH[SHULHQFHGSULRUWRHDFKYLVLW 

ZKLFKZHUHPXOWLSOLHGE\WRPDNHWKHYDOXHDQDORJRXVWRDSHUFHQWDJH7KH´$GHTXDF\ 

RI6XSSRUWHG7LPHµYDULDEOHZDVFUHDWHGIURPDQLQWHUYLHZLWHPDERXWZKHWKHUWHDFKHUVIHOW 

WKHUHZDVHQRXJK´VXSSRUWHGµRUSDLGWLPHWRSUHSDUHWRXVHWKHSURGXFW ´VXSSRUWHG 

WLPHQRWHQRXJKµWR ´VXSSRUWHGWLPHZDVDGHTXDWHµ7KHTXHVWLRQVZHUHDVNHGGXULQJ 

WKHWKLUGYLVLWDIWHUWHDFKHUVDOUHDG\KDGRSSRUWXQLWLHVWRDVVHVVKRZPXFKWLPHWKH\QHHGHG 

WRSUHSDUHWRXVHSURGXFWV 

'HVFULSWLYH'DWD 

7DEOHV$DGVKRZPHDQVDQGVWDQGDUGGHYLDWLRQVIRUDOOGDWDLWHPVXVHGLQWKH 

HVWLPDWLRQ PRGHOV %RWK IDOO DQG VSULQJ RYHUDOO VFRUHV DQG VXEWHVW VFRUHV DUH LQFOXGHG 

VWDQGDUG GHYLDWLRQV RI WKH FRQWURO JURXS VSULQJ WHVW VFRUH DUH WKH EDVLV RI HIIHFW VL]H 

FDOFXODWLRQV LQ WKH WH[W 6RPH GDWD LWHPV DUH GHILQHG IRU RQO\ WUHDWPHQW FODVVURRPV DQG 

VFKRROFKDUDFWHULVWLFVDUHWKHVDPHIRUWUHDWPHQWDQGFRQWUROFODVVURRPV 

 


91 

7$%/($D 

 

'HVFULSWLYH6WDWLVWLFVRI9DULDEOHV8VHGLQ(VWLPDWLQJ(IIHFWV)LUVW*UDGH 

0HDQVDQG6WDQGDUG'HYLDWLRQV 

 

'HVFULSWLYH 7UHDWPHQW*URXS &RQWURO*URXS Ã 

 

)HPDOHSHUFHQW 

 

$JHDVRI2FWREHU\HDUV 

6WXGHQWV 

 

 

 

 

 

)DOOVFRUHRQ6WDQIRUG(DUO\6FKRRO$FKLHYHPHQW7HVW1&( 

 

6RXQGVDQGOHWWHUV 

 

 

 

6HQWHQFHUHDGLQJ 

 

:RUGUHDGLQJ 

 

7RWDO 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

6SULQJVFRUHRQ6WDQIRUG$FKLHYHPHQW7HVW1&( 

 

6RXQGVDQGOHWWHUV 

 

 

 

6HQWHQFHUHDGLQJ 

 

:RUGUHDGLQJ 

 

7RWDO 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

)DOOVFRUHRQ7HVWRI:RUG5HDGLQJ(IILFLHQF\ 

 

3KRQHPLFGHFRGLQJ 

 

6LJKWZRUG 

 

7RWDOZRUGUHDGLQJ 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 


92 

$SSHQGL[$'DWD&ROOHFWLRQ$SSURDFKDQG5HVSRQVH5DWHV 

7DEOH$D 

 


 

6SULQJVFRUHRQ7HVWRI:RUG5HDGLQJ(IILFLHQF\ 

 

3KRQHPLFGHFRGLQJHIILFLHQF\ 

 

 

 

 

 

 

6LJKWZRUGHIILFLHQF\ 

 

 

 

 

 

 

7RWDOZRUGUHDGLQJHIILFLHQF\ 

 

 

 

 

 

7HDFKHUV 

 

)HPDOHSHUFHQW 

 

 

 

 

 

 

7HDFKLQJH[SHULHQFH\HDUV 

 

 

 

 

 

 

0DVWHU·VGHJUHHSHUFHQW 

 

 

 

 

 

 

7LPHVSHQWXVLQJRWKHUSURGXFWVKRXUVD\HDU 

 

 

 

 

 

 

7LPHVSHQWXVLQJVWXG\SURGXFWVKRXUVD\HDU 

 

 

 

QD 

 

6WXG\SURGXFWXVHGLQWKHFODVVURRPSHUFHQW 

 

 

 

QD 

 

$FFHVVSUREOHPVVFDOHIURPWR 

 

 

 

QD 

 

$GHTXDWHDPRXQWRISUHSDUDWLRQVXSSRUWWLPHSHUFHQW 

 

 

 

QD 

 

6FKRROKDVRQVLWHFRPSXWHUVSHFLDOLVWSHUFHQW 

 

 

 

QD 

 

3DUWLFLSDWHGLQWHFKQRORJ\SURIHVVLRQDOGHYHORSPHQWODVWVFKRRO\HDU 

SHUFHQW 

 

 

QD 

6FKRROV 

 

6WXGHQWVUHFHLYLQJIUHHUHGXFHGSULFHOXQFKSHUFHQW 

 

 

 

 

6WXGHQWWHDFKHUUDWLR 

 

 

 

 

%ODFNVWXGHQWVSHUFHQW

93 

7DEOH$D 

'HVFULSWLYH 

 

+LVSDQLFVWXGHQWVSHUFHQW 

 

+DV,(3SHUFHQW 

 

,QXUEDQDUHDSHUFHQW 

 

 

 

 

 

 

 

 

 

 

 

 


94 


7DEOH$E 

 

'HVFULSWLYH6WDWLVWLFVRI9DULDEOHV8VHGLQ(VWLPDWLQJ(IIHFWV)RXUWK*UDGH 


 


6WXGHQWV 

 

)HPDOHSHUFHQW 

 

 

 

 

 

 


 

 

 

 

 

 

)DOOVFRUHRQ6WDQIRUG$FKLHYHPHQW7HVW1&( 

 

5HDGLQJFRPSUHKHQVLRQ 

 

 

 

 

 

 

5HDGLQJYRFDEXODU\ 

 

 

 

 

 

 

:RUNVWXG\VNLOOV 

 

 

 

 

 

 

7RWDO 

 

 

 

 

 

 


 

5HDGLQJFRPSUHKHQVLRQ 

 

 

 

 

 

 

5HDGLQJYRFDEXODU\ 

 

 

 

 

 

 

:RUNVWXG\VNLOOV 

 

 

 

 

 

 

7RWDO 

 

 

 

 

 

7HDFKHUV 

 

)HPDOHSHUFHQW 

 

 

 

 

 

 


 

 

 

 

 

 


 

 

 

 

 

 

7LPHVSHQWXVLQJRWKHUSURGXFWVKRXUVD\HDU

95 

7DEOH$E 


 

7LPHXVLQJVWXG\SURGXFWVKRXUVD\HDU 

 


 


 


 


 

3DUWLFLSDWHG LQ WHFKQRORJ\ SURIHVVLRQDO GHYHORSPHQW ODVW VFKRRO 

\HDUSHUFHQW 

6FKRROV 

 


 


 

%ODFNVWXGHQWVSHUFHQW 

 


 

+DV,(3SHUFHQW 

 


 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

QD 

QD 

QD 

QD 

QD 

QD 


96 


7$%/($F 

 

'HVFULSWLYH6WDWLVWLFVRI9DULDEOHV8VHGLQ(VWLPDWLQJ(IIHFWV6L[WK*UDGH 


 


6WXGHQWV 

 

)HPDOHSHUFHQW 

 

 

 

 

 

 


 

 

 

 

 

 

)DOOVFRUHRQ6WDQIRUG$FKLHYHPHQW7HVW1&( 

 

3URFHGXUHV 

 

 

 

 

 

 

3UREOHPVROYLQJ 

 

 

 

 

 

 

7RWDO 

 

 

 

 

 

 


 

3URFHGXUHV 

 

 

 

 

 

 

3UREOHPVROYLQJ 

 

 

 

 

 

 

7RWDO 

 

 

 

 

 

7HDFKHUV 

 

)HPDOHSHUFHQW 

 

 

 

 

 

 


 

 

 

 

 

 


 

 

 

 

 

 

7LPHVSHQWXVLQJRWKHUSURGXFWVKRXUVD\HDU 

 

 

 

 

 

 


 

 

 

QD 

 


 

 

 

QD

97 



 


 

 

 

QD 

 


 

 

 

QD 

 


 

 

 

QD 

 


SHUFHQW 

 

 

 

QD 

6FKRROV 

 


 

 

 

 


 

 

 

 


 

 

 

 


 

 

 

 

+DV,(3SHUFHQW 

 

 

 

 


 

 

 

 

7DEOH$F

98 


7$%/($G 

 

'HVFULSWLYH6WDWLVWLFVRI9DULDEOHV8VHGLQ(VWLPDWLQJ(IIHFWV$OJHEUD 


 


6WXGHQWV 

 

)HPDOHSHUFHQW 

 

 

 

 

 

 


 

 

 

 

 

 

)DOOVFRUHRQ(76$OJHEUD7HVWSHUFHQWFRUUHFW 

 

7RWDO 

 

 

 

 

 

 

&RQFHSWV 

 

 

 

 

 

 

3URFHVVHV 

 

 

 

 

 

 

6NLOOV 

 

 

 

 

 

 

6SULQJVFRUHRQ(76$OJHEUD7HVWSHUFHQWFRUUHFW 

 

7RWDO 

 

 

 

 

 

 

&RQFHSWV 

 

 

 

 

 

 

3URFHVVHV 

 

 

 

 

 

 

 

6NLOOV 

 

 

 

 

7HDFKHUV 

 

)HPDOHSHUFHQW 

 

 

 

 

 

 


 

 

 

 

 

 


 

 

 

 

 

 

7LPHVSHQWXVLQJRWKHUSURGXFWVKRXUVD\HDU

99 



 


 

 

 

QD 

 


 

 

 

QD 

 


 

 

 

QD 

 


 

 

 

QD 

 


 

 

 

QD 

 


SHUFHQW 

 

 

 

QD 

6FKRROV 

 


 

 

 

 


 

 

 

 


 

 

 

 


 

 

 

 

+DV,(3SHUFHQW 

 

 

 

 


 

 

 

 

7DEOH$G

$SSHQGL[% 

 

(VWLPDWLQJ(IIHFWVDQG 

$VVHVVLQJ5REXVWQHVV 

$ (VWLPDWLQJ3URGXFW(IIHFWV 

)RU WKH VWXG\ YROXQWHHULQJ WHDFKHUV LQ HDFK VFKRRO ZHUH UDQGRPO\DVVLJQHG HLWKHU WR 

LPSOHPHQWDVRIWZDUHSURGXFWWUHDWPHQWWHDFKHUVRUQRWWRLPSOHPHQWLWFRQWUROWHDFKHUV 

5DQGRPDVVLJQPHQWRIWHDFKHUVPHDQVWKDWWKHSURGXFW·VHIIHFWRQVWXGHQWDFKLHYHPHQWFDQ 

EH HVWLPDWHG E\FRPSDULQJ DFKLHYHPHQW RI WUHDWPHQW DQG FRQWURO FODVVURRPV 7KH QHVWHG 

VWUXFWXUH RI WKH VDPSOH ZDV DFNQRZOHGJHG E\ HVWLPDWLQJ HIIHFWV XVLQJ KLHUDUFKLFDO OLQHDU 

PRGHOV 2WKHU DQDO\VHV DOVR XVHG KLHUDUFKLFDO PRGHOV ZKHQ WKH GDWD ZHUH FOXVWHUHG E\ 

FODVVURRPRUVFKRRO 

$7KUHH/HYHO+LHUDUFKLFDO/LQHDU0RGHOIRU(VWLPDWLQJ0DLQ(IIHFWV 

 

7KH VLPSOHVW HVWLPDWRU RI SURGXFW HIIHFWV LV WKH GLIIHUHQFH RI WKH DYHUDJH VSULQJ WHVW 

VFRUHV LQ WUHDWPHQW DQG FRQWURO FODVVURRPV 7KH H[SHULPHQWDO GHVLJQ HQVXUHV WKDW WKH 

SUHVHQFHRIWKHSURGXFWLQWUHDWPHQWFODVVURRPVLVWKHRQO\GLIIHUHQFHLQWKHWZRW\SHVRI 

FODVVURRPV RQ DYHUDJH DQG WKHUHIRUH DFKLHYHPHQW GLIIHUHQFHV FDQ EH DWWULEXWHG WR WKH 

HIIHFWVRIWKHSURGXFW 

 

+RZHYHU WKH VLPSOH HVWLPDWRU LV EDVHG RQ WKH QXPEHU RI FODVVURRPV LQ WKH VWXG\ 

ZKLFK OLPLWV LWV VWDWLVWLFDO SRZHU IRU H[SORULQJ UHODWLRQVKLSV EHWZHHQ SURGXFW HIIHFWV DQG 

PRGHUDWLQJYDULDEOHV$PRGHOEDVHGRQWKHQXPEHURIVWXGHQWVDOORZVWKHVWXG\WRLQFUHDVH 

LWV VWDWLVWLFDO SRZHU DQG HVWLPDWH UHODWLRQVKLSV RI HIIHFWV DQG PRGHUDWLQJ YDULDEOHV PRUH 

SUHFLVHO\ 

 

7KHVLPSOHWKUHHOHYHOKLHUDUFKLFDOOLQHDUPRGHOXVHGIRUHVWLPDWLQJWKHPDLQHIIHFWVKDV 

VWXGHQWFODVVURRPDQGVFKRROFRPSRQHQWV 

$6WXGHQW Yijk = α0 

jk 

+ πXijk + εijk 

 

$&ODVVURRP α0 jk 

= β0k + β1Tjk + ϕ Wjk + µ 

j 

 

$6FKRRO β0k = δ0 + δ1Zk + νk

ZKHUH

7DEOH % 0DLQ (IIHFWV +LHUDUFKLFDO /LQHDU 0RGHO (VWLPDWHV 2XWFRPH LV 6SULQJ 7HVW 6FRUH ZLWK 6WDQGDUG (UURUV LQ 

3DUHQWKHVHV 

Ã 

9DULDEOHÃ1DPHÃ )LUVWÃ*UDGH D ÃÃ )RXUWKÃ*UDGHÃÃ 6L[WKÃ*UDGHÃÃ $OJHEUDÃÃ 

6WXGHQW/HYHO Ã Ã Ã Ã 

,QWHUFHSWÃ Ã Ã Ã Ã 

ÃÃ Ã Ã Ã Ã 

6WXGHQWÃLVÃIHPDOHÃ Ã Ã Ã Ã 


6WXGHQWÃDJHÃ Ã Ã Ã Ã 


)DOOÃWHVWÃVFRUHV D Ã Ã Ã Ã Ã 


ÃÃ Ã Ã Ã ÃÃ 

ÃÃ Ã Ã Ã ÃÃ 

ÃÃ Ã Ã ÃÃ ÃÃ 

ÃÃ Ã Ã ÃÃ ÃÃ 

ÃÃ Ã ÃÃ ÃÃ ÃÃ 

ÃÃ Ã ÃÃ ÃÃ ÃÃ 

&ODVVURRP/HYHO 

7UHDWPHQWÃFODVVURRPÃ Ã Ã Ã Ã 


7HDFKHUÃLVÃIHPDOHÃ Ã Ã Ã Ã 


DIWHU DGMXVWLQJ IRU FRYDULDWHV RFFXUV DW WKH FODVVURRP OHYHO DQG SHUFHQW RFFXUV DW WKH 

VFKRROOHYHO7KHUHPDLQLQJSHUFHQWRIVFRUHYDULDQFHRFFXUVDWWKHVWXGHQWOHYHO$WRWKHU 

JUDGHOHYHOVFODVVURRPDQGVFKRROYDULDQFHVDOVRDUHFRQVLGHUDEOHZLWKFODVVURRPYDULDQFH 

WKH ODUJHU RI WKH WZR 7KH WUHDWPHQW HIIHFWV UHSRUWHG LQ WKH WH[W UHIHU WR WKH HVWLPDWHG 

FRHIILFLHQWVRIWKH´WUHDWPHQWFODVVURRPµLQGLFDWRUYDULDEOHDWWKHWHDFKHUOHYHO)RUH[DPSOH 

WKHHVWLPDWHRIIRUWKHWUHDWPHQWHIIHFWLQWKHFROXPQIRUILUVWJUDGHLVWKHVDPHDVLV 

VKRZQLQ7DEOH,,DVWKHGLIIHUHQFHEHWZHHQWUHDWPHQWDQGFRQWUROJURXSDYHUDJHVFRUHV 

7KHSYDOXHVKRZQLQ7DEOH,,LVWKHSYDOXHRIWKHHVWLPDWHGWUHDWPHQWFRHIILFLHQW 

% (VWLPDWLQJ0RGHUDWLQJ5HODWLRQVKLSV 

7KH KLHUDUFKLFDO PRGHO VXSSRUWV HVWLPDWLQJ UHODWLRQVKLSV EHWZHHQ RYHUDOO SURGXFW 

HIIHFWVDQGFODVVURRPDQGVFKRROFKDUDFWHULVWLFV,QWKHPDLQHIIHFWVPRGHODERYHFODVVURRP 

DQG VFKRRO FKDUDFWHULVWLFV DUH SUHGLFWRUV RI VWXGHQW DFKLHYHPHQW 6RPH RU DOO RI WKHVH 

FKDUDFWHULVWLFVDOVRPD\PRGHUDWHSURGXFWHIIHFWV 

 

7R DOORZ IRU PRGHUDWLQJ YDULDEOHV WKH PRGHO LV PRGLILHG E\ DGGLQJ LQWHUDFWLRQV 

EHWZHHQWKHWUHDWPHQWLQGLFDWRUDQGFODVVURRPFKDUDFWHULVWLFVWRHTXDWLRQ$ 

 

$ &ODVVURRP,QWHUDFWLRQV αojk = β0k + β1kTjk + β2kTjkΦ jk 

+ ϕ Wjk + µ 

jk 

 

 

7KHSURGXFWHIIHFWLQHTXDWLRQ$ DOVRKDVEHHQPRGLILHGE\DGGLQJDVFKRROVXEVFULSWWR 

LWVHVWLPDWRU7KHVHWRIYDULDEOHVLQGLFDWHGE\ Φ FDQLQFOXGHWKHYDULDEOHVLQWKHVHW:EXW 

DOVR FDQ LQFOXGH RWKHU FODVVURRP YDULDEOHV VXFK DV LPSOHPHQWDWLRQ YDULDEOHV 7KH VFKRRO 

VXEVFULSW LV DGGHG WR VXSSRUW WKH VHFRQG PRGLILFDWLRQ RI DGGLQJ DQ HTXDWLRQ WKDW DOORZV 

VFKRROFKDUDFWHULVWLFVWRPRGHUDWHWKHSURGXFWHIIHFW 

 

$6FKRRO,QWHUDFWLRQV β1k = γ0 + γ1Zk + τk 

 

 

&RPELQLQJWKHHTXDWLRQVDQGFROOHFWLQJWHUPV\LHOGVDPL[HGPRGHOHVWLPDWLQJHTXDWLRQLQ 

ZKLFKWKHSURGXFWHIIHFWLVUHODWHGWRFODVVURRPDQGVFKRROFRQGLWLRQV 

 

$0L[HG0RGHOZLWK,QWHUDFWLRQV@ 

 

 

’ 

Y = δ + [ γ + γ Z + β W ] T + [ δ Z + ϕW + πX 

] + ξ 

ijk 0 0 1 k 2 jk jk 1 k jk ijk ijk 

 

ZKHUHWKHHUURUWHUPKDVWKHVWUXFWXUH 

 

’ 

ξijk = ν 

kTjk + µ 

jk 

+ εijk 

 

 

 

7KHHVWLPDWRU·VVWUXFWXUHLQ$KDVWZRFRPSRQHQWVVKRZQLQVTXDUHEUDFNHWV7KH 

ILUVW LV WKH SURGXFW HIIHFW ZKLFK LV UHODWHG WR VFKRRO FKDUDFWHULVWLFV = DQG FODVVURRP 

FKDUDFWHULVWLFV:7KHVHFRQGLVWKHHIIHFWRIVWXGHQWFODVVURRPDQGVFKRROFKDUDFWHULVWLFV 


6WDWLVWLFDOO\ VLJQLILFDQW HVWLPDWHV RI WKH VHW RI FRHIILFLHQWV UHSUHVHQWHG E\ DQG DUH 

 

HYLGHQFHRIPRGHUDWLQJUHODWLRQVKLSVEHWZHHQFKDUDFWHULVWLFVDQGWKHSURGXFWHIIHFW 

 

7KH PL[HG PRGHO ZLWK LQWHUDFWLRQV LV RQH RI PDQ\ NLQGV RI LQWHUDFWLRQ PRGHOV ,Q 

SULQFLSOH DOO ORZHUOHYHO FRHIILFLHQWV LQ KLHUDUFKLFDO OLQHDU PRGHOV FDQ EH PRGHOHG DV 

IXQFWLRQV RI IDFWRUV DW KLJKHU OHYHOV +RZHYHU WKH FRPSOH[LW\ RI WKH UHVXOWLQJ HVWLPDWHV 

PDNHVLQWHUSUHWDWLRQGLIILFXOWDQGVLPSOLI\LQJDVVXPSWLRQVDUHQHHGHGWRUHGXFHFRPSOH[LW\ 

DQGPDNHLQWHUSUHWDWLRQVFOHDUHU 

 

,QSDUWLFXODUWKHVWXG\PDGHWZRVLPSOLI\LQJDVVXPSWLRQV2QHLVWKDWVWXGHQW 

FKDUDFWHULVWLFV DIIHFW DFKLHYHPHQW GLUHFWO\ WKHVH UHODWLRQVKLSV DUH UHSUHVHQWHG E\ WKH 

π FRHIILFLHQWV LQ WKH PRGHO EXW WKDW WKHVH FRHIILFLHQWV GR QRW LQWHUDFW ZLWK FODVVURRP 

FKDUDFWHULVWLFV6WDWHGDQRWKHUZD\FODVVURRPFKDUDFWHULVWLFVDIIHFWDOOVWXGHQWVLQWKHFODVV 

VLPLODUO\7KHSUDFWLFDOLPSOLFDWLRQRIWKHDVVXPSWLRQLVWKDWWKHPRGHOGRHVQRWDOORZIRU 

H[DPSOHWKDWDFKLHYHPHQWRIPDOHVWXGHQWVPD\GHSHQGRQWKHJHQGHURIWKHWHDFKHURUWKDW 

ORZDFKLHYLQJVWXGHQWVIDUHEHWWHUZLWKWHDFKHUVZKRKDYHPRUHH[SHULHQFH 

 

7KHVHFRQGVLPSOLI\LQJDVVXPSWLRQLVWKDWWKHPDJQLWXGHRIWKHLQWHUDFWLRQVEHWZHHQ 

WKHSURGXFWHIIHFWDQGFODVVURRPFKDUDFWHULVWLFVLVQRWUHODWHGWRVFKRROFKDUDFWHULVWLFVWKHUH 

DUH QR KLJKHUOHYHO HTXDWLRQV IRU WKH β 2 

FRHIILFLHQWV 7KH SUDFWLFDO LPSOLFDWLRQ RI WKH 

DVVXPSWLRQLVWKDWWKHSURGXFWHIIHFWPD\EHUHODWHGWRZKHWKHUDFODVVURRPKDVKLJKRUORZ 

DYHUDJHVWXGHQWDFKLHYHPHQWIRUH[DPSOHEXWWKHPDJQLWXGHRIWKHUHODWLRQVKLSLVQRWLQ 

WXUQUHODWHGWRVFKRROFKDUDFWHULVWLFVVXFKDVSRYHUW\OHYHO 

 

$ XVHIXO IHDWXUH RI WKH LQWHUDFWLRQ PRGHO $ LV WKDW LW HVWLPDWHV PRGHUDWLQJ 

UHODWLRQVKLSVIRUHDFKFKDUDFWHULVWLFWKDWRIWHQLVXVHGWRFUHDWHVXEJURXSVZKLOHDGMXVWLQJ 

IRUPRGHUDWLQJUHODWLRQVKLSVZLWKRWKHUFKDUDFWHULVWLFV)RUH[DPSOHWKHPRGHUDWLQJHIIHFW 

RIVFKRROSRYHUW\LVHVWLPDWHGDIWHUDGMXVWLQJIRUWKHPRGHUDWLQJHIIHFWRIWKHVFKRRO·VUDFLDO 

DQGHWKQLFFRPSRVLWLRQRIVWXGHQWV7KHHVWLPDWHVFDQEHXQGHUVWRRGDVWKHHIIHFWRIHDFK 

FKDUDFWHULVWLFKROGLQJRWKHUFKDUDFWHULVWLFVFRQVWDQW 

 

+RZHYHUWKHPRGHO·VDELOLW\WRHVWLPDWHWKHVHUHODWLRQVKLSVGHSHQGVRQWKHGHJUHHRI 

YDULDELOLW\LQWKHGDWD,IWKHGDWDLQFOXGHRQO\VFKRROVWKDWDUHERWKKLJKSRYHUW\DQGZLWK 

PDQ\PLQRULW\VWXGHQWVLQRWKHUZRUGVLIWKHWZRFKDUDFWHULVWLFVDUHKLJKO\FRUUHODWHGWKH 

PRGHO PD\ EH XQDEOH WR VHSDUDWH WKH FKDUDFWHULVWLFV DQG WKH UHVXOW PD\ EH VWDWLVWLFDOO\ 

LQVLJQLILFDQW FRHIILFLHQWV IRU SRYHUW\ DQG IRU PLQRULW\ UHSUHVHQWDWLRQ 3DUWLFXODUO\ IRU WKH 

VL[WK JUDGH DQG DOJHEUD VWXGLHV ZKLFK KDYH IHZHU VFKRROV WKDQ WKH ILUVW JUDGH DQG IRXUWK 

JUDGH UHDGLQJ VWXGLHV WKH DPRXQW RI YDULDWLRQ LQ WKH GDWD LV D FRQVWUDLQW RQ HVWLPDWLQJ 

PRGHUDWLQJUHODWLRQVKLSV 

7DEOH % VKRZV HVWLPDWHV IURP WKH IXOO PRGHO IRU WKH RYHUDOO VFRUH 7KH IXOO VHW RI 

HVWLPDWHV VKRZQ LQ WKH WH[W LQFOXGHV PRGHUDWLQJ UHODWLRQVKLSV ZLWK VXEWHVW VFRUHV DV WKH 

RXWFRPHEXWWKHVWUXFWXUHRIWKHPRGHOVLVWKHVDPH7KHIXOOLQWHUDFWLRQVPRGHOKDVPDQ\ 

SDUDPHWHUVPRUHWKDQDQGWKHWZRHTXDWLRQVDWWKHWKLUGOHYHODGGWRLWVFRPSOH[LW\7KH 

WDEOHVKRZVWKHHVWLPDWHGFRHIILFLHQWVLQILYHJURXSLQJVWKUHHDUHHVWLPDWHVFRUUHVSRQGLQJWR 

WKH PDLQ PRGHO VKRZQ LQ 7DEOH % DQG WZR DUH HVWLPDWHV FRUUHVSRQGLQJ WR WKH 

PRGHUDWLQJ YDULDEOHV RQH DW WKH FODVVURRP OHYHO DQG RQH DW WKH VFKRRO OHYHO 1RW DOO 


PRGHUDWLQJYDULDEOHVFRXOGEHLQFOXGHGIRUWKHPDWKJUDGHOHYHOV7KHPRGHOVSURYHGWREH 

QXPHULFDOO\XQVWDEOHZKHQWKHIXOOVHWRIYDULDEOHVZDVHQWHUHGSUREDEO\EHFDXVHWKHUHZHUH 

UHODWLYHO\IHZVFKRROVDQGQRWHQRXJKYDULDELOLW\LQWKHGDWDWRHVWLPDWHWKHODUJHQXPEHURI 

PRGHUDWRUV 

7KHWKLUGJURXSRIFRHIILFLHQWVODEHOHG´&ODVVURRPOHYHOLQWHUDFWLRQVZLWKWUHDWPHQWµ 

FRUUHVSRQGV WR WKH VHW RI YDULDEOHV Φ LQHTXDWLRQ$ DERYH 7KH VHW RI WHDFKHU 

FKDUDFWHULVWLFV:LVDXJPHQWHGE\DVHWRILPSOHPHQWDWLRQPHDVXUHVLQFOXGLQJWKHDPRXQW 

RI WLPH SURGXFWV ZHUH XVHG ZKHWKHU WHDFKHUV KDG SUREOHPV JDLQLQJ DFFHVV WR FRPSXWHUV 

DQG ZKHWKHU FODVVHV KDG WHFKQLFDO GLIILFXOWLHV GXULQJ REVHUYDWLRQV 3RVLWLYH VLJQV RI WKH 

HVWLPDWHG FRHIILFLHQWV LQGLFDWH WKDW WKH SURGXFW HIIHFW ZDV ODUJHU ZKHQ WKH YDULDEOH KDG D 

ODUJHU YDOXH KROGLQJ RWKHU YDULDEOHV FRQVWDQW )RU H[DPSOH WKH SRVLWLYH FRHIILFLHQW IRU 

´

7DEOH%(VWLPDWHVRI0RGHUDWLQJ5HODWLRQVKLSV)URP+LHUDUFKLFDO/LQHDU0RGHO2XWFRPHLV6SULQJ7HVW 

6FRUHZLWKVWDQGDUGHUURUV 

 

9DULDEOH1DPH )LUVW*UDGH )RXUWK*UDGH 6L[WK*UDGH $OJHEUD 

6WXGHQW/HYHO 

6WXGHQWLVIHPDOH 

 

 

6WXGHQWDJH 

 

 

)DOOWHVWVFRUHV D 

 

 

 

 

 

 

 

&ODVVURRP/HYHO 

7HDFKHULVIHPDOH 

 

 

7DEOH%FRQWLQXHG 

 

9DULDEOH1DPH )LUVW*UDGH )RXUWK*UDGH 6L[WK*UDGH $OJHEUD 

6FKRRO/HYHO 

,QWHUFHSW 

 

 

3HUFHQWRIVWXGHQWVHOLJLEOHIRUIUHHOXQFK 

 

 

6WXGHQWWHDFKHUUDWLR 

 

 

3HUFHQWRI%ODFNVWXGHQWV 

 

 

3HUFHQWRI+LVSDQLFVWXGHQWV 

 

 

3HUFHQWRIVWXGHQWVLQVSHFLDOHGXFDWLRQ 

 

 

6FKRROLVLQXUEDQDUHD 

 

6FKRRO/HYHO7UHDWPHQW(TXDWLRQ ÃÃ ÃÃ ÃÃ ÃÃ 

,QWHUFHSW 

 

 

3HUFHQWRIVWXGHQWVHOLJLEOHIRUIUHHOXQFK 

 

 

6WXGHQWWHDFKHUUDWLR 

 

 

3HUFHQWRI%ODFNVWXGHQWV 

 

 

3HUFHQWRI+LVSDQLFVWXGHQWV 

 

 

3HUFHQWRIVWXGHQWVLQVSHFLDOHGXFDWLRQ 

 

 

6FKRROLVLQXUEDQDUHD 

 

9DULDQFH&KDUDFWHULVWLFV ÃÃ ÃÃ ÃÃ ÃÃ 

6WXGHQWOHYHO 

7HDFKHUOHYHO 

6FKRROOHYHO 

 

 

D 

)RU IDOO WHVW VFRUH VXEWHVW VFRUHV DUH HQWHUHG VHSDUDWHO\ )RU ILUVW JUDGH WKH IRXU IDOO VFRUHV DUH WKH WKUHH 6(6$7 

VXEVFRUHVVRXQGVDQGOHWWHUVZRUGUHDGLQJDQGVHQWHQFHUHDGLQJDQGWKHWRWDOIDOO72:5(VFRUH)RUIRXUWKJUDGH 

WKHWKUHHVXEVFRUHVDUHHQWHUHGYRFDEXODU\ZRUGVWXG\VNLOOVDQGFRPSUHKHQVLRQ)RUVL[WKJUDGHWKHWZRVXEVFRUHV 

DUHHQWHUHGSURFHGXUHVDQGSUREOHPVROYLQJ)RUDOJHEUDWKHWRWDOIDOOVFRUHLVHQWHUHG 


VFRUH GDWD WKDW FRXOG VXSSRUW VHSDUDWH HVWLPDWHV HVSHFLDOO\ IRU ILUVW JUDGHUV WHVWLQJ ILUVW 

JUDGHUV LV UHODWLYHO\ XQFRPPRQ DQG KLJK VFKRRO VWXGHQWV GLVWULFWV· WHVWLQJ GHSHQGV RQ 

VWXGHQWJUDGHOHYHOV 

2WKHU(VWLPDWRUV 

 

7DEOH%VKRZVHVWLPDWHVIRURYHUDOOVFRUHVLQWKHIRXUJUDGHOHYHOVIRUIRXUHVWLPDWRUV 

DQGWKHVWXG\·VPDLQHVWLPDWRUSUHVHQWHGLQWKHWH[W7KHILUVWHVWLPDWRUWHUPHGWKH´QDwYH 

GLIIHUHQFHµ LV WKH DYHUDJH VSULQJ VFRUH IRU VWXGHQWV LQ WUHDWPHQW FODVVURRPV PLQXV WKH 

DYHUDJHVSULQJVFRUHIRUVWXGHQWVLQFRQWUROFODVVURRPV7KHHVWLPDWRULVVWUDLJKWIRUZDUGWR 

FDOFXODWH DQG KDV DQ LQWXLWLYH LQWHUSUHWDWLRQ +RZHYHU LW GRHV QRW FRUUHFWO\ HVWLPDWH 

YDULDQFHVZKHQVWXGHQWVDUHQHVWHGLQFODVVURRPV 

 

 

7DEOH%$OWHUQDWLYH(VWLPDWRUVRI3URGXFW(IIHFWVRQ2YHUDOO7HVW6FRUH 

6WDQGDUG(UURUVRIWKH(VWLPDWHG(IIHFWVLQ3DUHQWKHVHV 

 

 

)LUVW 

*UDGH 

)RXUWK 

*UDGH 

6L[WK 

*UDGH 

 

6$7 

5HDGLQJ 

6FRUH 

1&( 

6$7 

5HDGLQJ 

6FRUH 

1&( 

6$7 

0DWK 

6FRUH 

1&( 

(VWLPDWRU 

 

1DwYHGLIIHUHQFHRIVWXGHQWDYHUDJH 

VFRUHV 

 

$OJHEUD 

(76 

$OJHEUD 

([DP 

3HUFHQW 

&RUUHFW 

 

 

 

'LIIHUHQFHRIFODVVURRPDYHUDJHVFRUHV 

 

 

'LIIHUHQFHRIFODVVURRPGLIIHUHQFHV 

 

 

5HSHDWHGFURVVVHFWLRQ+/0 

 

 

3DQHO+/0UHSRUWHGLQWH[W 

 

6RXUFH $XWKRUFDOFXODWLRQV2WKHUYDULDEOHVLQWKH+/0PRGHOVLQFOXGHVWXGHQWDJHJHQGHUDQGSUHWHVWVFRUHV 

IRU WKH SDQHO WHDFKHU JHQGHU H[SHULHQFH DQG ZKHWKHU WKH\ KDG D PDVWHU·V GHJUHH FODVVURRP DYHUDJH 

SUHWHVWVFRUHIRUWKHFURVVVHFWLRQVFKRROUDFHDQGHWKQLFLW\SHUFHQWRIVWXGHQWVLQVSHFLDOHGXFDWLRQDQG 



7KH VHFRQG HVWLPDWRU LV WKH GLIIHUHQFH EHWZHHQ WUHDWPHQW DQGFRQWURO FODVVURRPV RQ 

WKHVSULQJWHVWVFRUHZLWKVFRUHGLIIHUHQFHVILUVWFDOFXODWHGIRUHDFKVFKRRODQGWKHUHVXOWLQJ 

VFKRROGLIIHUHQFHVWKHQDYHUDJHG7KHVWDQGDUGHUURURIWKHDYHUDJHVFKRROGLIIHUHQFHLVWKH 

HVWLPDWRURIVDPSOLQJYDULDQFH 

7KHWKLUGHVWLPDWRULVWKHSUHYLRXVHVWLPDWRUDGMXVWHGIRUWKHDYHUDJHFODVVURRPVFRUH 

RQWKHIDOOWHVW7KLV´GLIIHUHQFHVRIGLIIHUHQFHVµHVWLPDWRUDOORZVVWXGHQWPRELOLW\WRUHODWH 

WRSURGXFWHIIHFWV,QSULQFLSOHIRUVFKRROVZLWKKLJKPRELOLW\WKHDYHUDJHVWXGHQWVKRXOG 

KDYHOHVVH[SRVXUHWRWKHSURGXFWEHFDXVHVRPHZLOOQRWKDYHDWWHQGHGIRUWKHZKROH\HDU 

3RWHQWLDOSURGXFWHIIHFWVWKHUHE\ZRXOGEHDWWHQXDWHG 

 

7KHIRXUWKHVWLPDWRULVIURPDQ+/0LQZKLFKVSULQJWHVWVFRUHVDUHDIXQFWLRQRIIDOO 

WHVWVFRUHVDQGRWKHUFRYDULDWHV7KHIDOOWHVWVFRUHLVHQWHUHGLQWKHVHFRQGOHYHODVWKH 

DYHUDJHIDOOVFRUHIRUWKHFODVVURRPLQZKLFKWKHVWXGHQWZDVORFDWHGLQWKHVSULQJ%HFDXVH 

WKHPRGHOXVHVVWXGHQWWHVWVFRUHVLQWKHVSULQJDVWKHRXWFRPHEXWFODVVURRPDYHUDJHVFRUHV 

LQWKHIDOODVWKHEDVHOLQHLWGRHVQRWDVVXPHWKHVDPHVWXGHQWVDUHWHVWHGLQWKHIDOODQG 

VSULQJDVGRHVWKH+/0HVWLPDWRULQWKHWH[W7KLVÚHSHDWHGFURVVVHFWLRQVµHVWLPDWRULVD 

YDULDQWRIWKH´GLIIHUHQFHVRIGLIIHUHQFHVµHVWLPDWRU 

 

7DEOH % VKRZV WKDW WKH HVWLPDWRU XVHG GRHV QRW DIIHFW WKH GLUHFWLRQ RI WKH PDLQ 

ILQGLQJV 5HJDUGOHVV RI WKH HVWLPDWRU SURGXFW HIIHFWV DUH VWDWLVWLFDOO\ LQVLJQLILFDQW DQG WKH 

SRLQWHVWLPDWHVDUHVPDOO7KHPDJQLWXGHVRIWKHHVWLPDWHGHIIHFWVGLIIHUKRZHYHUZLWKWKH 

GLIIHUHQFH RI FODVVURRP DYHUDJH SRVWWHVW VFRUHV JHQHUDOO\ EHLQJ WKH VPDOOHVW DQG WKH 

GLIIHUHQFHRIFODVVURRPGLIIHUHQFHVWKHSRVWWHVWPLQXVWKHSUHWHVWWKHODUJHVW 

 

7KHUHODWLRQVKLSRIWKHUHSHDWHGFURVVVHFWLRQ+/0HVWLPDWRUDQGWKH+/0HVWLPDWRU 

XVHGLQWKHWH[WWKHSDQHOHVWLPDWRUGLGQRWDOZD\VKDYHWKHH[SHFWHGGLUHFWLRQ7KH+/0 

HVWLPDWRU LQ WKH WH[W LV EDVHG RQ VWXGHQWV ZKRFRPSOHWHG D IDOO WHVW DQG DVSULQJ WHVW WKH 

FURVVVHFWLRQ+/0LVEDVHGRQWKHODUJHUJURXSRIVWXGHQWVZKRFRPSOHWHGDVSULQJWHVW 

%HFDXVHWKHFURVVVHFWLRQVDPSOHLVOLNHO\WRKDYHORZHUDYHUDJHSURGXFWXVHHVWLPDWHVZHUH 

H[SHFWHGWREHVPDOOHUWKDQWKHSDQHOHVWLPDWHWRWKHH[WHQWWKDWWKHSURGXFWXVHPDWWHUHG 

+RZHYHUIRUWKHILUVWDQGIRXUWKJUDGHUHDGLQJVWXGLHVDQGWKHDOJHEUDVWXG\WKHFURVV 

VHFWLRQHVWLPDWHVDSSHDUWREHODUJHUWKDQWKHSDQHOHVWLPDWHVWKRXJKGLIIHUHQFHVZHUHQRW 

WHVWHGIRUVWDWLVWLFDOVLJQLILFDQFH,WLVGLIILFXOWWRGUDZDQ\FRQFOXVLRQVIURPVPDOOGLIIHUHQFHV 

EHWZHHQVWDWLVWLFDOO\LQVLJQLILFDQWHVWLPDWHVKRZHYHU 

'LVWULFW7HVWVDVWKH2XWFRPH 

 

$QRWKHUDSSURDFKIRUDVVHVVLQJUREXVWQHVVLVWRHVWLPDWHHIIHFWVXVLQJGLVWULFWWHVWVWKDW 

WKHVWXG\FROOHFWHGIURPUHFRUGVDQGFRPSDUHWKHUHVXOWVWRWKRVHXVLQJWKHVWXG\·VWHVWV 

'LVWULFW WHVWV LW FRXOG EH DUJXHG PD\ EH PRUH VDOLHQW WR VFKRROV DQG WHDFKHUV WKDQ WKH 

VWXG\·VWHVWVZKLFKKDYHQRDFFRXQWDELOLW\GLPHQVLRQ'LVWULFWWHVWVDOVRDUHDGPLQLVWHUHGDV 

DIXOOEDWWHU\DQGPD\PHDVXUHUHDGLQJRUPDWKPRUHUHOLDEO\WKDQWKHVKRUWHUWHVWXVHGE\ 

WKHVWXG\ 

 

 


7ZRLPSRUWDQWFDYHDWVIRUWKLVFRPSDULVRQUHODWHWRWHVWDYDLODELOLW\DQGPRGHOLQJVWUDWHJLHV 

'LVWULFWWHVWVZHUHQRWDYDLODEOHLQDOOGLVWULFWVDQGLQSDUWLFXODUZHUHQRWDYDLODEOHIRUPDQ\ 

ILUVWJUDGHUVDQGKLJKVFKRROVWXGHQWVEHFDXVHVWDQGDUGL]HGWHVWLQJLVOHVVFRPPRQLQWKHVH 

JUDGHV$OVRFRQVHFXWLYH\HDUWHVWVDUHQRWDOZD\VDYDLODEOHWRDGMXVWIRUSUHWHVWOHYHOVDQG 

WHVWV WKHPVHOYHV VRPHWLPHV GLIIHU LQ FRQVHFXWLYH \HDUV 8VLQJ GLVWULFW WHVWV DOVR UHTXLUHG D 

GLIIHUHQWHVWLPDWLRQDSSURDFKEHFDXVHUHVXOWVIRUHDFKGLVWULFWKDGWREHHVWLPDWHGVHSDUDWHO\ 

+HUH D WZROHYHO KLHUDUFKLFDO PRGHO LV XVHG EHFDXVH WKH QXPEHU RI VFKRROV LQ DQ\ RQH 

GLVWULFWZDVWRRVPDOOWRVXSSRUWDWKUHHOHYHOPRGHO 

 

7DEOH % VKRZV WKH UHVXOWV RI WKH FRPSDULVRQ H[HUFLVH (VWLPDWHG HIIHFWV ZHUH 

FRQYHUWHGWRHIIHFWVL]HVXVLQJWKHVWDQGDUGGHYLDWLRQRIWKHFRQWUROJURXSVSULQJWHVWVFRUH 

DQGWKHHIIHFWVL]HVZHUHFRPSDUHGWRWKHVWXG\·VUHVXOWV)RUGLVWULFWVWKHVWXG\ZDVDEOH 

WRREWDLQDGLVWULFWWHVWWKDWVXSSRUWHGDQHVWLPDWHRISURGXFWHIIHFWVL]HV%HFDXVHVDPSOH 

VL]HVDUHVPDOOHUWKDQWKHVWXG\·VRYHUDOOVDPSOHVL]HLQWKHJUDGHOHYHOVWKHIRFXVKHUH 

PRVWO\LVRQHIIHFWVL]HVUDWKHUWKDQRQVWDWLVWLFDOVLJQLILFDQFH 

 

7KHUHVXOWVKDYHWKHVDPHVLJQLQRIGLVWULFWV5HVXOWVLQWKHIRXUGLVWULFWVWKDW 

GLIIHUHGLQVLJQVKRZHGDODUJHUHIIHFWVL]HRQWKHGLVWULFWWHVWLQWZRGLVWULFWVDQGVPDOOHU 

HIIHFWVL]HLQWZRGLVWULFWV)RUVRPHGLVWULFWVWKHHIIHFWVL]HLVODUJHUIRUWKHVWXG\WHVWDQG 

IRUVRPHGLVWULFWVLWLVODUJHUIRUWKHGLVWULFWWHVW2YHUDOOWKHVLPSOHDYHUDJHRIHIIHFWVL]HV 

XVLQJGLVWULFWWHVWVLVDQGWKHVLPSOHDYHUDJHRIHIIHFWVL]HVXVLQJWKHVWXG\·VWHVWLV 

VOLJKWO\ODUJHU 

 

7KHILQGLQJVLQ7DEOH%VXSSRUWWKHUREXVWQHVVRIWKHVWXG\·VILQGLQJVEDVHGRQLWV 

WHVW7KRXJKQRWFRQFOXVLYHHYLGHQFHEHFDXVHGLVWULFWWHVWVDUHDYDLODEOHIRUOHVVWKDQKDOIWKH 

GLVWULFWV LQ WKH VWXG\ XVLQJ GLVWULFW WHVWV GR QRW \LHOG TXDOLWDWLYHO\ GLIIHUHQWILQGLQJV DERXW 

SURGXFWHIIHFWV 


7DEOH%&RPSDULVRQRI(IIHFW6L]HV%DVHGRQ'LVWULFW7HVWVDQGWKH 

6WXG\7HVW 

 

*UDGH 

2XWFRPH 

'LVWULFW7HVW 

2XWFRPH 

6WXG\7HVW 

 

)LUVW*UDGH 

$ 

% 

 

)RXUWK*UDGH 

& 

' 

( 

) 

* 

+ 

 

6L[WK*UDGH 

, 

- 

 

/ 

 

$OJHEUD 

0 

1 

 

 

$YHUDJHRI0HDVXUHG 

(IIHFW6L]HV

Effectiveness of Reading and Mathematics Software Products ...

You also want an ePaper? Increase the reach of your titles

Delete template?

Save as template?