02.04.2015 Views

PLEASE SCROLL DOWN FOR ARTICLE - Dhpescu.org

PLEASE SCROLL DOWN FOR ARTICLE - Dhpescu.org

PLEASE SCROLL DOWN FOR ARTICLE - Dhpescu.org

SHOW MORE
SHOW LESS

Create successful ePaper yourself

Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.

This article was downloaded by: [University of Maastricht]<br />

On: 25 November 2008<br />

Access details: Access Details: [subscription number 781062662]<br />

Publisher Informa Healthcare<br />

Informa Ltd Registered in England and Wales Registered Number: 1072954 Registered office: Mortimer House,<br />

37-41 Mortimer Street, London W1T 3JH, UK<br />

Medical Teacher<br />

Publication details, including instructions for authors and subscription information:<br />

http://www.informaworld.com/smpp/title~content=t713438241<br />

Identifying the perceived weaknesses of a new curriculum by means of the<br />

Dundee Ready Education Environment Measure (DREEM) Inventory<br />

Hettie Till a<br />

a<br />

Canadian Memorial Chiropractic College, Toronto, Canada<br />

Online Publication Date: 01 February 2004<br />

To cite this Article Till, Hettie(2004)'Identifying the perceived weaknesses of a new curriculum by means of the Dundee Ready<br />

Education Environment Measure (DREEM) Inventory',Medical Teacher,26:1,39 — 45<br />

To link to this Article: DOI: 10.1080/01421590310001642948<br />

URL: http://dx.doi.<strong>org</strong>/10.1080/01421590310001642948<br />

<strong>PLEASE</strong> <strong>SCROLL</strong> <strong>DOWN</strong> <strong>FOR</strong> <strong>ARTICLE</strong><br />

Full terms and conditions of use: http://www.informaworld.com/terms-and-conditions-of-access.pdf<br />

This article may be used for research, teaching and private study purposes. Any substantial or<br />

systematic reproduction, re-distribution, re-selling, loan or sub-licensing, systematic supply or<br />

distribution in any form to anyone is expressly forbidden.<br />

The publisher does not give any warranty express or implied or make any representation that the contents<br />

will be complete or accurate or up to date. The accuracy of any instructions, formulae and drug doses<br />

should be independently verified with primary sources. The publisher shall not be liable for any loss,<br />

actions, claims, proceedings, demand or costs or damages whatsoever or howsoever caused arising directly<br />

or indirectly in connection with or arising out of the use of this material.


Medical Teacher, Vol. 26, No. 1, 2004, pp. 39–45<br />

Identifying the perceived weaknesses of a new<br />

curriculum by means of the Dundee Ready Education<br />

Environment Measure (DREEM) Inventory<br />

HETTIE TILL<br />

Canadian Memorial Chiropractic College, Toronto, Canada<br />

Downloaded By: [University of Maastricht] At: 18:13 25 November 2008<br />

SUMMARY The Canadian Memorial Chiropractic College is in<br />

the fourth year of implementing a new four-year Integrative<br />

Curriculum. In order to determine how the students experienced the<br />

educational environment generated by the new curriculum, the<br />

Dundee Ready Education Environment (DREEM) Inventory<br />

was administered on the same day to 148 (96%) first-year, 131<br />

(87%) second-year, and 128 (84%) third-year students<br />

(n ¼ 407). Resultant scores indicated many areas of concern.<br />

However, bimodal and large numbers of ‘uncertain’ responses also<br />

occurred. In order to establish and compare areas of most concern<br />

between the three year groups, responses were calculated as<br />

percentages indicating for each item those who agree, disagree or<br />

are uncertain. This result clearly indicated areas of joint concern for<br />

each of the five domains addressed by the DREEM Inventory.<br />

Analysis of these concerns formed the basis of strategic planning<br />

in order to institute remedial action, and on which to focus<br />

institutional resources.<br />

Introduction<br />

Curriculum changes are usually undertaken in order to<br />

improve the whole learning environment for the students.<br />

Yet, the whole process of change, as well as the rate of<br />

change, is inevitably stressful for both students and faculty<br />

(McAleer et al., 1997; Roff et al., 1997). It is thus important<br />

to determine how our students are actually experiencing<br />

the educational environment created by a new curriculum<br />

by asking the question ‘‘What is (medical) education here<br />

really like?’’ (Genn & Harden, 1986).<br />

The Canadian Memorial Chiropractic College (CMCC)<br />

is situated in Toronto, Canada and offers a four-year professional<br />

programme. The majority of the students entering<br />

the programme have at least a bachelor’s degree with 2–3%<br />

per year also having graduate degrees. Until three years ago<br />

the educational programme consisted of three years of basic<br />

and clinical studies with the fourth year being a mix of<br />

didactic and practical teaching as well as an internship, all<br />

based very much on a traditional medical education model.<br />

In September 1999 a new Integrative Curriculum was<br />

introduced with the aim of placing the student’s focus<br />

on chiropractic studies through attempting to make taught<br />

material clinically meaningful from the first day of class.<br />

By December 2001, the first group of students to<br />

experience the new curriculum were halfway through their<br />

third year of study. These third-year students had indicated<br />

through focus-group meetings that they not only perceived<br />

themselves to be ‘guinea pigs’, but also that they were not<br />

satisfied with the third-year curriculum. The focus group<br />

meetings had also indicated that, although they did not<br />

appear seriously unhappy with the curriculum, the first- and<br />

second-year students were beginning to show similar signs<br />

of dissatisfaction with the educational environment, as did<br />

the third-year students. The focus-group messages were<br />

viewed very seriously, as evidence exists indicating that<br />

educational climate influences student behaviour and that<br />

it has a strong effect on student achievement, satisfaction and<br />

success (Pimparyon et al., 2000; Genn, 2001a; Cavanaugh &<br />

Simmons, 1997). The fact that the third-year students’<br />

negative perception of the educational climate was being<br />

echoed by the first- and second-year students was therefore<br />

a source of great concern. The establishment of a healthy<br />

educational climate becomes obvious if one takes note of<br />

the fact that climate has been likened to a mist with the<br />

observation that one could not stay for long in a mist before<br />

becoming thoroughly soaked (Stern, 1970, as cited in Genn<br />

& Harden, 1986).<br />

Steps therefore had to be taken urgently to identify the<br />

elements operating in the educational environment of the<br />

institution, and to evaluate how the students perceive them in<br />

order to provide a basis for modifications that could enhance<br />

the students’ learning experiences in relation to our teaching<br />

goals (Genn, 2001b). We decided to undertake an institutional<br />

climate study and the present research is one part of<br />

a larger multipronged, longitudinal quality assurance study<br />

undertaken at the institution for the purposes of understanding,<br />

and possibly enhancing, the quality of the educational<br />

environment for the students. The purpose of the<br />

research reported here was to attempt to identify the<br />

perceived weaknesses of the new Integrative Curriculum in<br />

order to focus institutional resources on those areas that<br />

would require remedial action.<br />

Method<br />

I selected the Dundee Ready Education Environment<br />

Measure (DREEM) Inventory to measure the educational<br />

climate at CMCC. The DREEM Inventory is a validated<br />

inventory (McAleer et al., 1997; Roff et al., 1997) with proven<br />

high reliability (McAleer et al., 1997; Roff et al., 1997;<br />

Pimparyon et al., 2000; Roff et al., 2001) that has been<br />

used in various countries around the world to assess the<br />

educational climate of health professional/medical schools.<br />

Correspondence: Hettie Till, MSc M.Med.Ed D.Ed, Canadian Memorial<br />

Chiropractic College, 1900 Bayview Avenue, Toronto, Ontario, Canada M4G<br />

3E6. Tel: (416)-482-2340; fax: (416)-488-0470; email: htill@cmcc.ca<br />

ISSN 0142–159X print/ISSN 1466–187X online/03/040039-7 ß 2004 Taylor & Francis Ltd 39<br />

DOI: 10.1080/01421590310001642948


H. Till<br />

Downloaded By: [University of Maastricht] At: 18:13 25 November 2008<br />

The inventory consists of 50 items with each item scored on<br />

a five-point Likert scale with 4 ¼ strongly agree, 3 ¼ agree,<br />

2 ¼ unsure, 1 ¼ disagree and 0 ¼ strongly disagree. Seven<br />

of the items are negative and are thus scored in reverse so<br />

that a higher score indicates a more positive reading. The<br />

Inventory measures five domains or subscales of students’<br />

perceptions of a given institution: (1) students’ perceptions of<br />

learning, (2) students’ perceptions of teachers, (3) students’<br />

academic self-perception, (4) students’ perception of atmosphere,<br />

and (5) students’ social self-perceptions. The scale<br />

allows the user to report a total environment score as well<br />

as scores for the five domains or subscales.<br />

The DREEM Inventory was administered on the same<br />

day at the end of February 2002 to all first-, second- and<br />

third-year students. The fourth-year students were excluded<br />

for the following two reasons. First, they were the last<br />

group of the previous curriculum and had thus not<br />

experienced the new curriculum that was being evaluated.<br />

Second, they were at that time involved in the—mostly—<br />

clinical part of their studies and were scattered among seven<br />

different clinics, only one of which was on campus. Although<br />

it would have been interesting to obtain their perceptions<br />

of the educational environment as part of the longitudinal<br />

quality assurance project planned, it was unfortunately not<br />

possible to get a representative sample from this group at<br />

the time of the study.<br />

Before the students completed the inventory, I addressed<br />

the classes explaining the purpose for collecting the data<br />

as well as the process of data collection, and stressing<br />

the anonymity of the participants and the fact that the data<br />

could not be tracked back to individual participants. I also<br />

explained that the data would be used for quality assurance as<br />

well as for research purposes and requested the students’<br />

cooperation, making it clear that participation would be<br />

entirely on a voluntary basis.<br />

Students marked their responses to the items on a<br />

computer card which was then scanned in order to obtain<br />

responses per item. I also requested them to indicate on<br />

their computer cards their year of study as well as their<br />

gender. By means of the statistical package SPSS, Levene’s<br />

test was used to test for equality of variances, and the<br />

Independent Samples t-test to identify significant differences<br />

between the different year groups as well as between the<br />

male and female students in each group ( < 0.05).<br />

In order to get an overview of students per year of study<br />

that indicated specific problems with each item of the<br />

DREEM Inventory, the percentage of all the students<br />

who had strongly agreed and agreed (yes), those who were<br />

uncertain (neutral), as well as those who strongly disagreed<br />

and disagreed (no) were calculated and compared. Those<br />

items, per domain, where the majority of students indicated<br />

problems, were then extracted and listed.<br />

This study had received prior approval from the Internal<br />

Revue Board of CMCC as complying with the institutional<br />

Research Policy and Procedure manual.<br />

Results<br />

The DREEM Inventory was administered on the same day<br />

to all first-, second- and third-year students and 148 (96%)<br />

first-year, 131 (87%) second-year and 128 (84%) third-year<br />

students (n ¼ 407) returned valid responses. Unfortunately,<br />

not all of the students remembered to indicate their gender<br />

on the computer response forms, but of the 372 (91%) of the<br />

students who did so, 54% were female and 46% male,<br />

compared with the overall gender distribution of undergraduate<br />

students at the time which was about an equal<br />

distribution between male and female.<br />

Table 1 shows the mean DREEM scores per year of study.<br />

The mean total DREEM score was 97/200 and the mean<br />

scores for the five domains were as follows: (1) Perceptions<br />

of learning 19/48; (2) Perceptions of teaching 24/44; (3)<br />

Academic self-perception 15/32; (4) Perceptions of atmosphere<br />

25/48; and (5) Social self-perceptions 15/28. The<br />

results per year indicated large differences between the three<br />

years in the average scores per domain and showed that the<br />

scores decreased considerably from the first year, which<br />

had the best results, to the third-year students, who had the<br />

lowest scores.<br />

Several statistically significant differences were found<br />

between the responses of the three groups. Twenty-eight<br />

items registered as significantly different between the first<br />

and second years’ responses, 37 items between the second<br />

and third years’, and 44 between the first and third years. The<br />

only items where no significant differences were registered<br />

between all three the groups are listed in Table 2.<br />

A similar analysis between male and female students<br />

indicated only three significantly different responses for first<br />

years and four for the third years, while the second-year<br />

group registered 20 such differences between male and<br />

female responses. The first-year female students gave lower<br />

mean responses than the males for all three significantly<br />

different items, and the third-year female students gave<br />

higher mean responses for all four significantly different<br />

items. The second-year female students gave lower mean<br />

responses for six and higher mean responses for 14 of their 20<br />

significantly different items.<br />

Close investigation of the results indicated that bimodal<br />

and large numbers of ‘uncertain’ responses also occurred.<br />

The first-year students, in particular, sometimes gave mixed<br />

messages as indicated in Table 3. Such mixed messages also<br />

contributed to lower scores per item.<br />

Table 4 gives examples of the results obtained after<br />

calculating and comparing, for each of the items, the percentages<br />

of students who had strongly agreed and agreed (yes),<br />

those who were uncertain (neutral), as well as those who<br />

strongly disagreed and disagreed (no). Table 4 indicates, for<br />

example, that for Item 25 the majority of students in all three<br />

years felt that the teaching over-emphasized factual learning.<br />

Similarly 80% of the third years, 66% of the second years and<br />

37% of the first years disagreed with the statement in Item 47<br />

that long-term learning was emphasized over short-term<br />

learning. Tables 5 to 9 show the items per domain where the<br />

majority of the students indicated problems.<br />

Discussion<br />

The students were keen to complete the DREEM Inventory,<br />

as they perceived it as an ideal opportunity to ‘voice’ their<br />

opinions, and the good response rates ensured that we had<br />

access to the views of the majority of our students.<br />

The differences between the three years in the average<br />

scores per domain (Table 1), indicating different perceptions<br />

of the educational environment, were somewhat to be<br />

40


Identifying the weaknesses of a new curriculum<br />

Table 1. Mean DREEM scores per item and year of study.<br />

Downloaded By: [University of Maastricht] At: 18:13 25 November 2008<br />

Item First year Second year Third year<br />

(1) I am encouraged to participate in class 2.3 2.0 1.5<br />

(2) The teachers are knowledgeable 2.8 2.9 2.6<br />

(3) There is a good support system for students who get stressed 1.7 1.3 1.0<br />

(4) I am too tired to enjoy the course 1.3 1.1 0.7<br />

(5) Learning strategies which worked for me before continue to work for me now 2.2 2.0 1.5<br />

(6) The clinicians are patient with patients 2.7 2.7 2.6<br />

(7) The teaching is often stimulating 1.9 1.5 0.9<br />

(8) The teachers ridicule the students 2.8 2.2 2.2<br />

(9) The teachers are authoritarian 2.1 1.7 1.3<br />

(10) I am confident about my passing this year 2.9 2.9 2.6<br />

(11) The atmosphere is relaxed during the clinic teaching 2.6 2.4 1.8<br />

(12) This college is well timetabled 1.6 0.9 0.3<br />

(13) The teaching is student centred 2.0 1.2 0.7<br />

(14) I am rarely bored on this program 1.8 1.4 1.1<br />

(15) I have good friends in this college 3.2 3.3 3.4<br />

(16) The teaching helps me to develop my competence 2.6 2.3 1.4<br />

(17) Cheating is a problem in this college 2.5 2.4 2.4<br />

(18) The clinicians have good communications skills with patients 2.6 2.6 2.5<br />

(19) My social life is good 2.5 2.4 1.9<br />

(20) The teaching is well focused 2.1 1.4 1.1<br />

(21) I feel I am being well prepared for my profession 2.1 1.5 1.3<br />

(22) The teaching helps to develop my confidence 2.3 1.6 1.0<br />

(23) The atmosphere is relaxed during lectures 2.7 2.5 2.2<br />

(24) The teaching time is put to good use 1.8 1.3 0.8<br />

(25) The teaching over-emphasizes factual learning 1.5 1.3 1.1<br />

(26) Last year’s work has been a good preparation for this year’s work 2.1 2.5 1.7<br />

(27) I am able to memorize all I need 1.3 1.5 0.9<br />

(28) I seldom feel lonely 2.5 2.4 2.0<br />

(29) The teachers are good at providing feedback to students 2.0 1.5 0.9<br />

(30) There are opportunities for me to develop interpersonal skills 2.8 2.5 1.9<br />

(31) I have learned a lot about empathy in my profession 2.1 1.9 1.4<br />

(32) The teachers provide constructive criticism here 2.2 1.9 1.2<br />

(33) I feel comfortable in class socially 3.2 3.1 3.0<br />

(34) The atmosphere is relaxed during seminars/tutorials 3.1 2.9 2.8<br />

(35) I find the experience disappointing 2.4 1.7 1.1<br />

(36) I am able to concentrate well 1.8 1.7 1.4<br />

(37) The teachers give clear examples 2.2 2.0 1.5<br />

(38) I am clear about the learning objectives of the program 2.1 1.7 1.4<br />

(39) The teachers get angry in class 2.6 1.7 2.1<br />

(40) The teachers are well prepared for their classes 2.7 2.6 2.1<br />

(41) My problem solving skills are being well developed here 1.9 1.7 1.6<br />

(42) The enjoyment outweighs the stress of the program 1.7 1.5 0.8<br />

(43) The atmosphere motivates me as a learner 1.9 1.4 0.7<br />

(44) The teaching encourages me to be an active learner 2.0 1.6 1.2<br />

(45) Much of what I have to learn seems relevant to a career in chiropractic 2.0 1.5 1.2<br />

(46) My accommodation is pleasant 2.9 3.1 3.1<br />

(47) Long-term learning is emphasized over short-term learning 2.0 1.3 0.8<br />

(48) The teaching is too teacher centred 1.8 1.5 1.0<br />

(49) I feel able to ask the questions I want 2.6 2.3 2.0<br />

(50) The students irritate the teachers 2.0 1.9 1.3<br />

I. Students’ perception of learning 24 19 13<br />

II. Students’ perception of teachers 27 24 20<br />

III. Students’ academic self-perception 17 16 12<br />

IV. Students’ perception of atmosphere 29 25 20<br />

V. Students’ social self-perception 16 15 13<br />

Total 113 98 79<br />

41


H. Till<br />

Table 2. List of DREEM Inventory items where no significant differences registered between the three years of study.<br />

Item Year 1 Year 2 Year 3<br />

6: The clinicians are patient with patients 2.64 2.65 2.60<br />

15: I have good friends in this college 3.05 3.34 3.37<br />

17: Cheating is a problem in this college 2.53 2.40 2.36<br />

18: The clinicians have good communication skills with patients 2.57 2.60 2.45<br />

33: I feel comfortable in class socially 3.14 3.05 3.00<br />

46: My accommodation is pleasant 2.89 3.06 3.07<br />

Total DREEM scores 16.8 17.1 16.9<br />

Table 3. Examples of first-year responses that gave an unclear message of their perceptions of<br />

the educational environment.<br />

Downloaded By: [University of Maastricht] At: 18:13 25 November 2008<br />

Item Options Responses Percentage<br />

There is a good support system<br />

for students who get stressed<br />

expected. However, the low total scores for all three years<br />

were a matter of serious concern. The low scores for all five<br />

domains for the third-year students supported the information<br />

brought forward from the focus-group meetings that the<br />

A. Strongly agree 5 3<br />

B. Agree 12 8<br />

C. Uncertain 75 51<br />

D. Disagree 41 28<br />

E. Strongly disagree 14 9<br />

13. The teaching is teacher centred A. Strongly agree 3 2<br />

B. Agree 60 41<br />

C. Uncertain 33 22<br />

D. Disagree 41 28<br />

E. Strongly disagree 11 7<br />

21. I am being well prepared<br />

for my profession<br />

26. Last year’s work has been a good<br />

preparation for this year’s work<br />

Table 4. Examples of the percentage of students who<br />

agreed, disagreed, or were uncertain about the<br />

different items of the DREEM Inventory.<br />

Item 25: The teaching over-emphasizes factual learning<br />

Year 1 Year 2 Year 3<br />

Yes 53 68 74<br />

Neutral 24 13 7<br />

No 22 19 20<br />

Item 47: Long-term learning is emphasized over short-term<br />

learning<br />

Year 1 Year 2 Year 3<br />

Yes 39 21 10<br />

Neutral 22 13 11<br />

No 37 66 80<br />

A. Strongly agree 6 4<br />

B. Agree 45 30<br />

C. Uncertain 61 41<br />

D. Disagree 31 21<br />

E. Strongly disagree 5 3<br />

A. Strongly agree 4 3<br />

B. Agree 28 19<br />

C. Uncertain 90 61<br />

D. Disagree 11 7<br />

E. Strongly disagree 8 5<br />

third years perceived themselves to be guinea pigs and that<br />

they had found the third-year curriculum to be wanting<br />

in many aspects. The low mean scores from the first- and<br />

second-year students also supported the messages coming<br />

out of the focus-group meetings indicating that the first- and<br />

second-year students were beginning to show similar signs of<br />

dissatisfaction with the educational environment as did the<br />

third years.<br />

Some of the low mean scores of the first-year students<br />

might have been due to the fact that they had only been at the<br />

institution for six months when they were asked to complete<br />

the questionnaire and they had therefore not yet experienced<br />

some parts of the educational environment such as items<br />

relating to the clinic. In some of the areas surveyed by<br />

the DREEM Inventory the first years might thus not have<br />

been too sure of how to respond (Table 3). For example,<br />

51% of the first-year students indicated an ‘uncertain’<br />

response to Item 3, ‘There is a good support system for<br />

students who get stressed’. Although this might simply<br />

mean that the first-year students were not (yet) too stressed<br />

by their studies, this result did contribute to the overall<br />

low score. Similarly for Item 13, ‘The teaching is teacher<br />

42


Identifying the weaknesses of a new curriculum<br />

Downloaded By: [University of Maastricht] At: 18:13 25 November 2008<br />

Table 5. Perceived weaknesses as indicated by the students<br />

in Domain I: Perceptions of Learning a .<br />

All three years of study agreed that:<br />

The teaching over-emphasizes factual learning (53/68/74)<br />

The second and third years (and some first years) agreed that:<br />

The teaching is not student centred (35/71/89)<br />

Teaching time is not put to good use (45/66/85)<br />

The teaching is not stimulating (41/62/83)<br />

The teaching is too teacher centred (40/55/98)<br />

The second and third years agreed that:<br />

The teaching over-emphasizes short-term learning (66/80)<br />

The teaching does not help them to develop confidence (58/79)<br />

The teaching is not well focused (57/78)<br />

The teaching does not encourage active learning (56/68)<br />

Notes: a Figures in parentheses indicate the percentages of<br />

students per year that agreed with the statement. Percentages<br />

are listed in ascending order, i.e. first years, second years, and<br />

third years. Where there are only two figures in the<br />

parentheses, the order is second years and then third years.<br />

Table 6. Perceived weaknesses as indicated by the students<br />

in Domain II: Perceptions of Teachers a .<br />

None that all three years agreed upon<br />

The second and third years (and some of the first years) agreed<br />

that:<br />

The teachers are authoritarian (32/50/62)<br />

The teachers are not good at providing feedback to the students<br />

(43/53/83)<br />

As an added weakness must be seen the fact that in none of the<br />

years more than 50% of the students indicated that:<br />

They get constructive criticism (46/33/11)<br />

They get clear examples (48/37/21)<br />

Notes: a Figures in parentheses indicate the percentages of<br />

students per year that agreed with the statement. Percentages<br />

are listed in ascending order, i.e. first years, second years,<br />

and third years. Where there are only two figures in the<br />

parentheses, the order is second years and then third years.<br />

Table 7. Perceived weaknesses as indicated by the students<br />

in Domain III: Academic Self-perceptions a .<br />

The third-year students perceived every item as negative except<br />

that they were confident about passing the year<br />

All three years of study agreed that:<br />

They are not able to memorize all that they need (67/62/80)<br />

The second and third years agreed that:<br />

They feel that they are not being well prepared for their<br />

profession (55/62)<br />

Much of what they had to learn did not seem relevant to a career<br />

in chiropractic (61/70)<br />

Notes: a Figures in parentheses indicate the percentages of<br />

students per year that agreed with the statement. Percentages<br />

are listed in ascending order, i.e. first years, second years,<br />

third years. Where there are only two figures in the<br />

parentheses, the order is second years and then third years.<br />

Table 8. Perceived weaknesses as indicated by the students<br />

in Domain IV: Perceptions of Atmosphere a .<br />

All three years agreed that:<br />

The institution is not well timetabled (53/79/94)<br />

The second and third years agreed that:<br />

The atmosphere does not motivate them as learners (62/91)<br />

Notes: a Figures in parentheses indicate the percentages of<br />

students per year that agreed with the statement. Percentages<br />

are listed in ascending order, i.e. first years, second years,<br />

and third years. Where there are only two figures in the<br />

parentheses, the order is second years and then third years.<br />

Table 9. Perceived weaknesses as indicated by the students<br />

in Domain V: Social Self-perceptions a .<br />

All three years agreed that:<br />

They are too tired to enjoy the programme (71/75/88)<br />

The second and third years agreed that:<br />

There is not a good support system for students who get stressed<br />

(62/71)<br />

They are sometimes bored with the programme (64/72)<br />

Notes: a Figures in parentheses indicate the percentages of<br />

students per year that agreed with the statement. Percentages<br />

are listed in ascending order, i.e. first years, second years,<br />

and third years. Where there are only two figures in the<br />

parentheses, the order is second years and then third years.<br />

centred’ where only 2% strongly agreed and 41% agreed.<br />

The majority of the first years (57%) therefore did not agree<br />

with the statement. Part of the reason for students (in all<br />

three years) giving an ‘uncertain’ response, or giving a mixed<br />

message for items such as Item 13, can also be attributed<br />

to the fact that pockets of problem areas exist. For example,<br />

not all of the courses were poorly presented, or were too<br />

teacher centred, or poorly planned. Also, although the<br />

Integrative Curriculum was developed to place the student’s<br />

focus on chiropractic studies through attempting to make<br />

taught material clinically meaningful from the first day of<br />

class, it must also be noted that the first year of professional<br />

studies still includes a large proportion of basic sciences.<br />

The first-year students might, therefore, not have been too<br />

sure whether all this information was helping them in<br />

becoming well prepared for their profession. However, the<br />

fact that they were not too sure is possibly an indication<br />

that the material was not presented to them in a format that<br />

made its relevance to their chosen profession very clear.<br />

As far as Item 26 is concerned, ‘Last years’ work has been<br />

a good preparation for this years’ work’, for the majority<br />

of the first-year students their pre-professional studies might<br />

not have been too good a preparation for their first year<br />

of chiropractic studies. Again, that was not surprising as<br />

the students are selected from a variety of educational<br />

backgrounds.<br />

However, the strong message received from all three<br />

years of students required urgent action. What action to take,<br />

in other words how to take the DREEM results and turn<br />

them into a strategic plan, was, however, not so easy.<br />

As this was the first climate study done at this institution by<br />

43


H. Till<br />

Downloaded By: [University of Maastricht] At: 18:13 25 November 2008<br />

means of the DREEM Inventory, there were no previous<br />

results to compare with. The literature also gave no indication<br />

of what institutions do after they get the results of a<br />

climate study. The first-year students’ total DREEM score<br />

of 113/200 was, for example, similar to the 118/200 reported<br />

by Roff et al. (2001) for the Nigerian undergraduate medical<br />

students. However, that paper contrasted the results from<br />

two medical schools and gave no indication of what strategic<br />

plans resulted at the Nigerian medical school in response<br />

to the measurement of their educational climate.<br />

In a further attempt to find usable information, the<br />

mean responses of the three groups were compared to find<br />

statistically significant differences between the years of study.<br />

The results of this comparison indicated large differences in<br />

the responses between the three groups and Table 2 lists<br />

the only six items where no significant differences registered<br />

between the three years of study. The apparent differences<br />

in how the different groups experienced the educational<br />

environment at the institution again supported the different<br />

levels of their experience not only of the institution, but<br />

also of the curriculum. So, not much guidance for the<br />

development of a focused plan of action came from this<br />

exercise. Also, the comparison between male and female<br />

students to find statistically significant differences between<br />

their responses similarly delivered no guidance for the<br />

development of a focused plan of action. Contrary to Roff<br />

et al. (2001), who found that both Nigerian and Nepalese<br />

female students were significantly less pleased with their<br />

educational environments, no such definite pattern could<br />

be determined at CMCC. For example, the female secondyear<br />

students were less satisfied with six aspects of their<br />

programme and more satisfied than the male students with<br />

14 aspects. The first-year female students were significantly<br />

less satisfied with only three aspects of their programme,<br />

whilst the third-year female students were more satisfied<br />

than the males with four aspects of their programme.<br />

Taking all of these facts into consideration, it was felt<br />

that institutional remedial action should rather be based<br />

on the actual number, or percentage, of students per year<br />

of study that indicated specific problems (Tables 5 to 9).<br />

The results obtained from these tables gave a very clear<br />

indication of where the majority of the students perceived<br />

areas of serious concern. Our students were telling us:<br />

that they were stressed;<br />

that they were too tired to enjoy the programme.<br />

This cry from students is, unfortunately, only too common<br />

to medical and many other healthcare professions programmes<br />

due in no small part to the quantity and quality of<br />

information that has to be absorbed during the time of<br />

studies. However, our students were also more specific<br />

in that they requested help with:<br />

the third-year curriculum in particular;<br />

content overload;<br />

not enough active learning;<br />

the perceived clinical relevance of material taught;<br />

the lack of feedback and constructive criticism;<br />

assessment methods that tested mostly recall and<br />

short-term memory (the commonly used multiple-choice<br />

examinations).<br />

Based on this very clear indication from our students, it was<br />

then possible to develop both short-term and long-term<br />

strategic plans to try and enhance the quality of the<br />

educational environment for our students, which will be<br />

addressed in a later paper.<br />

Conclusion<br />

It became clear that the students lost some of the neutrality<br />

that they exhibited in the first year and became more critical<br />

of the educational environment as they progressed through<br />

the programme. The low mean scores, particularly for the<br />

third years, required urgent remedial action and it was found<br />

that the DREEM Inventory was effective as a diagnostic<br />

tool in order to identify areas of most concern. The results<br />

obtained in this study were thus used to guide strategic<br />

planning and the institutional focus of available resources.<br />

In order to manage change successfully, it is necessary to<br />

obtain regular evaluation and feedback as it is only through<br />

the information obtained in this way that alterations can be<br />

made, mistakes corrected and momentum maintained.<br />

Further data received on an annual basis from the planned<br />

longitudinal study using the DREEM Inventory should<br />

thus provide further valuable input for strategic planning<br />

purposes.<br />

Practice points<br />

Climate studies are undertaken in order to determine<br />

how students experience the educational environment<br />

generated by a curriculum.<br />

Institutional remedial action should follow students’<br />

indication of areas of concern.<br />

The DREEM Inventory can be used effectively as a<br />

diagnostic tool in that the results indicate clearly where<br />

the majority of the students perceived areas of serious<br />

concern.<br />

The DREEM Inventory can thus be used to guide<br />

strategic planning and focus institutional resources on<br />

those areas that require remedial action.<br />

Notes on contributor<br />

HETTIE TILL, M.Sc, M.Med.Ed, D.Ed is Professor and Associate Dean,<br />

Undergraduate Studies at the Canadian Memorial Chiropractic<br />

College (CMCC) in Toronto, Canada. She is actively involved in<br />

curriculum development and programme evaluation.<br />

References<br />

CAVANAUGH, S.&SIMMONS, P. (1997) Evaluation of a school climate<br />

instrument for assessing affective objectives in health professional<br />

education, Evaluation and the Health Professions, 20(4), pp. 455–479.<br />

GENN, J.M. & HARDEN, R.M. (1986) What is medical education<br />

here really like? Suggestions for action research studies of climates of<br />

medical education environments, Medical Teacher, 8(2), pp. 111–124.<br />

GENN, J.M. (2001a) AMEE Medical Education Guide No 23 (Part 1):<br />

Curriculum environment, climate, quality and change in medical<br />

education—a unifying perspective, Medical Teacher, 23(4), pp. 337–344.<br />

44


Downloaded By: [University of Maastricht] At: 18:13 25 November 2008<br />

Identifying the weaknesses of a new curriculum<br />

GENN, J.M. (2001b) AMEE Medical Education Guide No 23<br />

(Part 2): Curriculum environment, climate, quality and change in<br />

medical education—a unifying perspective, Medical Teacher, 23(5),<br />

pp. 445–454.<br />

MCALEER, S., ROFF, S., HARDEN, R.M., AL-QAHTANI, M., AHMEN, A.U.,<br />

DEZA, H.&GROENEN, G. (1997) The medical education environment<br />

measure: a diagnostic tool, Medical Education, 32, pp. 209–221.<br />

PIMPARYON, P., ROFF, S., MCALEER, S., POONCHAI, B. & PEMBA, S.<br />

(2000) Educational environment, student approaches to learning<br />

and academic achievement in a Thai nursing school, Medical Teacher,<br />

22(4), pp. 359–364.<br />

ROFF, S., MCALEER, S., HARDEN, R.M., AL-QAHTANI, M., AHMED, A.U.,<br />

DEZA, H., GROENEN, G.&PRIMPARYON, P. (1997) Development and<br />

validation of the Dundee Ready Education Environment Measure<br />

(DREEM), Medical Teacher, 19(4), pp. 295–299.<br />

ROFF, S., MCALEER, S., IFERE, O.S. & BHATTACHARYA, S. (2001) A global<br />

diagnostic tool for measuring educational environment comparing<br />

Nigeria and Nepal, Medical Teacher, 34(4), pp. 378–382.<br />

45

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!