Research in Engineering Education Symposium 2011 - rees2009

Universidad Politécnica de Madrid (UPM) Página 879 de 957
Data Collection
The PSVT:R and the MCT will be implemented to 300 students in 15 sections of EGR 120,
in August 2011. The instruments will be completed during the regularly schedule class
time. Each teacher will be briefed on the two tests and their administration. The tests will
be paper-based and timed. The teachers will be provided with written directions,
describing the procedures for administering the PSVT:R and MCT. The tests will be
administered prior to any classroom instruction on 3D solid modeling.
Of the 300 hundred students to be tested, two from section will be interviewed as a means
of critically examining how students constructed their 3D models. One higher performing
and lower performing student from section, the aggregate scores from both instruments
will be used as the selection criterion. Participants will be asked to review their answers
on the two tests as well as describe their modeling strategies of several 3D solid models.
Data Analysis
Data Analysis will involve two phases. The first phase will involve a detailed item analysis
of both instruments, to determine the validity. Statics to be reported for all items on both
tests are: item discrimination, item difficulty, and item total score correlation. Overall
instrument validity for the PSV:T and MCT will also be determined. This information will
be provided for the presentation.
The second phase will involve a content analysis of the students’ responses in the
interviews. This data analysis process will be inductive (Krippendorf, 2003). This
information will not be provided for the presentation.
Findings/Conclusions/Recommendations
As this paper is documenting research in progress, findings, conclusions, and
recommendations will not be available until September 2011and will be provided for the
presentation.
References
ABET. (2009). Criteria For Accrediting Engineering Programs: Effective Evaluations
During the 2010-2100 Accreditation Cycle. In A. B. o. Directors (Ed.).
Barr, R. E., Thomas J. Krueger, & Theodore A. Aanstoos. (2003). Assessing Student Outcomes
in an Engineering Design and Grpahics Course. Paper presented at the ASEE Annual
Conference and Exposition, Nashville, TN.
Barr, R. E., Thomas J. Krueger, & Theodore A. Aanstoos. (2004). Results of an EDG Student
Outcomes Survey. Paper presented at the ASEE Annual Conference and Exposition,
Salt Lake City, UT.
Barr, R. E., Thomas J. Krueger, & Theodore A. Aanstoos. (2005). Addressing Program
Outcomes in a Freshmen Introduction to Engineering Course. Paper presented at the
ASEE Annual Conference and Exposition, Portland, OR.
Proceedings of Research in Engineering Education Symposium 2011
Madrid, 4 th - 7 th October 2011